Aug 14 16:31:40 user nova-compute[73056]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 14 16:31:43 user nova-compute[73056]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=73056) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=73056) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=73056) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 14 16:31:43 user nova-compute[73056]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:31:43 user nova-compute[73056]: INFO nova.virt.driver [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 14 16:31:43 user nova-compute[73056]: INFO nova.compute.provider_config [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] Acquiring lock "singleton_lock" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] Acquired lock "singleton_lock" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] Releasing lock "singleton_lock" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] Full set of CONF: {{(pid=73056) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] ******************************************************************************** {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] Configuration options gathered from: {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] ================================================================================ {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] allow_resize_to_same_host      = True {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] arq_binding_timeout            = 300 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] backdoor_port                  = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] backdoor_socket                = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] block_device_allocate_retries  = 300 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] block_device_allocate_retries_interval = 5 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cert                           = self.pem {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] compute_monitors               = [] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] config_dir                     = [] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] config_drive_format            = iso9660 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] config_source                  = [] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] console_host                   = user {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] control_exchange               = nova {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cpu_allocation_ratio           = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] daemon                         = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] debug                          = True {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] default_access_ip_network_name = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] default_availability_zone      = nova {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] default_ephemeral_format       = ext4 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] default_schedule_zone          = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] disk_allocation_ratio          = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] enable_new_services            = True {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] enabled_apis                   = ['osapi_compute'] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] enabled_ssl_apis               = [] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] flat_injected                  = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] force_config_drive             = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] force_raw_images               = True {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] graceful_shutdown_timeout      = 5 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] heal_instance_info_cache_interval = 60 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] host                           = user {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] instance_build_timeout         = 0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] instance_delete_interval       = 300 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] instance_format                = [instance: %(uuid)s]  {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] instance_name_template         = instance-%08x {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] instance_usage_audit           = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] instance_usage_audit_period    = month {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] internal_service_availability_zone = internal {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] key                            = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] live_migration_retry_count     = 30 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] log_config_append              = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] log_dir                        = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] log_file                       = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] log_options                    = True {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] log_rotate_interval            = 1 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] log_rotate_interval_type       = days {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] log_rotation_type              = none {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] long_rpc_timeout               = 1800 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] max_concurrent_builds          = 10 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] max_concurrent_live_migrations = 1 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] max_concurrent_snapshots       = 5 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] max_local_block_devices        = 3 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] max_logfile_count              = 30 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] max_logfile_size_mb            = 200 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] maximum_instance_delete_attempts = 5 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] metadata_listen                = 0.0.0.0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] metadata_listen_port           = 8775 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] metadata_workers               = 3 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] migrate_max_retries            = -1 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] mkisofs_cmd                    = genisoimage {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] my_ip                          = 10.0.0.210 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] network_allocate_retries       = 0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] osapi_compute_listen_port      = 8774 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] osapi_compute_unique_server_name_scope =  {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] osapi_compute_workers          = 3 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] password_length                = 12 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] periodic_enable                = True {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] periodic_fuzzy_delay           = 60 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] pointer_model                  = ps2mouse {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] preallocate_images             = none {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] publish_errors                 = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] pybasedir                      = /opt/stack/nova {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] ram_allocation_ratio           = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] rate_limit_burst               = 0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] rate_limit_except_level        = CRITICAL {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] rate_limit_interval            = 0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] reboot_timeout                 = 0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] reclaim_instance_interval      = 0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] record                         = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] reimage_timeout_per_gb         = 60 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] report_interval                = 120 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] rescue_timeout                 = 0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] reserved_host_cpus             = 0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] reserved_host_disk_mb          = 0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] reserved_host_memory_mb        = 512 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] reserved_huge_pages            = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] resize_confirm_window          = 0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] resize_fs_using_block_device   = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] resume_guests_state_on_host_boot = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] rpc_response_timeout           = 60 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] run_external_periodic_tasks    = True {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] running_deleted_instance_action = reap {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] running_deleted_instance_poll_interval = 1800 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] running_deleted_instance_timeout = 0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] scheduler_instance_sync_interval = 120 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] service_down_time              = 720 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] servicegroup_driver            = db {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] shelved_offload_time           = 0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] shelved_poll_interval          = 3600 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] shutdown_timeout               = 0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] source_is_ipv6                 = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] ssl_only                       = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] state_path                     = /opt/stack/data/nova {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] sync_power_state_interval      = 600 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] sync_power_state_pool_size     = 1000 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] syslog_log_facility            = LOG_USER {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] tempdir                        = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] timeout_nbd                    = 10 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] transport_url                  = **** {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] update_resources_interval      = 0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] use_cow_images                 = True {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] use_eventlog                   = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] use_journal                    = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] use_json                       = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] use_rootwrap_daemon            = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] use_stderr                     = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] use_syslog                     = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vcpu_pin_set                   = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vif_plugging_is_fatal          = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vif_plugging_timeout           = 0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] virt_mkfs                      = [] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] volume_usage_poll_interval     = 0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] watch_log_file                 = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] web                            = /usr/share/spice-html5 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_concurrency.disable_process_locking = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api.auth_strategy              = keystone {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api.compute_link_prefix        = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api.dhcp_domain                = novalocal {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api.enable_instance_password   = True {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api.glance_link_prefix         = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api.instance_list_per_project_cells = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api.list_records_by_skipping_down_cells = True {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api.local_metadata_per_cell    = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api.max_limit                  = 1000 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api.metadata_cache_expiration  = 15 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api.neutron_default_tenant_id  = default {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api.use_forwarded_for          = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api.use_neutron_default_nets   = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api.vendordata_dynamic_targets = [] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api.vendordata_jsonfile_path   = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cache.backend                  = dogpile.cache.memcached {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cache.backend_argument         = **** {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cache.config_prefix            = cache.oslo {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cache.dead_timeout             = 60.0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cache.debug_cache_backend      = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cache.enable_retry_client      = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cache.enable_socket_keepalive  = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cache.enabled                  = True {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cache.expiration_time          = 600 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cache.hashclient_retry_attempts = 2 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cache.memcache_dead_retry      = 300 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cache.memcache_password        =  {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cache.memcache_pool_maxsize    = 10 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cache.memcache_sasl_enabled    = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cache.memcache_username        =  {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cache.proxies                  = [] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cache.retry_attempts           = 2 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cache.retry_delay              = 0.0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cache.socket_keepalive_count   = 1 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cache.socket_keepalive_idle    = 1 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cache.socket_keepalive_interval = 1 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cache.tls_allowed_ciphers      = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cache.tls_cafile               = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cache.tls_certfile             = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cache.tls_enabled              = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cache.tls_keyfile              = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cinder.auth_section            = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cinder.auth_type               = password {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cinder.cafile                  = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cinder.certfile                = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cinder.collect_timing          = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cinder.cross_az_attach         = True {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cinder.debug                   = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cinder.endpoint_template       = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cinder.http_retries            = 3 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cinder.insecure                = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cinder.keyfile                 = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cinder.os_region_name          = RegionOne {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cinder.split_loggers           = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cinder.timeout                 = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] compute.cpu_dedicated_set      = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] compute.cpu_shared_set         = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] compute.image_type_exclude_list = [] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] compute.max_concurrent_disk_ops = 0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] compute.max_disk_devices_to_attach = -1 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] compute.resource_provider_association_refresh = 300 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] compute.shutdown_retry_interval = 10 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] conductor.workers              = 3 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] console.allowed_origins        = [] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] console.ssl_ciphers            = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] console.ssl_minimum_version    = default {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] consoleauth.token_ttl          = 600 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cyborg.cafile                  = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cyborg.certfile                = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cyborg.collect_timing          = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cyborg.connect_retries         = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cyborg.connect_retry_delay     = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cyborg.endpoint_override       = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cyborg.insecure                = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cyborg.keyfile                 = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cyborg.max_version             = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cyborg.min_version             = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cyborg.region_name             = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cyborg.service_name            = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cyborg.service_type            = accelerator {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cyborg.split_loggers           = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cyborg.status_code_retries     = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cyborg.status_code_retry_delay = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cyborg.timeout                 = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] cyborg.version                 = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] database.backend               = sqlalchemy {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] database.connection            = **** {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] database.connection_debug      = 0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] database.connection_parameters =  {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] database.connection_recycle_time = 3600 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] database.connection_trace      = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] database.db_inc_retry_interval = True {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] database.db_max_retries        = 20 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] database.db_max_retry_interval = 10 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] database.db_retry_interval     = 1 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] database.max_overflow          = 50 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] database.max_pool_size         = 5 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] database.max_retries           = 10 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] database.mysql_enable_ndb      = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] database.mysql_wsrep_sync_wait = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] database.pool_timeout          = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] database.retry_interval        = 10 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] database.slave_connection      = **** {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] database.sqlite_synchronous    = True {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api_database.backend           = sqlalchemy {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api_database.connection        = **** {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api_database.connection_debug  = 0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api_database.connection_parameters =  {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api_database.connection_recycle_time = 3600 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api_database.connection_trace  = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api_database.db_inc_retry_interval = True {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api_database.db_max_retries    = 20 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api_database.db_max_retry_interval = 10 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api_database.db_retry_interval = 1 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api_database.max_overflow      = 50 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api_database.max_pool_size     = 5 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api_database.max_retries       = 10 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api_database.mysql_enable_ndb  = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api_database.pool_timeout      = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api_database.retry_interval    = 10 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api_database.slave_connection  = **** {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] api_database.sqlite_synchronous = True {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] devices.enabled_mdev_types     = [] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] ephemeral_storage_encryption.enabled = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] glance.api_servers             = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] glance.cafile                  = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] glance.certfile                = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] glance.collect_timing          = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] glance.connect_retries         = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] glance.connect_retry_delay     = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] glance.debug                   = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] glance.default_trusted_certificate_ids = [] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] glance.enable_certificate_validation = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] glance.enable_rbd_download     = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] glance.endpoint_override       = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] glance.insecure                = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] glance.keyfile                 = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] glance.max_version             = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] glance.min_version             = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] glance.num_retries             = 3 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] glance.rbd_ceph_conf           =  {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] glance.rbd_connect_timeout     = 5 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] glance.rbd_pool                =  {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] glance.rbd_user                =  {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] glance.region_name             = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] glance.service_name            = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] glance.service_type            = image {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] glance.split_loggers           = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] glance.status_code_retries     = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] glance.status_code_retry_delay = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] glance.timeout                 = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] glance.verify_glance_signatures = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] glance.version                 = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] guestfs.debug                  = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] hyperv.config_drive_cdrom      = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] hyperv.config_drive_inject_password = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] hyperv.enable_instance_metrics_collection = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] hyperv.enable_remotefx         = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] hyperv.instances_path_share    =  {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] hyperv.iscsi_initiator_list    = [] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] hyperv.limit_cpu_features      = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] hyperv.power_state_check_timeframe = 60 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] hyperv.use_multipath_io        = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] hyperv.volume_attach_retry_count = 10 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] hyperv.vswitch_name            = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] mks.enabled                    = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] image_cache.manager_interval   = 2400 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] image_cache.precache_concurrency = 1 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] image_cache.remove_unused_base_images = True {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] image_cache.subdirectory_name  = _base {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] ironic.api_max_retries         = 60 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] ironic.api_retry_interval      = 2 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] ironic.auth_section            = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] ironic.auth_type               = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] ironic.cafile                  = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] ironic.certfile                = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] ironic.collect_timing          = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] ironic.connect_retries         = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] ironic.connect_retry_delay     = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] ironic.endpoint_override       = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] ironic.insecure                = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] ironic.keyfile                 = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] ironic.max_version             = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] ironic.min_version             = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] ironic.partition_key           = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] ironic.peer_list               = [] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] ironic.region_name             = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] ironic.serial_console_state_timeout = 10 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] ironic.service_name            = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] ironic.service_type            = baremetal {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] ironic.split_loggers           = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] ironic.status_code_retries     = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] ironic.status_code_retry_delay = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] ironic.timeout                 = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] ironic.version                 = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] key_manager.fixed_key          = **** {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] barbican.barbican_api_version  = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] barbican.barbican_endpoint     = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] barbican.barbican_endpoint_type = public {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] barbican.barbican_region_name  = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] barbican.cafile                = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] barbican.certfile              = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] barbican.collect_timing        = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] barbican.insecure              = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] barbican.keyfile               = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] barbican.number_of_retries     = 60 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] barbican.retry_delay           = 1 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] barbican.send_service_user_token = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] barbican.split_loggers         = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] barbican.timeout               = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] barbican.verify_ssl            = True {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] barbican.verify_ssl_path       = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] barbican_service_user.auth_section = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] barbican_service_user.auth_type = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] barbican_service_user.cafile   = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] barbican_service_user.certfile = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] barbican_service_user.collect_timing = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] barbican_service_user.insecure = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] barbican_service_user.keyfile  = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] barbican_service_user.split_loggers = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] barbican_service_user.timeout  = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vault.approle_role_id          = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vault.approle_secret_id        = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vault.cafile                   = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vault.certfile                 = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vault.collect_timing           = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vault.insecure                 = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vault.keyfile                  = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vault.kv_mountpoint            = secret {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vault.kv_version               = 2 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vault.namespace                = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vault.root_token_id            = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vault.split_loggers            = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vault.ssl_ca_crt_file          = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vault.timeout                  = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vault.use_ssl                  = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] keystone.cafile                = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] keystone.certfile              = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] keystone.collect_timing        = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] keystone.connect_retries       = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] keystone.connect_retry_delay   = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] keystone.endpoint_override     = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] keystone.insecure              = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] keystone.keyfile               = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] keystone.max_version           = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] keystone.min_version           = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] keystone.region_name           = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] keystone.service_name          = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] keystone.service_type          = identity {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] keystone.split_loggers         = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] keystone.status_code_retries   = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] keystone.status_code_retry_delay = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] keystone.timeout               = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] keystone.version               = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.connection_uri         =  {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.cpu_mode               = custom {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: WARNING oslo_config.cfg [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.cpu_power_governor_high = performance {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.cpu_power_governor_low = powersave {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.cpu_power_management   = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.device_detach_attempts = 8 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.device_detach_timeout  = 20 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.disk_cachemodes        = [] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.disk_prefix            = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.enabled_perf_events    = [] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.file_backed_memory     = 0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.gid_maps               = [] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.hw_disk_discard        = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.hw_machine_type        = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.images_rbd_glance_store_name =  {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.images_rbd_pool        = rbd {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.images_type            = default {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.images_volume_group    = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.inject_key             = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.inject_partition       = -2 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.inject_password        = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.iscsi_iface            = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.iser_use_multipath     = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.live_migration_bandwidth = 0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.live_migration_downtime = 500 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.live_migration_inbound_addr = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.live_migration_permit_post_copy = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.live_migration_scheme  = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.live_migration_timeout_action = abort {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.live_migration_tunnelled = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: WARNING oslo_config.cfg [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 14 16:31:43 user nova-compute[73056]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 14 16:31:43 user nova-compute[73056]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 14 16:31:43 user nova-compute[73056]: and ``live_migration_inbound_addr`` respectively.
Aug 14 16:31:43 user nova-compute[73056]: ).  Its value may be silently ignored in the future.
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.live_migration_with_native_tls = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.max_queues             = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.nfs_mount_options      = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.num_memory_encrypted_guests = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.num_pcie_ports         = 0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.pmem_namespaces        = [] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.quobyte_client_cfg     = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.rbd_secret_uuid        = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.rbd_user               = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.remote_filesystem_transport = ssh {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.rescue_image_id        = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.rescue_kernel_id       = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.rescue_ramdisk_id      = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.rx_queue_size          = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.smbfs_mount_options    =  {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.snapshot_compression   = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.snapshot_image_format  = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.sparse_logical_volumes = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.swtpm_enabled          = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.swtpm_group            = tss {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.swtpm_user             = tss {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.sysinfo_serial         = unique {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.tb_cache_size          = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.tx_queue_size          = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.uid_maps               = [] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.use_virtio_for_bridges = True {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.virt_type              = kvm {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.volume_clear           = zero {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.volume_clear_size      = 0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.volume_use_multipath   = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.vzstorage_cache_path   = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.vzstorage_mount_user   = stack {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] neutron.auth_section           = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] neutron.auth_type              = password {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] neutron.cafile                 = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] neutron.certfile               = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] neutron.collect_timing         = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] neutron.connect_retries        = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] neutron.connect_retry_delay    = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] neutron.default_floating_pool  = public {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] neutron.endpoint_override      = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] neutron.extension_sync_interval = 600 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] neutron.http_retries           = 3 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] neutron.insecure               = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] neutron.keyfile                = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] neutron.max_version            = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] neutron.min_version            = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] neutron.ovs_bridge             = br-int {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] neutron.physnets               = [] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] neutron.region_name            = RegionOne {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] neutron.service_metadata_proxy = True {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] neutron.service_name           = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] neutron.service_type           = network {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] neutron.split_loggers          = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] neutron.status_code_retries    = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] neutron.status_code_retry_delay = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] neutron.timeout                = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] neutron.version                = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] notifications.bdms_in_notifications = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] notifications.default_level    = INFO {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] notifications.notification_format = unversioned {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] notifications.notify_on_state_change = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] pci.alias                      = [] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] pci.device_spec                = [] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] pci.report_in_placement        = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] placement.auth_section         = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] placement.auth_type            = password {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] placement.cafile               = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] placement.certfile             = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] placement.collect_timing       = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] placement.connect_retries      = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] placement.connect_retry_delay  = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] placement.default_domain_id    = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] placement.default_domain_name  = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] placement.domain_id            = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] placement.domain_name          = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] placement.endpoint_override    = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] placement.insecure             = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] placement.keyfile              = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] placement.max_version          = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] placement.min_version          = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] placement.password             = **** {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] placement.project_domain_id    = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] placement.project_domain_name  = Default {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] placement.project_id           = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] placement.project_name         = service {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] placement.region_name          = RegionOne {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] placement.service_name         = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] placement.service_type         = placement {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] placement.split_loggers        = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] placement.status_code_retries  = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] placement.status_code_retry_delay = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] placement.system_scope         = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] placement.timeout              = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] placement.trust_id             = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] placement.user_domain_id       = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] placement.user_domain_name     = Default {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] placement.user_id              = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] placement.username             = placement {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] placement.version              = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] quota.cores                    = 20 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] quota.count_usage_from_placement = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] quota.injected_file_content_bytes = 10240 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] quota.injected_file_path_length = 255 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] quota.injected_files           = 5 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] quota.instances                = 10 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] quota.key_pairs                = 100 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] quota.metadata_items           = 128 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] quota.ram                      = 51200 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] quota.recheck_quota            = True {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] quota.server_group_members     = 10 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] quota.server_groups            = 10 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] rdp.enabled                    = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] scheduler.image_metadata_prefilter = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] scheduler.max_attempts         = 3 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] scheduler.max_placement_results = 1000 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] scheduler.query_placement_for_availability_zone = True {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] scheduler.query_placement_for_image_type_support = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] scheduler.workers              = 3 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] filter_scheduler.host_subset_size = 1 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] filter_scheduler.isolated_hosts = [] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] filter_scheduler.isolated_images = [] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] filter_scheduler.pci_in_placement = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] filter_scheduler.track_instance_changes = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] metrics.required               = True {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] metrics.weight_multiplier      = 1.0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] metrics.weight_setting         = [] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] serial_console.enabled         = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] serial_console.port_range      = 10000:20000 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] serial_console.serialproxy_port = 6083 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] service_user.auth_section      = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] service_user.auth_type         = password {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] service_user.cafile            = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] service_user.certfile          = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] service_user.collect_timing    = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] service_user.insecure          = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] service_user.keyfile           = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] service_user.send_service_user_token = True {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] service_user.split_loggers     = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] service_user.timeout           = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] spice.agent_enabled            = True {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] spice.enabled                  = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] spice.html5proxy_port          = 6082 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] spice.image_compression        = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] spice.jpeg_compression         = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] spice.playback_compression     = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] spice.server_listen            = 127.0.0.1 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] spice.streaming_mode           = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] spice.zlib_compression         = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] upgrade_levels.baseapi         = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] upgrade_levels.cert            = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] upgrade_levels.compute         = auto {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] upgrade_levels.conductor       = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] upgrade_levels.scheduler       = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vendordata_dynamic_auth.auth_section = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vendordata_dynamic_auth.auth_type = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vendordata_dynamic_auth.cafile = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vendordata_dynamic_auth.certfile = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vendordata_dynamic_auth.insecure = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vendordata_dynamic_auth.keyfile = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vendordata_dynamic_auth.timeout = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vmware.api_retry_count         = 10 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vmware.ca_file                 = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vmware.cache_prefix            = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vmware.cluster_name            = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vmware.connection_pool_size    = 10 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vmware.console_delay_seconds   = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vmware.datastore_regex         = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vmware.host_ip                 = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vmware.host_password           = **** {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vmware.host_port               = 443 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vmware.host_username           = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vmware.insecure                = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vmware.integration_bridge      = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vmware.maximum_objects         = 100 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vmware.pbm_default_policy      = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vmware.pbm_enabled             = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vmware.pbm_wsdl_location       = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vmware.serial_port_proxy_uri   = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vmware.serial_port_service_uri = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vmware.task_poll_interval      = 0.5 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vmware.use_linked_clone        = True {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vmware.vnc_keymap              = en-us {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vmware.vnc_port                = 5900 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vmware.vnc_port_total          = 10000 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vnc.auth_schemes               = ['none'] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vnc.enabled                    = True {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vnc.novncproxy_port            = 6080 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vnc.server_listen              = 0.0.0.0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vnc.vencrypt_ca_certs          = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vnc.vencrypt_client_cert       = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vnc.vencrypt_client_key        = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] workarounds.disable_rootwrap   = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] workarounds.enable_numa_live_migration = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] workarounds.libvirt_disable_apic = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] wsgi.client_socket_timeout     = 900 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] wsgi.default_pool_size         = 1000 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] wsgi.keep_alive                = True {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] wsgi.max_header_line           = 16384 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] wsgi.ssl_ca_file               = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] wsgi.ssl_cert_file             = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] wsgi.ssl_key_file              = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] wsgi.tcp_keepidle              = 600 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] zvm.ca_file                    = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] zvm.cloud_connector_url        = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] zvm.reachable_timeout          = 300 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_policy.enforce_new_defaults = True {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_policy.enforce_scope      = True {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_policy.policy_default_rule = default {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_policy.policy_file        = policy.yaml {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] profiler.connection_string     = messaging:// {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] profiler.enabled               = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] profiler.es_doc_type           = notification {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] profiler.es_scroll_size        = 10000 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] profiler.es_scroll_time        = 2m {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] profiler.filter_error_trace    = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] profiler.hmac_keys             = **** {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] profiler.sentinel_service_name = mymaster {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] profiler.socket_timeout        = 0.1 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] profiler.trace_requests        = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] profiler.trace_sqlalchemy      = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] profiler_jaeger.process_tags   = {} {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] profiler_jaeger.service_name_prefix = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] profiler_otlp.service_name_prefix = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] remote_debug.host              = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] remote_debug.port              = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_messaging_rabbit.ssl      = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:43 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_messaging_notifications.retry = -1 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_limit.auth_section        = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_limit.auth_type           = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_limit.cafile              = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_limit.certfile            = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_limit.collect_timing      = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_limit.connect_retries     = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_limit.connect_retry_delay = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_limit.endpoint_id         = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_limit.endpoint_override   = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_limit.insecure            = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_limit.keyfile             = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_limit.max_version         = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_limit.min_version         = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_limit.region_name         = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_limit.service_name        = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_limit.service_type        = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_limit.split_loggers       = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_limit.status_code_retries = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_limit.status_code_retry_delay = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_limit.timeout             = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_limit.valid_interfaces    = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_limit.version             = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_reports.file_event_handler = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] oslo_reports.log_dir           = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vif_plug_ovs_privileged.group  = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] vif_plug_ovs_privileged.user   = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] os_vif_linux_bridge.flat_interface = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] os_vif_ovs.isolate_vif         = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] os_vif_ovs.per_port_bridge     = False {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] os_brick.lock_path             = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] privsep_osbrick.capabilities   = [21] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] privsep_osbrick.group          = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] privsep_osbrick.helper_command = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] privsep_osbrick.user           = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] nova_sys_admin.group           = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] nova_sys_admin.helper_command  = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] nova_sys_admin.user            = None {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG oslo_service.service [None req-a53a698b-89bf-4c65-903b-ea9c17f4c079 None None] ******************************************************************************** {{(pid=73056) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 14 16:31:44 user nova-compute[73056]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 14 16:31:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Starting native event thread {{(pid=73056) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Starting green dispatch thread {{(pid=73056) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Starting connection event dispatch thread {{(pid=73056) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Connecting to libvirt: qemu:///system {{(pid=73056) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7ff32c1fcdc0> {{(pid=73056) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 14 16:31:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7ff32c1fcdc0> {{(pid=73056) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 14 16:31:44 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Connection event '1' reason 'None'
Aug 14 16:31:44 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 14 16:31:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.mount [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Initialising _HostMountState generation 0 {{(pid=73056) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 14 16:31:51 user nova-compute[73056]: INFO nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Libvirt host capabilities <capabilities>
Aug 14 16:31:51 user nova-compute[73056]:   <host>
Aug 14 16:31:51 user nova-compute[73056]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 14 16:31:51 user nova-compute[73056]:     <cpu>
Aug 14 16:31:51 user nova-compute[73056]:       <arch>x86_64</arch>
Aug 14 16:31:51 user nova-compute[73056]:       <model>IvyBridge-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <vendor>Intel</vendor>
Aug 14 16:31:51 user nova-compute[73056]:       <microcode version='1070'/>
Aug 14 16:31:51 user nova-compute[73056]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 14 16:31:51 user nova-compute[73056]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature name='ss'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature name='vmx'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature name='pcid'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature name='osxsave'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature name='hypervisor'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature name='arat'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature name='tsc_adjust'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature name='md-clear'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature name='stibp'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature name='arch-capabilities'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature name='ssbd'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature name='invtsc'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature name='rsba'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature name='skip-l1dfl-vmentry'/>
Aug 14 16:31:51 user nova-compute[73056]:       <pages unit='KiB' size='4'/>
Aug 14 16:31:51 user nova-compute[73056]:       <pages unit='KiB' size='2048'/>
Aug 14 16:31:51 user nova-compute[73056]:     </cpu>
Aug 14 16:31:51 user nova-compute[73056]:     <power_management>
Aug 14 16:31:51 user nova-compute[73056]:       <suspend_mem/>
Aug 14 16:31:51 user nova-compute[73056]:       <suspend_disk/>
Aug 14 16:31:51 user nova-compute[73056]:       <suspend_hybrid/>
Aug 14 16:31:51 user nova-compute[73056]:     </power_management>
Aug 14 16:31:51 user nova-compute[73056]:     <iommu support='no'/>
Aug 14 16:31:51 user nova-compute[73056]:     <migration_features>
Aug 14 16:31:51 user nova-compute[73056]:       <live/>
Aug 14 16:31:51 user nova-compute[73056]:       <uri_transports>
Aug 14 16:31:51 user nova-compute[73056]:         <uri_transport>tcp</uri_transport>
Aug 14 16:31:51 user nova-compute[73056]:         <uri_transport>rdma</uri_transport>
Aug 14 16:31:51 user nova-compute[73056]:       </uri_transports>
Aug 14 16:31:51 user nova-compute[73056]:     </migration_features>
Aug 14 16:31:51 user nova-compute[73056]:     <topology>
Aug 14 16:31:51 user nova-compute[73056]:       <cells num='2'>
Aug 14 16:31:51 user nova-compute[73056]:         <cell id='0'>
Aug 14 16:31:51 user nova-compute[73056]:           <memory unit='KiB'>8140616</memory>
Aug 14 16:31:51 user nova-compute[73056]:           <pages unit='KiB' size='4'>2035154</pages>
Aug 14 16:31:51 user nova-compute[73056]:           <pages unit='KiB' size='2048'>0</pages>
Aug 14 16:31:51 user nova-compute[73056]:           <distances>
Aug 14 16:31:51 user nova-compute[73056]:             <sibling id='0' value='10'/>
Aug 14 16:31:51 user nova-compute[73056]:             <sibling id='1' value='20'/>
Aug 14 16:31:51 user nova-compute[73056]:           </distances>
Aug 14 16:31:51 user nova-compute[73056]:           <cpus num='6'>
Aug 14 16:31:51 user nova-compute[73056]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 14 16:31:51 user nova-compute[73056]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 14 16:31:51 user nova-compute[73056]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 14 16:31:51 user nova-compute[73056]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 14 16:31:51 user nova-compute[73056]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 14 16:31:51 user nova-compute[73056]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 14 16:31:51 user nova-compute[73056]:           </cpus>
Aug 14 16:31:51 user nova-compute[73056]:         </cell>
Aug 14 16:31:51 user nova-compute[73056]:         <cell id='1'>
Aug 14 16:31:51 user nova-compute[73056]:           <memory unit='KiB'>8255068</memory>
Aug 14 16:31:51 user nova-compute[73056]:           <pages unit='KiB' size='4'>2063767</pages>
Aug 14 16:31:51 user nova-compute[73056]:           <pages unit='KiB' size='2048'>0</pages>
Aug 14 16:31:51 user nova-compute[73056]:           <distances>
Aug 14 16:31:51 user nova-compute[73056]:             <sibling id='0' value='20'/>
Aug 14 16:31:51 user nova-compute[73056]:             <sibling id='1' value='10'/>
Aug 14 16:31:51 user nova-compute[73056]:           </distances>
Aug 14 16:31:51 user nova-compute[73056]:           <cpus num='6'>
Aug 14 16:31:51 user nova-compute[73056]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 14 16:31:51 user nova-compute[73056]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 14 16:31:51 user nova-compute[73056]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 14 16:31:51 user nova-compute[73056]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 14 16:31:51 user nova-compute[73056]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 14 16:31:51 user nova-compute[73056]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 14 16:31:51 user nova-compute[73056]:           </cpus>
Aug 14 16:31:51 user nova-compute[73056]:         </cell>
Aug 14 16:31:51 user nova-compute[73056]:       </cells>
Aug 14 16:31:51 user nova-compute[73056]:     </topology>
Aug 14 16:31:51 user nova-compute[73056]:     <cache>
Aug 14 16:31:51 user nova-compute[73056]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 14 16:31:51 user nova-compute[73056]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 14 16:31:51 user nova-compute[73056]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 14 16:31:51 user nova-compute[73056]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 14 16:31:51 user nova-compute[73056]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 14 16:31:51 user nova-compute[73056]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 14 16:31:51 user nova-compute[73056]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 14 16:31:51 user nova-compute[73056]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 14 16:31:51 user nova-compute[73056]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 14 16:31:51 user nova-compute[73056]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 14 16:31:51 user nova-compute[73056]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 14 16:31:51 user nova-compute[73056]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 14 16:31:51 user nova-compute[73056]:     </cache>
Aug 14 16:31:51 user nova-compute[73056]:     <secmodel>
Aug 14 16:31:51 user nova-compute[73056]:       <model>apparmor</model>
Aug 14 16:31:51 user nova-compute[73056]:       <doi>0</doi>
Aug 14 16:31:51 user nova-compute[73056]:     </secmodel>
Aug 14 16:31:51 user nova-compute[73056]:     <secmodel>
Aug 14 16:31:51 user nova-compute[73056]:       <model>dac</model>
Aug 14 16:31:51 user nova-compute[73056]:       <doi>0</doi>
Aug 14 16:31:51 user nova-compute[73056]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 14 16:31:51 user nova-compute[73056]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 14 16:31:51 user nova-compute[73056]:     </secmodel>
Aug 14 16:31:51 user nova-compute[73056]:   </host>
Aug 14 16:31:51 user nova-compute[73056]:   <guest>
Aug 14 16:31:51 user nova-compute[73056]:     <os_type>hvm</os_type>
Aug 14 16:31:51 user nova-compute[73056]:     <arch name='alpha'>
Aug 14 16:31:51 user nova-compute[73056]:       <wordsize>64</wordsize>
Aug 14 16:31:51 user nova-compute[73056]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='4'>clipper</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <domain type='qemu'/>
Aug 14 16:31:51 user nova-compute[73056]:     </arch>
Aug 14 16:31:51 user nova-compute[73056]:     <features>
Aug 14 16:31:51 user nova-compute[73056]:       <cpuselection/>
Aug 14 16:31:51 user nova-compute[73056]:       <deviceboot/>
Aug 14 16:31:51 user nova-compute[73056]:       <disksnapshot default='on' toggle='no'/>
Aug 14 16:31:51 user nova-compute[73056]:     </features>
Aug 14 16:31:51 user nova-compute[73056]:   </guest>
Aug 14 16:31:51 user nova-compute[73056]:   <guest>
Aug 14 16:31:51 user nova-compute[73056]:     <os_type>hvm</os_type>
Aug 14 16:31:51 user nova-compute[73056]:     <arch name='armv6l'>
Aug 14 16:31:51 user nova-compute[73056]:       <wordsize>32</wordsize>
Aug 14 16:31:51 user nova-compute[73056]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>integratorcp</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>borzoi</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>spitz</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>nuri</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>musca-b1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>versatileab</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>kzm</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>musca-a</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>smdkc210</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>sx1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>z2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>tosa</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='4'>sabrelite</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>realview-eb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>n810</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>n800</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>versatilepb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>terrier</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>mainstone</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='4'>midway</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>musicpal</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>microbit</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>cubieboard</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>verdex</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>netduino2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='4'>raspi2b</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>cheetah</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='4'>highbank</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>akita</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>connex</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>collie</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>raspi0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <domain type='qemu'/>
Aug 14 16:31:51 user nova-compute[73056]:     </arch>
Aug 14 16:31:51 user nova-compute[73056]:     <features>
Aug 14 16:31:51 user nova-compute[73056]:       <cpuselection/>
Aug 14 16:31:51 user nova-compute[73056]:       <deviceboot/>
Aug 14 16:31:51 user nova-compute[73056]:       <disksnapshot default='on' toggle='no'/>
Aug 14 16:31:51 user nova-compute[73056]:     </features>
Aug 14 16:31:51 user nova-compute[73056]:   </guest>
Aug 14 16:31:51 user nova-compute[73056]:   <guest>
Aug 14 16:31:51 user nova-compute[73056]:     <os_type>hvm</os_type>
Aug 14 16:31:51 user nova-compute[73056]:     <arch name='armv7l'>
Aug 14 16:31:51 user nova-compute[73056]:       <wordsize>32</wordsize>
Aug 14 16:31:51 user nova-compute[73056]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>integratorcp</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>borzoi</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>spitz</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>nuri</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>musca-b1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>versatileab</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>kzm</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>musca-a</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>smdkc210</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>sx1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>z2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>tosa</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='4'>sabrelite</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>realview-eb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>n810</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>n800</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>versatilepb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>terrier</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>mainstone</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='4'>midway</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>musicpal</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>microbit</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>cubieboard</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>verdex</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>netduino2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='4'>raspi2b</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>cheetah</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='4'>highbank</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>akita</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>connex</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>collie</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>raspi0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <domain type='qemu'/>
Aug 14 16:31:51 user nova-compute[73056]:     </arch>
Aug 14 16:31:51 user nova-compute[73056]:     <features>
Aug 14 16:31:51 user nova-compute[73056]:       <cpuselection/>
Aug 14 16:31:51 user nova-compute[73056]:       <deviceboot/>
Aug 14 16:31:51 user nova-compute[73056]:       <disksnapshot default='on' toggle='no'/>
Aug 14 16:31:51 user nova-compute[73056]:     </features>
Aug 14 16:31:51 user nova-compute[73056]:   </guest>
Aug 14 16:31:51 user nova-compute[73056]:   <guest>
Aug 14 16:31:51 user nova-compute[73056]:     <os_type>hvm</os_type>
Aug 14 16:31:51 user nova-compute[73056]:     <arch name='aarch64'>
Aug 14 16:31:51 user nova-compute[73056]:       <wordsize>64</wordsize>
Aug 14 16:31:51 user nova-compute[73056]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>integratorcp</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>borzoi</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>spitz</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>nuri</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>musca-b1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>versatileab</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>kzm</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>musca-a</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>smdkc210</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>sx1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>z2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>tosa</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='4'>sabrelite</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>realview-eb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>n810</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>n800</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>versatilepb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>terrier</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>mainstone</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='4'>midway</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>musicpal</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>microbit</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>cubieboard</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>verdex</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>netduino2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='4'>raspi3b</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='4'>raspi2b</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>cheetah</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='4'>highbank</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>akita</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>connex</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>collie</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>raspi0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <domain type='qemu'/>
Aug 14 16:31:51 user nova-compute[73056]:     </arch>
Aug 14 16:31:51 user nova-compute[73056]:     <features>
Aug 14 16:31:51 user nova-compute[73056]:       <acpi default='on' toggle='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:       <cpuselection/>
Aug 14 16:31:51 user nova-compute[73056]:       <deviceboot/>
Aug 14 16:31:51 user nova-compute[73056]:       <disksnapshot default='on' toggle='no'/>
Aug 14 16:31:51 user nova-compute[73056]:     </features>
Aug 14 16:31:51 user nova-compute[73056]:   </guest>
Aug 14 16:31:51 user nova-compute[73056]:   <guest>
Aug 14 16:31:51 user nova-compute[73056]:     <os_type>hvm</os_type>
Aug 14 16:31:51 user nova-compute[73056]:     <arch name='cris'>
Aug 14 16:31:51 user nova-compute[73056]:       <wordsize>32</wordsize>
Aug 14 16:31:51 user nova-compute[73056]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <domain type='qemu'/>
Aug 14 16:31:51 user nova-compute[73056]:     </arch>
Aug 14 16:31:51 user nova-compute[73056]:     <features>
Aug 14 16:31:51 user nova-compute[73056]:       <cpuselection/>
Aug 14 16:31:51 user nova-compute[73056]:       <deviceboot/>
Aug 14 16:31:51 user nova-compute[73056]:       <disksnapshot default='on' toggle='no'/>
Aug 14 16:31:51 user nova-compute[73056]:     </features>
Aug 14 16:31:51 user nova-compute[73056]:   </guest>
Aug 14 16:31:51 user nova-compute[73056]:   <guest>
Aug 14 16:31:51 user nova-compute[73056]:     <os_type>hvm</os_type>
Aug 14 16:31:51 user nova-compute[73056]:     <arch name='i686'>
Aug 14 16:31:51 user nova-compute[73056]:       <wordsize>32</wordsize>
Aug 14 16:31:51 user nova-compute[73056]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>x-remote</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>isapc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>microvm</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <domain type='qemu'/>
Aug 14 16:31:51 user nova-compute[73056]:       <domain type='kvm'/>
Aug 14 16:31:51 user nova-compute[73056]:     </arch>
Aug 14 16:31:51 user nova-compute[73056]:     <features>
Aug 14 16:31:51 user nova-compute[73056]:       <pae/>
Aug 14 16:31:51 user nova-compute[73056]:       <nonpae/>
Aug 14 16:31:51 user nova-compute[73056]:       <acpi default='on' toggle='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:       <apic default='on' toggle='no'/>
Aug 14 16:31:51 user nova-compute[73056]:       <cpuselection/>
Aug 14 16:31:51 user nova-compute[73056]:       <deviceboot/>
Aug 14 16:31:51 user nova-compute[73056]:       <disksnapshot default='on' toggle='no'/>
Aug 14 16:31:51 user nova-compute[73056]:     </features>
Aug 14 16:31:51 user nova-compute[73056]:   </guest>
Aug 14 16:31:51 user nova-compute[73056]:   <guest>
Aug 14 16:31:51 user nova-compute[73056]:     <os_type>hvm</os_type>
Aug 14 16:31:51 user nova-compute[73056]:     <arch name='m68k'>
Aug 14 16:31:51 user nova-compute[73056]:       <wordsize>32</wordsize>
Aug 14 16:31:51 user nova-compute[73056]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>an5206</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>q800</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>next-cube</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <domain type='qemu'/>
Aug 14 16:31:51 user nova-compute[73056]:     </arch>
Aug 14 16:31:51 user nova-compute[73056]:     <features>
Aug 14 16:31:51 user nova-compute[73056]:       <cpuselection/>
Aug 14 16:31:51 user nova-compute[73056]:       <deviceboot/>
Aug 14 16:31:51 user nova-compute[73056]:       <disksnapshot default='on' toggle='no'/>
Aug 14 16:31:51 user nova-compute[73056]:     </features>
Aug 14 16:31:51 user nova-compute[73056]:   </guest>
Aug 14 16:31:51 user nova-compute[73056]:   <guest>
Aug 14 16:31:51 user nova-compute[73056]:     <os_type>hvm</os_type>
Aug 14 16:31:51 user nova-compute[73056]:     <arch name='microblaze'>
Aug 14 16:31:51 user nova-compute[73056]:       <wordsize>32</wordsize>
Aug 14 16:31:51 user nova-compute[73056]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <domain type='qemu'/>
Aug 14 16:31:51 user nova-compute[73056]:     </arch>
Aug 14 16:31:51 user nova-compute[73056]:     <features>
Aug 14 16:31:51 user nova-compute[73056]:       <cpuselection/>
Aug 14 16:31:51 user nova-compute[73056]:       <deviceboot/>
Aug 14 16:31:51 user nova-compute[73056]:       <disksnapshot default='on' toggle='no'/>
Aug 14 16:31:51 user nova-compute[73056]:     </features>
Aug 14 16:31:51 user nova-compute[73056]:   </guest>
Aug 14 16:31:51 user nova-compute[73056]:   <guest>
Aug 14 16:31:51 user nova-compute[73056]:     <os_type>hvm</os_type>
Aug 14 16:31:51 user nova-compute[73056]:     <arch name='microblazeel'>
Aug 14 16:31:51 user nova-compute[73056]:       <wordsize>32</wordsize>
Aug 14 16:31:51 user nova-compute[73056]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <domain type='qemu'/>
Aug 14 16:31:51 user nova-compute[73056]:     </arch>
Aug 14 16:31:51 user nova-compute[73056]:     <features>
Aug 14 16:31:51 user nova-compute[73056]:       <cpuselection/>
Aug 14 16:31:51 user nova-compute[73056]:       <deviceboot/>
Aug 14 16:31:51 user nova-compute[73056]:       <disksnapshot default='on' toggle='no'/>
Aug 14 16:31:51 user nova-compute[73056]:     </features>
Aug 14 16:31:51 user nova-compute[73056]:   </guest>
Aug 14 16:31:51 user nova-compute[73056]:   <guest>
Aug 14 16:31:51 user nova-compute[73056]:     <os_type>hvm</os_type>
Aug 14 16:31:51 user nova-compute[73056]:     <arch name='mips'>
Aug 14 16:31:51 user nova-compute[73056]:       <wordsize>32</wordsize>
Aug 14 16:31:51 user nova-compute[73056]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='16'>malta</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>mipssim</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <domain type='qemu'/>
Aug 14 16:31:51 user nova-compute[73056]:     </arch>
Aug 14 16:31:51 user nova-compute[73056]:     <features>
Aug 14 16:31:51 user nova-compute[73056]:       <cpuselection/>
Aug 14 16:31:51 user nova-compute[73056]:       <deviceboot/>
Aug 14 16:31:51 user nova-compute[73056]:       <disksnapshot default='on' toggle='no'/>
Aug 14 16:31:51 user nova-compute[73056]:     </features>
Aug 14 16:31:51 user nova-compute[73056]:   </guest>
Aug 14 16:31:51 user nova-compute[73056]:   <guest>
Aug 14 16:31:51 user nova-compute[73056]:     <os_type>hvm</os_type>
Aug 14 16:31:51 user nova-compute[73056]:     <arch name='mipsel'>
Aug 14 16:31:51 user nova-compute[73056]:       <wordsize>32</wordsize>
Aug 14 16:31:51 user nova-compute[73056]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='16'>malta</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>mipssim</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <domain type='qemu'/>
Aug 14 16:31:51 user nova-compute[73056]:     </arch>
Aug 14 16:31:51 user nova-compute[73056]:     <features>
Aug 14 16:31:51 user nova-compute[73056]:       <cpuselection/>
Aug 14 16:31:51 user nova-compute[73056]:       <deviceboot/>
Aug 14 16:31:51 user nova-compute[73056]:       <disksnapshot default='on' toggle='no'/>
Aug 14 16:31:51 user nova-compute[73056]:     </features>
Aug 14 16:31:51 user nova-compute[73056]:   </guest>
Aug 14 16:31:51 user nova-compute[73056]:   <guest>
Aug 14 16:31:51 user nova-compute[73056]:     <os_type>hvm</os_type>
Aug 14 16:31:51 user nova-compute[73056]:     <arch name='mips64'>
Aug 14 16:31:51 user nova-compute[73056]:       <wordsize>64</wordsize>
Aug 14 16:31:51 user nova-compute[73056]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='16'>malta</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>mipssim</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>pica61</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>magnum</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <domain type='qemu'/>
Aug 14 16:31:51 user nova-compute[73056]:     </arch>
Aug 14 16:31:51 user nova-compute[73056]:     <features>
Aug 14 16:31:51 user nova-compute[73056]:       <cpuselection/>
Aug 14 16:31:51 user nova-compute[73056]:       <deviceboot/>
Aug 14 16:31:51 user nova-compute[73056]:       <disksnapshot default='on' toggle='no'/>
Aug 14 16:31:51 user nova-compute[73056]:     </features>
Aug 14 16:31:51 user nova-compute[73056]:   </guest>
Aug 14 16:31:51 user nova-compute[73056]:   <guest>
Aug 14 16:31:51 user nova-compute[73056]:     <os_type>hvm</os_type>
Aug 14 16:31:51 user nova-compute[73056]:     <arch name='mips64el'>
Aug 14 16:31:51 user nova-compute[73056]:       <wordsize>64</wordsize>
Aug 14 16:31:51 user nova-compute[73056]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='16'>malta</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>mipssim</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>pica61</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>magnum</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='16'>boston</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <domain type='qemu'/>
Aug 14 16:31:51 user nova-compute[73056]:     </arch>
Aug 14 16:31:51 user nova-compute[73056]:     <features>
Aug 14 16:31:51 user nova-compute[73056]:       <cpuselection/>
Aug 14 16:31:51 user nova-compute[73056]:       <deviceboot/>
Aug 14 16:31:51 user nova-compute[73056]:       <disksnapshot default='on' toggle='no'/>
Aug 14 16:31:51 user nova-compute[73056]:     </features>
Aug 14 16:31:51 user nova-compute[73056]:   </guest>
Aug 14 16:31:51 user nova-compute[73056]:   <guest>
Aug 14 16:31:51 user nova-compute[73056]:     <os_type>hvm</os_type>
Aug 14 16:31:51 user nova-compute[73056]:     <arch name='ppc'>
Aug 14 16:31:51 user nova-compute[73056]:       <wordsize>32</wordsize>
Aug 14 16:31:51 user nova-compute[73056]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>g3beige</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>mac99</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='32'>ppce500</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>pegasos2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>sam460ex</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>bamboo</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>40p</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>ref405ep</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>taihu</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <domain type='qemu'/>
Aug 14 16:31:51 user nova-compute[73056]:     </arch>
Aug 14 16:31:51 user nova-compute[73056]:     <features>
Aug 14 16:31:51 user nova-compute[73056]:       <cpuselection/>
Aug 14 16:31:51 user nova-compute[73056]:       <deviceboot/>
Aug 14 16:31:51 user nova-compute[73056]:       <disksnapshot default='on' toggle='no'/>
Aug 14 16:31:51 user nova-compute[73056]:     </features>
Aug 14 16:31:51 user nova-compute[73056]:   </guest>
Aug 14 16:31:51 user nova-compute[73056]:   <guest>
Aug 14 16:31:51 user nova-compute[73056]:     <os_type>hvm</os_type>
Aug 14 16:31:51 user nova-compute[73056]:     <arch name='ppc64'>
Aug 14 16:31:51 user nova-compute[73056]:       <wordsize>64</wordsize>
Aug 14 16:31:51 user nova-compute[73056]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2048'>powernv9</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>taihu</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2048'>powernv10</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='32'>ppce500</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>40p</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>pegasos2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>bamboo</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>g3beige</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>mac99</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>sam460ex</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>ref405ep</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2048'>powernv8</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <domain type='qemu'/>
Aug 14 16:31:51 user nova-compute[73056]:     </arch>
Aug 14 16:31:51 user nova-compute[73056]:     <features>
Aug 14 16:31:51 user nova-compute[73056]:       <cpuselection/>
Aug 14 16:31:51 user nova-compute[73056]:       <deviceboot/>
Aug 14 16:31:51 user nova-compute[73056]:       <disksnapshot default='on' toggle='no'/>
Aug 14 16:31:51 user nova-compute[73056]:     </features>
Aug 14 16:31:51 user nova-compute[73056]:   </guest>
Aug 14 16:31:51 user nova-compute[73056]:   <guest>
Aug 14 16:31:51 user nova-compute[73056]:     <os_type>hvm</os_type>
Aug 14 16:31:51 user nova-compute[73056]:     <arch name='ppc64le'>
Aug 14 16:31:51 user nova-compute[73056]:       <wordsize>64</wordsize>
Aug 14 16:31:51 user nova-compute[73056]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2048'>powernv9</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>taihu</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2048'>powernv10</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='32'>ppce500</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>40p</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>pegasos2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>bamboo</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>g3beige</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>mac99</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>sam460ex</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>ref405ep</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2048'>powernv8</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <domain type='qemu'/>
Aug 14 16:31:51 user nova-compute[73056]:     </arch>
Aug 14 16:31:51 user nova-compute[73056]:     <features>
Aug 14 16:31:51 user nova-compute[73056]:       <cpuselection/>
Aug 14 16:31:51 user nova-compute[73056]:       <deviceboot/>
Aug 14 16:31:51 user nova-compute[73056]:       <disksnapshot default='on' toggle='no'/>
Aug 14 16:31:51 user nova-compute[73056]:     </features>
Aug 14 16:31:51 user nova-compute[73056]:   </guest>
Aug 14 16:31:51 user nova-compute[73056]:   <guest>
Aug 14 16:31:51 user nova-compute[73056]:     <os_type>hvm</os_type>
Aug 14 16:31:51 user nova-compute[73056]:     <arch name='riscv32'>
Aug 14 16:31:51 user nova-compute[73056]:       <wordsize>32</wordsize>
Aug 14 16:31:51 user nova-compute[73056]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='8'>spike</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>opentitan</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='5'>sifive_u</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>sifive_e</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='8'>virt</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <domain type='qemu'/>
Aug 14 16:31:51 user nova-compute[73056]:     </arch>
Aug 14 16:31:51 user nova-compute[73056]:     <features>
Aug 14 16:31:51 user nova-compute[73056]:       <cpuselection/>
Aug 14 16:31:51 user nova-compute[73056]:       <deviceboot/>
Aug 14 16:31:51 user nova-compute[73056]:       <disksnapshot default='on' toggle='no'/>
Aug 14 16:31:51 user nova-compute[73056]:     </features>
Aug 14 16:31:51 user nova-compute[73056]:   </guest>
Aug 14 16:31:51 user nova-compute[73056]:   <guest>
Aug 14 16:31:51 user nova-compute[73056]:     <os_type>hvm</os_type>
Aug 14 16:31:51 user nova-compute[73056]:     <arch name='riscv64'>
Aug 14 16:31:51 user nova-compute[73056]:       <wordsize>64</wordsize>
Aug 14 16:31:51 user nova-compute[73056]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='8'>spike</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='5'>sifive_u</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>shakti_c</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>sifive_e</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='8'>virt</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <domain type='qemu'/>
Aug 14 16:31:51 user nova-compute[73056]:     </arch>
Aug 14 16:31:51 user nova-compute[73056]:     <features>
Aug 14 16:31:51 user nova-compute[73056]:       <cpuselection/>
Aug 14 16:31:51 user nova-compute[73056]:       <deviceboot/>
Aug 14 16:31:51 user nova-compute[73056]:       <disksnapshot default='on' toggle='no'/>
Aug 14 16:31:51 user nova-compute[73056]:     </features>
Aug 14 16:31:51 user nova-compute[73056]:   </guest>
Aug 14 16:31:51 user nova-compute[73056]:   <guest>
Aug 14 16:31:51 user nova-compute[73056]:     <os_type>hvm</os_type>
Aug 14 16:31:51 user nova-compute[73056]:     <arch name='s390x'>
Aug 14 16:31:51 user nova-compute[73056]:       <wordsize>64</wordsize>
Aug 14 16:31:51 user nova-compute[73056]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <domain type='qemu'/>
Aug 14 16:31:51 user nova-compute[73056]:     </arch>
Aug 14 16:31:51 user nova-compute[73056]:     <features>
Aug 14 16:31:51 user nova-compute[73056]:       <cpuselection/>
Aug 14 16:31:51 user nova-compute[73056]:       <deviceboot/>
Aug 14 16:31:51 user nova-compute[73056]:       <disksnapshot default='on' toggle='no'/>
Aug 14 16:31:51 user nova-compute[73056]:     </features>
Aug 14 16:31:51 user nova-compute[73056]:   </guest>
Aug 14 16:31:51 user nova-compute[73056]:   <guest>
Aug 14 16:31:51 user nova-compute[73056]:     <os_type>hvm</os_type>
Aug 14 16:31:51 user nova-compute[73056]:     <arch name='sh4'>
Aug 14 16:31:51 user nova-compute[73056]:       <wordsize>32</wordsize>
Aug 14 16:31:51 user nova-compute[73056]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>shix</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>r2d</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <domain type='qemu'/>
Aug 14 16:31:51 user nova-compute[73056]:     </arch>
Aug 14 16:31:51 user nova-compute[73056]:     <features>
Aug 14 16:31:51 user nova-compute[73056]:       <cpuselection/>
Aug 14 16:31:51 user nova-compute[73056]:       <deviceboot/>
Aug 14 16:31:51 user nova-compute[73056]:       <disksnapshot default='on' toggle='no'/>
Aug 14 16:31:51 user nova-compute[73056]:     </features>
Aug 14 16:31:51 user nova-compute[73056]:   </guest>
Aug 14 16:31:51 user nova-compute[73056]:   <guest>
Aug 14 16:31:51 user nova-compute[73056]:     <os_type>hvm</os_type>
Aug 14 16:31:51 user nova-compute[73056]:     <arch name='sh4eb'>
Aug 14 16:31:51 user nova-compute[73056]:       <wordsize>64</wordsize>
Aug 14 16:31:51 user nova-compute[73056]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>shix</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>r2d</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <domain type='qemu'/>
Aug 14 16:31:51 user nova-compute[73056]:     </arch>
Aug 14 16:31:51 user nova-compute[73056]:     <features>
Aug 14 16:31:51 user nova-compute[73056]:       <cpuselection/>
Aug 14 16:31:51 user nova-compute[73056]:       <deviceboot/>
Aug 14 16:31:51 user nova-compute[73056]:       <disksnapshot default='on' toggle='no'/>
Aug 14 16:31:51 user nova-compute[73056]:     </features>
Aug 14 16:31:51 user nova-compute[73056]:   </guest>
Aug 14 16:31:51 user nova-compute[73056]:   <guest>
Aug 14 16:31:51 user nova-compute[73056]:     <os_type>hvm</os_type>
Aug 14 16:31:51 user nova-compute[73056]:     <arch name='sparc'>
Aug 14 16:31:51 user nova-compute[73056]:       <wordsize>32</wordsize>
Aug 14 16:31:51 user nova-compute[73056]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>SS-5</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='4'>SS-20</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>LX</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>SS-4</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='4'>SS-10</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>Voyager</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <domain type='qemu'/>
Aug 14 16:31:51 user nova-compute[73056]:     </arch>
Aug 14 16:31:51 user nova-compute[73056]:     <features>
Aug 14 16:31:51 user nova-compute[73056]:       <cpuselection/>
Aug 14 16:31:51 user nova-compute[73056]:       <deviceboot/>
Aug 14 16:31:51 user nova-compute[73056]:       <disksnapshot default='on' toggle='no'/>
Aug 14 16:31:51 user nova-compute[73056]:     </features>
Aug 14 16:31:51 user nova-compute[73056]:   </guest>
Aug 14 16:31:51 user nova-compute[73056]:   <guest>
Aug 14 16:31:51 user nova-compute[73056]:     <os_type>hvm</os_type>
Aug 14 16:31:51 user nova-compute[73056]:     <arch name='sparc64'>
Aug 14 16:31:51 user nova-compute[73056]:       <wordsize>64</wordsize>
Aug 14 16:31:51 user nova-compute[73056]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>sun4u</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>niagara</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>sun4v</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <domain type='qemu'/>
Aug 14 16:31:51 user nova-compute[73056]:     </arch>
Aug 14 16:31:51 user nova-compute[73056]:     <features>
Aug 14 16:31:51 user nova-compute[73056]:       <cpuselection/>
Aug 14 16:31:51 user nova-compute[73056]:       <deviceboot/>
Aug 14 16:31:51 user nova-compute[73056]:       <disksnapshot default='on' toggle='no'/>
Aug 14 16:31:51 user nova-compute[73056]:     </features>
Aug 14 16:31:51 user nova-compute[73056]:   </guest>
Aug 14 16:31:51 user nova-compute[73056]:   <guest>
Aug 14 16:31:51 user nova-compute[73056]:     <os_type>hvm</os_type>
Aug 14 16:31:51 user nova-compute[73056]:     <arch name='x86_64'>
Aug 14 16:31:51 user nova-compute[73056]:       <wordsize>64</wordsize>
Aug 14 16:31:51 user nova-compute[73056]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>x-remote</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='1'>isapc</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>microvm</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <domain type='qemu'/>
Aug 14 16:31:51 user nova-compute[73056]:       <domain type='kvm'/>
Aug 14 16:31:51 user nova-compute[73056]:     </arch>
Aug 14 16:31:51 user nova-compute[73056]:     <features>
Aug 14 16:31:51 user nova-compute[73056]:       <acpi default='on' toggle='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:       <apic default='on' toggle='no'/>
Aug 14 16:31:51 user nova-compute[73056]:       <cpuselection/>
Aug 14 16:31:51 user nova-compute[73056]:       <deviceboot/>
Aug 14 16:31:51 user nova-compute[73056]:       <disksnapshot default='on' toggle='no'/>
Aug 14 16:31:51 user nova-compute[73056]:     </features>
Aug 14 16:31:51 user nova-compute[73056]:   </guest>
Aug 14 16:31:51 user nova-compute[73056]:   <guest>
Aug 14 16:31:51 user nova-compute[73056]:     <os_type>hvm</os_type>
Aug 14 16:31:51 user nova-compute[73056]:     <arch name='xtensa'>
Aug 14 16:31:51 user nova-compute[73056]:       <wordsize>32</wordsize>
Aug 14 16:31:51 user nova-compute[73056]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='4'>sim</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='32'>kc705</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='32'>ml605</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='32'>virt</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='32'>lx200</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='32'>lx60</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <domain type='qemu'/>
Aug 14 16:31:51 user nova-compute[73056]:     </arch>
Aug 14 16:31:51 user nova-compute[73056]:     <features>
Aug 14 16:31:51 user nova-compute[73056]:       <cpuselection/>
Aug 14 16:31:51 user nova-compute[73056]:       <deviceboot/>
Aug 14 16:31:51 user nova-compute[73056]:       <disksnapshot default='on' toggle='no'/>
Aug 14 16:31:51 user nova-compute[73056]:     </features>
Aug 14 16:31:51 user nova-compute[73056]:   </guest>
Aug 14 16:31:51 user nova-compute[73056]:   <guest>
Aug 14 16:31:51 user nova-compute[73056]:     <os_type>hvm</os_type>
Aug 14 16:31:51 user nova-compute[73056]:     <arch name='xtensaeb'>
Aug 14 16:31:51 user nova-compute[73056]:       <wordsize>32</wordsize>
Aug 14 16:31:51 user nova-compute[73056]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='4'>sim</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='32'>kc705</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='32'>ml605</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='32'>virt</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='32'>lx200</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='32'>lx60</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 14 16:31:51 user nova-compute[73056]:       <domain type='qemu'/>
Aug 14 16:31:51 user nova-compute[73056]:     </arch>
Aug 14 16:31:51 user nova-compute[73056]:     <features>
Aug 14 16:31:51 user nova-compute[73056]:       <cpuselection/>
Aug 14 16:31:51 user nova-compute[73056]:       <deviceboot/>
Aug 14 16:31:51 user nova-compute[73056]:       <disksnapshot default='on' toggle='no'/>
Aug 14 16:31:51 user nova-compute[73056]:     </features>
Aug 14 16:31:51 user nova-compute[73056]:   </guest>
Aug 14 16:31:51 user nova-compute[73056]: </capabilities>
Aug 14 16:31:51 user nova-compute[73056]: 
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=73056) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=73056) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=73056) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73056) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73056) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=73056) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73056) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=73056) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=73056) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Getting domain capabilities for cris via machine types: {None} {{(pid=73056) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=73056) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'pc', 'ubuntu-q35', 'q35'} {{(pid=73056) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 14 16:31:51 user nova-compute[73056]: <domainCapabilities>
Aug 14 16:31:51 user nova-compute[73056]:   <path>/usr/bin/qemu-system-i386</path>
Aug 14 16:31:51 user nova-compute[73056]:   <domain>kvm</domain>
Aug 14 16:31:51 user nova-compute[73056]:   <machine>pc-i440fx-jammy</machine>
Aug 14 16:31:51 user nova-compute[73056]:   <arch>i686</arch>
Aug 14 16:31:51 user nova-compute[73056]:   <vcpu max='255'/>
Aug 14 16:31:51 user nova-compute[73056]:   <iothreads supported='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:   <os supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:     <enum name='firmware'/>
Aug 14 16:31:51 user nova-compute[73056]:     <loader supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 14 16:31:51 user nova-compute[73056]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 14 16:31:51 user nova-compute[73056]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 14 16:31:51 user nova-compute[73056]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 14 16:31:51 user nova-compute[73056]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='type'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>rom</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>pflash</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='readonly'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>yes</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>no</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='secure'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>no</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </loader>
Aug 14 16:31:51 user nova-compute[73056]:   </os>
Aug 14 16:31:51 user nova-compute[73056]:   <cpu>
Aug 14 16:31:51 user nova-compute[73056]:     <mode name='host-passthrough' supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='hostPassthroughMigratable'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>off</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </mode>
Aug 14 16:31:51 user nova-compute[73056]:     <mode name='maximum' supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='maximumMigratable'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>on</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>off</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </mode>
Aug 14 16:31:51 user nova-compute[73056]:     <mode name='host-model' supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <vendor>Intel</vendor>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='ss'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='vmx'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='pcid'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='hypervisor'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='arat'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='umip'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='md-clear'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='stibp'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='ssbd'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='ibpb'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='ibrs'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='amd-stibp'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='disable' name='erms'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='disable' name='lm'/>
Aug 14 16:31:51 user nova-compute[73056]:     </mode>
Aug 14 16:31:51 user nova-compute[73056]:     <mode name='custom' supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>qemu64</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>qemu32</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>phenom</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>pentium3</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>pentium2</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>pentium</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>n270</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>kvm64</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>kvm32</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>coreduo</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>core2duo</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>athlon</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Westmere-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Westmere</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Snowridge</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Server</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Client</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>SandyBridge</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Penryn</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Opteron_G5</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Opteron_G4</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Opteron_G3</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Opteron_G2</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Opteron_G1</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Nehalem-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Nehalem</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>IvyBridge</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Icelake-Server</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Haswell</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>EPYC-Rome</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>EPYC-Milan</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>EPYC</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Dhyana</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Cooperlake</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Conroe</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Broadwell</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>486</model>
Aug 14 16:31:51 user nova-compute[73056]:     </mode>
Aug 14 16:31:51 user nova-compute[73056]:   </cpu>
Aug 14 16:31:51 user nova-compute[73056]:   <memoryBacking supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:     <enum name='sourceType'>
Aug 14 16:31:51 user nova-compute[73056]:       <value>file</value>
Aug 14 16:31:51 user nova-compute[73056]:       <value>anonymous</value>
Aug 14 16:31:51 user nova-compute[73056]:       <value>memfd</value>
Aug 14 16:31:51 user nova-compute[73056]:     </enum>
Aug 14 16:31:51 user nova-compute[73056]:   </memoryBacking>
Aug 14 16:31:51 user nova-compute[73056]:   <devices>
Aug 14 16:31:51 user nova-compute[73056]:     <disk supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='diskDevice'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>disk</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>cdrom</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>floppy</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>lun</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='bus'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>ide</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>fdc</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>scsi</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>usb</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>sata</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='model'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio-transitional</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio-non-transitional</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </disk>
Aug 14 16:31:51 user nova-compute[73056]:     <graphics supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='type'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>sdl</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>vnc</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>spice</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>egl-headless</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </graphics>
Aug 14 16:31:51 user nova-compute[73056]:     <video supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='modelType'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>vga</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>cirrus</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>vmvga</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>qxl</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>none</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>bochs</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>ramfb</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </video>
Aug 14 16:31:51 user nova-compute[73056]:     <hostdev supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='mode'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>subsystem</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='startupPolicy'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>default</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>mandatory</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>requisite</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>optional</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='subsysType'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>usb</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>pci</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>scsi</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='capsType'/>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='pciBackend'/>
Aug 14 16:31:51 user nova-compute[73056]:     </hostdev>
Aug 14 16:31:51 user nova-compute[73056]:     <rng supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='model'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio-transitional</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio-non-transitional</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='backendModel'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>random</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>egd</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>builtin</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </rng>
Aug 14 16:31:51 user nova-compute[73056]:     <filesystem supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='driverType'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>path</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>handle</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtiofs</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </filesystem>
Aug 14 16:31:51 user nova-compute[73056]:     <tpm supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='model'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>tpm-tis</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>tpm-crb</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='backendModel'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>passthrough</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>emulator</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </tpm>
Aug 14 16:31:51 user nova-compute[73056]:   </devices>
Aug 14 16:31:51 user nova-compute[73056]:   <features>
Aug 14 16:31:51 user nova-compute[73056]:     <gic supported='no'/>
Aug 14 16:31:51 user nova-compute[73056]:     <vmcoreinfo supported='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:     <genid supported='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:     <backingStoreInput supported='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:     <backup supported='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:     <sev supported='no'/>
Aug 14 16:31:51 user nova-compute[73056]:   </features>
Aug 14 16:31:51 user nova-compute[73056]: </domainCapabilities>
Aug 14 16:31:51 user nova-compute[73056]:  {{(pid=73056) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 14 16:31:51 user nova-compute[73056]: <domainCapabilities>
Aug 14 16:31:51 user nova-compute[73056]:   <path>/usr/bin/qemu-system-i386</path>
Aug 14 16:31:51 user nova-compute[73056]:   <domain>kvm</domain>
Aug 14 16:31:51 user nova-compute[73056]:   <machine>pc-i440fx-6.2</machine>
Aug 14 16:31:51 user nova-compute[73056]:   <arch>i686</arch>
Aug 14 16:31:51 user nova-compute[73056]:   <vcpu max='255'/>
Aug 14 16:31:51 user nova-compute[73056]:   <iothreads supported='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:   <os supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:     <enum name='firmware'/>
Aug 14 16:31:51 user nova-compute[73056]:     <loader supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 14 16:31:51 user nova-compute[73056]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 14 16:31:51 user nova-compute[73056]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 14 16:31:51 user nova-compute[73056]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 14 16:31:51 user nova-compute[73056]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='type'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>rom</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>pflash</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='readonly'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>yes</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>no</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='secure'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>no</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </loader>
Aug 14 16:31:51 user nova-compute[73056]:   </os>
Aug 14 16:31:51 user nova-compute[73056]:   <cpu>
Aug 14 16:31:51 user nova-compute[73056]:     <mode name='host-passthrough' supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='hostPassthroughMigratable'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>off</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </mode>
Aug 14 16:31:51 user nova-compute[73056]:     <mode name='maximum' supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='maximumMigratable'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>on</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>off</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </mode>
Aug 14 16:31:51 user nova-compute[73056]:     <mode name='host-model' supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <vendor>Intel</vendor>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='ss'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='vmx'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='pcid'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='hypervisor'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='arat'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='umip'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='md-clear'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='stibp'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='ssbd'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='ibpb'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='ibrs'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='amd-stibp'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='disable' name='erms'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='disable' name='lm'/>
Aug 14 16:31:51 user nova-compute[73056]:     </mode>
Aug 14 16:31:51 user nova-compute[73056]:     <mode name='custom' supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>qemu64</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>qemu32</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>phenom</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>pentium3</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>pentium2</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>pentium</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>n270</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>kvm64</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>kvm32</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>coreduo</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>core2duo</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>athlon</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Westmere-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Westmere</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Snowridge</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Server</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Client</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>SandyBridge</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Penryn</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Opteron_G5</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Opteron_G4</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Opteron_G3</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Opteron_G2</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Opteron_G1</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Nehalem-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Nehalem</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>IvyBridge</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Icelake-Server</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Haswell</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>EPYC-Rome</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>EPYC-Milan</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>EPYC</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Dhyana</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Cooperlake</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Conroe</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Broadwell</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>486</model>
Aug 14 16:31:51 user nova-compute[73056]:     </mode>
Aug 14 16:31:51 user nova-compute[73056]:   </cpu>
Aug 14 16:31:51 user nova-compute[73056]:   <memoryBacking supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:     <enum name='sourceType'>
Aug 14 16:31:51 user nova-compute[73056]:       <value>file</value>
Aug 14 16:31:51 user nova-compute[73056]:       <value>anonymous</value>
Aug 14 16:31:51 user nova-compute[73056]:       <value>memfd</value>
Aug 14 16:31:51 user nova-compute[73056]:     </enum>
Aug 14 16:31:51 user nova-compute[73056]:   </memoryBacking>
Aug 14 16:31:51 user nova-compute[73056]:   <devices>
Aug 14 16:31:51 user nova-compute[73056]:     <disk supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='diskDevice'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>disk</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>cdrom</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>floppy</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>lun</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='bus'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>ide</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>fdc</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>scsi</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>usb</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>sata</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='model'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio-transitional</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio-non-transitional</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </disk>
Aug 14 16:31:51 user nova-compute[73056]:     <graphics supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='type'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>sdl</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>vnc</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>spice</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>egl-headless</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </graphics>
Aug 14 16:31:51 user nova-compute[73056]:     <video supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='modelType'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>vga</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>cirrus</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>vmvga</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>qxl</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>none</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>bochs</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>ramfb</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </video>
Aug 14 16:31:51 user nova-compute[73056]:     <hostdev supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='mode'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>subsystem</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='startupPolicy'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>default</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>mandatory</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>requisite</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>optional</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='subsysType'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>usb</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>pci</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>scsi</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='capsType'/>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='pciBackend'/>
Aug 14 16:31:51 user nova-compute[73056]:     </hostdev>
Aug 14 16:31:51 user nova-compute[73056]:     <rng supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='model'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio-transitional</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio-non-transitional</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='backendModel'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>random</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>egd</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>builtin</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </rng>
Aug 14 16:31:51 user nova-compute[73056]:     <filesystem supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='driverType'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>path</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>handle</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtiofs</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </filesystem>
Aug 14 16:31:51 user nova-compute[73056]:     <tpm supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='model'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>tpm-tis</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>tpm-crb</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='backendModel'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>passthrough</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>emulator</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </tpm>
Aug 14 16:31:51 user nova-compute[73056]:   </devices>
Aug 14 16:31:51 user nova-compute[73056]:   <features>
Aug 14 16:31:51 user nova-compute[73056]:     <gic supported='no'/>
Aug 14 16:31:51 user nova-compute[73056]:     <vmcoreinfo supported='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:     <genid supported='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:     <backingStoreInput supported='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:     <backup supported='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:     <sev supported='no'/>
Aug 14 16:31:51 user nova-compute[73056]:   </features>
Aug 14 16:31:51 user nova-compute[73056]: </domainCapabilities>
Aug 14 16:31:51 user nova-compute[73056]:  {{(pid=73056) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 14 16:31:51 user nova-compute[73056]: <domainCapabilities>
Aug 14 16:31:51 user nova-compute[73056]:   <path>/usr/bin/qemu-system-i386</path>
Aug 14 16:31:51 user nova-compute[73056]:   <domain>kvm</domain>
Aug 14 16:31:51 user nova-compute[73056]:   <machine>pc-q35-jammy</machine>
Aug 14 16:31:51 user nova-compute[73056]:   <arch>i686</arch>
Aug 14 16:31:51 user nova-compute[73056]:   <vcpu max='288'/>
Aug 14 16:31:51 user nova-compute[73056]:   <iothreads supported='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:   <os supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:     <enum name='firmware'/>
Aug 14 16:31:51 user nova-compute[73056]:     <loader supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 14 16:31:51 user nova-compute[73056]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 14 16:31:51 user nova-compute[73056]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 14 16:31:51 user nova-compute[73056]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 14 16:31:51 user nova-compute[73056]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='type'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>rom</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>pflash</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='readonly'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>yes</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>no</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='secure'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>no</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </loader>
Aug 14 16:31:51 user nova-compute[73056]:   </os>
Aug 14 16:31:51 user nova-compute[73056]:   <cpu>
Aug 14 16:31:51 user nova-compute[73056]:     <mode name='host-passthrough' supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='hostPassthroughMigratable'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>off</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </mode>
Aug 14 16:31:51 user nova-compute[73056]:     <mode name='maximum' supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='maximumMigratable'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>on</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>off</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </mode>
Aug 14 16:31:51 user nova-compute[73056]:     <mode name='host-model' supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <vendor>Intel</vendor>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='ss'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='vmx'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='pcid'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='hypervisor'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='arat'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='umip'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='md-clear'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='stibp'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='ssbd'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='ibpb'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='ibrs'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='amd-stibp'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='disable' name='erms'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='disable' name='lm'/>
Aug 14 16:31:51 user nova-compute[73056]:     </mode>
Aug 14 16:31:51 user nova-compute[73056]:     <mode name='custom' supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>qemu64</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>qemu32</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>phenom</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>pentium3</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>pentium2</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>pentium</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>n270</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>kvm64</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>kvm32</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>coreduo</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>core2duo</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>athlon</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Westmere-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Westmere</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Snowridge</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Server</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Client</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>SandyBridge</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Penryn</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Opteron_G5</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Opteron_G4</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Opteron_G3</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Opteron_G2</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Opteron_G1</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Nehalem-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Nehalem</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>IvyBridge</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Icelake-Server</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Haswell</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>EPYC-Rome</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>EPYC-Milan</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>EPYC</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Dhyana</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Cooperlake</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Conroe</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Broadwell</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>486</model>
Aug 14 16:31:51 user nova-compute[73056]:     </mode>
Aug 14 16:31:51 user nova-compute[73056]:   </cpu>
Aug 14 16:31:51 user nova-compute[73056]:   <memoryBacking supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:     <enum name='sourceType'>
Aug 14 16:31:51 user nova-compute[73056]:       <value>file</value>
Aug 14 16:31:51 user nova-compute[73056]:       <value>anonymous</value>
Aug 14 16:31:51 user nova-compute[73056]:       <value>memfd</value>
Aug 14 16:31:51 user nova-compute[73056]:     </enum>
Aug 14 16:31:51 user nova-compute[73056]:   </memoryBacking>
Aug 14 16:31:51 user nova-compute[73056]:   <devices>
Aug 14 16:31:51 user nova-compute[73056]:     <disk supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='diskDevice'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>disk</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>cdrom</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>floppy</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>lun</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='bus'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>fdc</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>scsi</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>usb</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>sata</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='model'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio-transitional</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio-non-transitional</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </disk>
Aug 14 16:31:51 user nova-compute[73056]:     <graphics supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='type'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>sdl</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>vnc</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>spice</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>egl-headless</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </graphics>
Aug 14 16:31:51 user nova-compute[73056]:     <video supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='modelType'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>vga</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>cirrus</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>vmvga</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>qxl</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>none</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>bochs</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>ramfb</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </video>
Aug 14 16:31:51 user nova-compute[73056]:     <hostdev supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='mode'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>subsystem</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='startupPolicy'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>default</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>mandatory</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>requisite</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>optional</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='subsysType'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>usb</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>pci</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>scsi</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='capsType'/>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='pciBackend'/>
Aug 14 16:31:51 user nova-compute[73056]:     </hostdev>
Aug 14 16:31:51 user nova-compute[73056]:     <rng supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='model'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio-transitional</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio-non-transitional</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='backendModel'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>random</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>egd</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>builtin</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </rng>
Aug 14 16:31:51 user nova-compute[73056]:     <filesystem supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='driverType'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>path</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>handle</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtiofs</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </filesystem>
Aug 14 16:31:51 user nova-compute[73056]:     <tpm supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='model'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>tpm-tis</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>tpm-crb</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='backendModel'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>passthrough</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>emulator</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </tpm>
Aug 14 16:31:51 user nova-compute[73056]:   </devices>
Aug 14 16:31:51 user nova-compute[73056]:   <features>
Aug 14 16:31:51 user nova-compute[73056]:     <gic supported='no'/>
Aug 14 16:31:51 user nova-compute[73056]:     <vmcoreinfo supported='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:     <genid supported='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:     <backingStoreInput supported='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:     <backup supported='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:     <sev supported='no'/>
Aug 14 16:31:51 user nova-compute[73056]:   </features>
Aug 14 16:31:51 user nova-compute[73056]: </domainCapabilities>
Aug 14 16:31:51 user nova-compute[73056]:  {{(pid=73056) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 14 16:31:51 user nova-compute[73056]: <domainCapabilities>
Aug 14 16:31:51 user nova-compute[73056]:   <path>/usr/bin/qemu-system-i386</path>
Aug 14 16:31:51 user nova-compute[73056]:   <domain>kvm</domain>
Aug 14 16:31:51 user nova-compute[73056]:   <machine>pc-q35-6.2</machine>
Aug 14 16:31:51 user nova-compute[73056]:   <arch>i686</arch>
Aug 14 16:31:51 user nova-compute[73056]:   <vcpu max='288'/>
Aug 14 16:31:51 user nova-compute[73056]:   <iothreads supported='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:   <os supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:     <enum name='firmware'/>
Aug 14 16:31:51 user nova-compute[73056]:     <loader supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 14 16:31:51 user nova-compute[73056]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 14 16:31:51 user nova-compute[73056]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 14 16:31:51 user nova-compute[73056]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 14 16:31:51 user nova-compute[73056]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='type'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>rom</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>pflash</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='readonly'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>yes</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>no</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='secure'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>no</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </loader>
Aug 14 16:31:51 user nova-compute[73056]:   </os>
Aug 14 16:31:51 user nova-compute[73056]:   <cpu>
Aug 14 16:31:51 user nova-compute[73056]:     <mode name='host-passthrough' supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='hostPassthroughMigratable'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>off</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </mode>
Aug 14 16:31:51 user nova-compute[73056]:     <mode name='maximum' supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='maximumMigratable'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>on</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>off</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </mode>
Aug 14 16:31:51 user nova-compute[73056]:     <mode name='host-model' supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <vendor>Intel</vendor>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='ss'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='vmx'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='pcid'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='hypervisor'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='arat'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='umip'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='md-clear'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='stibp'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='ssbd'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='ibpb'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='ibrs'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='amd-stibp'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='disable' name='erms'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='disable' name='lm'/>
Aug 14 16:31:51 user nova-compute[73056]:     </mode>
Aug 14 16:31:51 user nova-compute[73056]:     <mode name='custom' supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>qemu64</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>qemu32</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>phenom</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>pentium3</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>pentium2</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>pentium</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>n270</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>kvm64</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>kvm32</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>coreduo</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>core2duo</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>athlon</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Westmere-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Westmere</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Snowridge</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Server</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Client</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>SandyBridge</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Penryn</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Opteron_G5</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Opteron_G4</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Opteron_G3</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Opteron_G2</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Opteron_G1</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Nehalem-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Nehalem</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>IvyBridge</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Icelake-Server</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Haswell</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>EPYC-Rome</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>EPYC-Milan</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>EPYC</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Dhyana</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Cooperlake</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Conroe</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Broadwell</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>486</model>
Aug 14 16:31:51 user nova-compute[73056]:     </mode>
Aug 14 16:31:51 user nova-compute[73056]:   </cpu>
Aug 14 16:31:51 user nova-compute[73056]:   <memoryBacking supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:     <enum name='sourceType'>
Aug 14 16:31:51 user nova-compute[73056]:       <value>file</value>
Aug 14 16:31:51 user nova-compute[73056]:       <value>anonymous</value>
Aug 14 16:31:51 user nova-compute[73056]:       <value>memfd</value>
Aug 14 16:31:51 user nova-compute[73056]:     </enum>
Aug 14 16:31:51 user nova-compute[73056]:   </memoryBacking>
Aug 14 16:31:51 user nova-compute[73056]:   <devices>
Aug 14 16:31:51 user nova-compute[73056]:     <disk supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='diskDevice'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>disk</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>cdrom</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>floppy</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>lun</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='bus'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>fdc</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>scsi</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>usb</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>sata</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='model'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio-transitional</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio-non-transitional</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </disk>
Aug 14 16:31:51 user nova-compute[73056]:     <graphics supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='type'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>sdl</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>vnc</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>spice</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>egl-headless</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </graphics>
Aug 14 16:31:51 user nova-compute[73056]:     <video supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='modelType'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>vga</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>cirrus</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>vmvga</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>qxl</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>none</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>bochs</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>ramfb</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </video>
Aug 14 16:31:51 user nova-compute[73056]:     <hostdev supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='mode'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>subsystem</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='startupPolicy'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>default</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>mandatory</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>requisite</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>optional</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='subsysType'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>usb</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>pci</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>scsi</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='capsType'/>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='pciBackend'/>
Aug 14 16:31:51 user nova-compute[73056]:     </hostdev>
Aug 14 16:31:51 user nova-compute[73056]:     <rng supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='model'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio-transitional</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio-non-transitional</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='backendModel'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>random</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>egd</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>builtin</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </rng>
Aug 14 16:31:51 user nova-compute[73056]:     <filesystem supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='driverType'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>path</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>handle</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtiofs</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </filesystem>
Aug 14 16:31:51 user nova-compute[73056]:     <tpm supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='model'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>tpm-tis</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>tpm-crb</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='backendModel'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>passthrough</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>emulator</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </tpm>
Aug 14 16:31:51 user nova-compute[73056]:   </devices>
Aug 14 16:31:51 user nova-compute[73056]:   <features>
Aug 14 16:31:51 user nova-compute[73056]:     <gic supported='no'/>
Aug 14 16:31:51 user nova-compute[73056]:     <vmcoreinfo supported='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:     <genid supported='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:     <backingStoreInput supported='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:     <backup supported='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:     <sev supported='no'/>
Aug 14 16:31:51 user nova-compute[73056]:   </features>
Aug 14 16:31:51 user nova-compute[73056]: </domainCapabilities>
Aug 14 16:31:51 user nova-compute[73056]:  {{(pid=73056) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=73056) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73056) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73056) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=73056) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=73056) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=73056) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=73056) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Getting domain capabilities for mips via machine types: {None} {{(pid=73056) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=73056) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=73056) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=73056) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=73056) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=73056) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=73056) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=73056) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=73056) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=73056) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=73056) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73056) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73056) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73056) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=73056) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73056) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73056) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=73056) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=73056) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=73056) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=73056) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=73056) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=73056) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=73056) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=73056) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=73056) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=73056) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=73056) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=73056) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=73056) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=73056) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'pc', 'ubuntu-q35', 'q35'} {{(pid=73056) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 14 16:31:51 user nova-compute[73056]: <domainCapabilities>
Aug 14 16:31:51 user nova-compute[73056]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 14 16:31:51 user nova-compute[73056]:   <domain>kvm</domain>
Aug 14 16:31:51 user nova-compute[73056]:   <machine>pc-i440fx-jammy</machine>
Aug 14 16:31:51 user nova-compute[73056]:   <arch>x86_64</arch>
Aug 14 16:31:51 user nova-compute[73056]:   <vcpu max='255'/>
Aug 14 16:31:51 user nova-compute[73056]:   <iothreads supported='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:   <os supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:     <enum name='firmware'>
Aug 14 16:31:51 user nova-compute[73056]:       <value>efi</value>
Aug 14 16:31:51 user nova-compute[73056]:     </enum>
Aug 14 16:31:51 user nova-compute[73056]:     <loader supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='type'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>rom</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>pflash</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='readonly'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>yes</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>no</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='secure'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>no</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </loader>
Aug 14 16:31:51 user nova-compute[73056]:   </os>
Aug 14 16:31:51 user nova-compute[73056]:   <cpu>
Aug 14 16:31:51 user nova-compute[73056]:     <mode name='host-passthrough' supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='hostPassthroughMigratable'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>on</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>off</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </mode>
Aug 14 16:31:51 user nova-compute[73056]:     <mode name='maximum' supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='maximumMigratable'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>on</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>off</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </mode>
Aug 14 16:31:51 user nova-compute[73056]:     <mode name='host-model' supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <vendor>Intel</vendor>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='ss'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='vmx'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='pcid'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='hypervisor'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='arat'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='umip'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='md-clear'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='stibp'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='ssbd'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='invtsc'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='ibpb'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='ibrs'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='amd-stibp'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='rsba'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='pschange-mc-no'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='disable' name='erms'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 16:31:51 user nova-compute[73056]:     </mode>
Aug 14 16:31:51 user nova-compute[73056]:     <mode name='custom' supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>qemu64</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>qemu32</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>phenom</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>pentium3</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>pentium2</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>pentium</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>n270</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>kvm64</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>kvm32</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>coreduo</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>core2duo</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>athlon</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>Westmere-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>Westmere</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Snowridge</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Server</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Client</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>SandyBridge</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>Penryn</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Opteron_G5</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Opteron_G4</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Opteron_G3</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Opteron_G2</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>Opteron_G1</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>Nehalem</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>IvyBridge</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Icelake-Server</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Haswell</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>EPYC-Rome</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>EPYC-Milan</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>EPYC</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Dhyana</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Cooperlake</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>Conroe</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Broadwell</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>486</model>
Aug 14 16:31:51 user nova-compute[73056]:     </mode>
Aug 14 16:31:51 user nova-compute[73056]:   </cpu>
Aug 14 16:31:51 user nova-compute[73056]:   <memoryBacking supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:     <enum name='sourceType'>
Aug 14 16:31:51 user nova-compute[73056]:       <value>file</value>
Aug 14 16:31:51 user nova-compute[73056]:       <value>anonymous</value>
Aug 14 16:31:51 user nova-compute[73056]:       <value>memfd</value>
Aug 14 16:31:51 user nova-compute[73056]:     </enum>
Aug 14 16:31:51 user nova-compute[73056]:   </memoryBacking>
Aug 14 16:31:51 user nova-compute[73056]:   <devices>
Aug 14 16:31:51 user nova-compute[73056]:     <disk supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='diskDevice'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>disk</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>cdrom</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>floppy</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>lun</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='bus'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>ide</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>fdc</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>scsi</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>usb</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>sata</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='model'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio-transitional</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio-non-transitional</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </disk>
Aug 14 16:31:51 user nova-compute[73056]:     <graphics supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='type'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>sdl</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>vnc</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>spice</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>egl-headless</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </graphics>
Aug 14 16:31:51 user nova-compute[73056]:     <video supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='modelType'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>vga</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>cirrus</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>vmvga</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>qxl</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>none</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>bochs</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>ramfb</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </video>
Aug 14 16:31:51 user nova-compute[73056]:     <hostdev supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='mode'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>subsystem</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='startupPolicy'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>default</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>mandatory</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>requisite</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>optional</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='subsysType'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>usb</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>pci</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>scsi</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='capsType'/>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='pciBackend'/>
Aug 14 16:31:51 user nova-compute[73056]:     </hostdev>
Aug 14 16:31:51 user nova-compute[73056]:     <rng supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='model'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio-transitional</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio-non-transitional</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='backendModel'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>random</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>egd</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>builtin</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </rng>
Aug 14 16:31:51 user nova-compute[73056]:     <filesystem supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='driverType'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>path</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>handle</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtiofs</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </filesystem>
Aug 14 16:31:51 user nova-compute[73056]:     <tpm supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='model'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>tpm-tis</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>tpm-crb</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='backendModel'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>passthrough</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>emulator</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </tpm>
Aug 14 16:31:51 user nova-compute[73056]:   </devices>
Aug 14 16:31:51 user nova-compute[73056]:   <features>
Aug 14 16:31:51 user nova-compute[73056]:     <gic supported='no'/>
Aug 14 16:31:51 user nova-compute[73056]:     <vmcoreinfo supported='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:     <genid supported='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:     <backingStoreInput supported='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:     <backup supported='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:     <sev supported='no'/>
Aug 14 16:31:51 user nova-compute[73056]:   </features>
Aug 14 16:31:51 user nova-compute[73056]: </domainCapabilities>
Aug 14 16:31:51 user nova-compute[73056]:  {{(pid=73056) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 14 16:31:51 user nova-compute[73056]: <domainCapabilities>
Aug 14 16:31:51 user nova-compute[73056]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 14 16:31:51 user nova-compute[73056]:   <domain>kvm</domain>
Aug 14 16:31:51 user nova-compute[73056]:   <machine>pc-i440fx-6.2</machine>
Aug 14 16:31:51 user nova-compute[73056]:   <arch>x86_64</arch>
Aug 14 16:31:51 user nova-compute[73056]:   <vcpu max='255'/>
Aug 14 16:31:51 user nova-compute[73056]:   <iothreads supported='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:   <os supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:     <enum name='firmware'>
Aug 14 16:31:51 user nova-compute[73056]:       <value>efi</value>
Aug 14 16:31:51 user nova-compute[73056]:     </enum>
Aug 14 16:31:51 user nova-compute[73056]:     <loader supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='type'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>rom</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>pflash</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='readonly'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>yes</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>no</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='secure'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>no</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </loader>
Aug 14 16:31:51 user nova-compute[73056]:   </os>
Aug 14 16:31:51 user nova-compute[73056]:   <cpu>
Aug 14 16:31:51 user nova-compute[73056]:     <mode name='host-passthrough' supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='hostPassthroughMigratable'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>on</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>off</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </mode>
Aug 14 16:31:51 user nova-compute[73056]:     <mode name='maximum' supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='maximumMigratable'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>on</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>off</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </mode>
Aug 14 16:31:51 user nova-compute[73056]:     <mode name='host-model' supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <vendor>Intel</vendor>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='ss'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='vmx'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='pcid'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='hypervisor'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='arat'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='umip'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='md-clear'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='stibp'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='ssbd'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='invtsc'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='ibpb'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='ibrs'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='amd-stibp'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='rsba'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='pschange-mc-no'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='disable' name='erms'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 16:31:51 user nova-compute[73056]:     </mode>
Aug 14 16:31:51 user nova-compute[73056]:     <mode name='custom' supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>qemu64</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>qemu32</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>phenom</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>pentium3</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>pentium2</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>pentium</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>n270</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>kvm64</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>kvm32</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>coreduo</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>core2duo</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>athlon</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>Westmere-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>Westmere</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Snowridge</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Server</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Client</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>SandyBridge</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>Penryn</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Opteron_G5</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Opteron_G4</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Opteron_G3</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Opteron_G2</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>Opteron_G1</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>Nehalem</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>IvyBridge</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Icelake-Server</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Haswell</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>EPYC-Rome</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>EPYC-Milan</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>EPYC</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Dhyana</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Cooperlake</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>Conroe</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Broadwell</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>486</model>
Aug 14 16:31:51 user nova-compute[73056]:     </mode>
Aug 14 16:31:51 user nova-compute[73056]:   </cpu>
Aug 14 16:31:51 user nova-compute[73056]:   <memoryBacking supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:     <enum name='sourceType'>
Aug 14 16:31:51 user nova-compute[73056]:       <value>file</value>
Aug 14 16:31:51 user nova-compute[73056]:       <value>anonymous</value>
Aug 14 16:31:51 user nova-compute[73056]:       <value>memfd</value>
Aug 14 16:31:51 user nova-compute[73056]:     </enum>
Aug 14 16:31:51 user nova-compute[73056]:   </memoryBacking>
Aug 14 16:31:51 user nova-compute[73056]:   <devices>
Aug 14 16:31:51 user nova-compute[73056]:     <disk supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='diskDevice'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>disk</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>cdrom</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>floppy</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>lun</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='bus'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>ide</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>fdc</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>scsi</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>usb</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>sata</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='model'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio-transitional</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio-non-transitional</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </disk>
Aug 14 16:31:51 user nova-compute[73056]:     <graphics supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='type'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>sdl</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>vnc</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>spice</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>egl-headless</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </graphics>
Aug 14 16:31:51 user nova-compute[73056]:     <video supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='modelType'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>vga</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>cirrus</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>vmvga</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>qxl</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>none</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>bochs</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>ramfb</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </video>
Aug 14 16:31:51 user nova-compute[73056]:     <hostdev supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='mode'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>subsystem</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='startupPolicy'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>default</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>mandatory</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>requisite</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>optional</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='subsysType'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>usb</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>pci</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>scsi</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='capsType'/>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='pciBackend'/>
Aug 14 16:31:51 user nova-compute[73056]:     </hostdev>
Aug 14 16:31:51 user nova-compute[73056]:     <rng supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='model'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio-transitional</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio-non-transitional</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='backendModel'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>random</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>egd</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>builtin</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </rng>
Aug 14 16:31:51 user nova-compute[73056]:     <filesystem supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='driverType'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>path</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>handle</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtiofs</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </filesystem>
Aug 14 16:31:51 user nova-compute[73056]:     <tpm supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='model'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>tpm-tis</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>tpm-crb</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='backendModel'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>passthrough</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>emulator</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </tpm>
Aug 14 16:31:51 user nova-compute[73056]:   </devices>
Aug 14 16:31:51 user nova-compute[73056]:   <features>
Aug 14 16:31:51 user nova-compute[73056]:     <gic supported='no'/>
Aug 14 16:31:51 user nova-compute[73056]:     <vmcoreinfo supported='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:     <genid supported='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:     <backingStoreInput supported='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:     <backup supported='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:     <sev supported='no'/>
Aug 14 16:31:51 user nova-compute[73056]:   </features>
Aug 14 16:31:51 user nova-compute[73056]: </domainCapabilities>
Aug 14 16:31:51 user nova-compute[73056]:  {{(pid=73056) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 14 16:31:51 user nova-compute[73056]: <domainCapabilities>
Aug 14 16:31:51 user nova-compute[73056]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 14 16:31:51 user nova-compute[73056]:   <domain>kvm</domain>
Aug 14 16:31:51 user nova-compute[73056]:   <machine>pc-q35-jammy</machine>
Aug 14 16:31:51 user nova-compute[73056]:   <arch>x86_64</arch>
Aug 14 16:31:51 user nova-compute[73056]:   <vcpu max='288'/>
Aug 14 16:31:51 user nova-compute[73056]:   <iothreads supported='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:   <os supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:     <enum name='firmware'>
Aug 14 16:31:51 user nova-compute[73056]:       <value>efi</value>
Aug 14 16:31:51 user nova-compute[73056]:     </enum>
Aug 14 16:31:51 user nova-compute[73056]:     <loader supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 14 16:31:51 user nova-compute[73056]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 14 16:31:51 user nova-compute[73056]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='type'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>rom</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>pflash</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='readonly'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>yes</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>no</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='secure'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>yes</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>no</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </loader>
Aug 14 16:31:51 user nova-compute[73056]:   </os>
Aug 14 16:31:51 user nova-compute[73056]:   <cpu>
Aug 14 16:31:51 user nova-compute[73056]:     <mode name='host-passthrough' supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='hostPassthroughMigratable'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>on</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>off</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </mode>
Aug 14 16:31:51 user nova-compute[73056]:     <mode name='maximum' supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='maximumMigratable'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>on</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>off</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </mode>
Aug 14 16:31:51 user nova-compute[73056]:     <mode name='host-model' supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <vendor>Intel</vendor>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='ss'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='vmx'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='pcid'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='hypervisor'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='arat'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='umip'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='md-clear'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='stibp'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='ssbd'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='invtsc'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='ibpb'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='ibrs'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='amd-stibp'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='rsba'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='pschange-mc-no'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='disable' name='erms'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 16:31:51 user nova-compute[73056]:     </mode>
Aug 14 16:31:51 user nova-compute[73056]:     <mode name='custom' supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>qemu64</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>qemu32</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>phenom</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>pentium3</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>pentium2</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>pentium</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>n270</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>kvm64</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>kvm32</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>coreduo</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>core2duo</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>athlon</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>Westmere-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>Westmere</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Snowridge</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Server</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Client</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>SandyBridge</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>Penryn</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Opteron_G5</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Opteron_G4</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Opteron_G3</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Opteron_G2</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>Opteron_G1</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>Nehalem</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>IvyBridge</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Icelake-Server</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Haswell</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>EPYC-Rome</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>EPYC-Milan</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>EPYC</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Dhyana</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Cooperlake</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>Conroe</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Broadwell</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>486</model>
Aug 14 16:31:51 user nova-compute[73056]:     </mode>
Aug 14 16:31:51 user nova-compute[73056]:   </cpu>
Aug 14 16:31:51 user nova-compute[73056]:   <memoryBacking supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:     <enum name='sourceType'>
Aug 14 16:31:51 user nova-compute[73056]:       <value>file</value>
Aug 14 16:31:51 user nova-compute[73056]:       <value>anonymous</value>
Aug 14 16:31:51 user nova-compute[73056]:       <value>memfd</value>
Aug 14 16:31:51 user nova-compute[73056]:     </enum>
Aug 14 16:31:51 user nova-compute[73056]:   </memoryBacking>
Aug 14 16:31:51 user nova-compute[73056]:   <devices>
Aug 14 16:31:51 user nova-compute[73056]:     <disk supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='diskDevice'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>disk</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>cdrom</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>floppy</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>lun</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='bus'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>fdc</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>scsi</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>usb</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>sata</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='model'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio-transitional</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio-non-transitional</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </disk>
Aug 14 16:31:51 user nova-compute[73056]:     <graphics supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='type'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>sdl</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>vnc</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>spice</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>egl-headless</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </graphics>
Aug 14 16:31:51 user nova-compute[73056]:     <video supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='modelType'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>vga</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>cirrus</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>vmvga</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>qxl</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>none</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>bochs</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>ramfb</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </video>
Aug 14 16:31:51 user nova-compute[73056]:     <hostdev supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='mode'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>subsystem</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='startupPolicy'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>default</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>mandatory</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>requisite</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>optional</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='subsysType'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>usb</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>pci</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>scsi</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='capsType'/>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='pciBackend'/>
Aug 14 16:31:51 user nova-compute[73056]:     </hostdev>
Aug 14 16:31:51 user nova-compute[73056]:     <rng supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='model'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio-transitional</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio-non-transitional</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='backendModel'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>random</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>egd</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>builtin</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </rng>
Aug 14 16:31:51 user nova-compute[73056]:     <filesystem supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='driverType'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>path</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>handle</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtiofs</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </filesystem>
Aug 14 16:31:51 user nova-compute[73056]:     <tpm supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='model'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>tpm-tis</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>tpm-crb</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='backendModel'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>passthrough</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>emulator</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </tpm>
Aug 14 16:31:51 user nova-compute[73056]:   </devices>
Aug 14 16:31:51 user nova-compute[73056]:   <features>
Aug 14 16:31:51 user nova-compute[73056]:     <gic supported='no'/>
Aug 14 16:31:51 user nova-compute[73056]:     <vmcoreinfo supported='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:     <genid supported='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:     <backingStoreInput supported='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:     <backup supported='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:     <sev supported='no'/>
Aug 14 16:31:51 user nova-compute[73056]:   </features>
Aug 14 16:31:51 user nova-compute[73056]: </domainCapabilities>
Aug 14 16:31:51 user nova-compute[73056]:  {{(pid=73056) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 14 16:31:51 user nova-compute[73056]: <domainCapabilities>
Aug 14 16:31:51 user nova-compute[73056]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 14 16:31:51 user nova-compute[73056]:   <domain>kvm</domain>
Aug 14 16:31:51 user nova-compute[73056]:   <machine>pc-q35-6.2</machine>
Aug 14 16:31:51 user nova-compute[73056]:   <arch>x86_64</arch>
Aug 14 16:31:51 user nova-compute[73056]:   <vcpu max='288'/>
Aug 14 16:31:51 user nova-compute[73056]:   <iothreads supported='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:   <os supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:     <enum name='firmware'>
Aug 14 16:31:51 user nova-compute[73056]:       <value>efi</value>
Aug 14 16:31:51 user nova-compute[73056]:     </enum>
Aug 14 16:31:51 user nova-compute[73056]:     <loader supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 14 16:31:51 user nova-compute[73056]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 14 16:31:51 user nova-compute[73056]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='type'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>rom</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>pflash</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='readonly'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>yes</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>no</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='secure'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>yes</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>no</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </loader>
Aug 14 16:31:51 user nova-compute[73056]:   </os>
Aug 14 16:31:51 user nova-compute[73056]:   <cpu>
Aug 14 16:31:51 user nova-compute[73056]:     <mode name='host-passthrough' supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='hostPassthroughMigratable'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>on</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>off</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </mode>
Aug 14 16:31:51 user nova-compute[73056]:     <mode name='maximum' supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='maximumMigratable'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>on</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>off</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </mode>
Aug 14 16:31:51 user nova-compute[73056]:     <mode name='host-model' supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <vendor>Intel</vendor>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='ss'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='vmx'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='pcid'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='hypervisor'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='arat'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='umip'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='md-clear'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='stibp'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='ssbd'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='invtsc'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='ibpb'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='ibrs'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='amd-stibp'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='rsba'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='require' name='pschange-mc-no'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='disable' name='erms'/>
Aug 14 16:31:51 user nova-compute[73056]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 16:31:51 user nova-compute[73056]:     </mode>
Aug 14 16:31:51 user nova-compute[73056]:     <mode name='custom' supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>qemu64</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>qemu32</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>phenom</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>pentium3</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>pentium2</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>pentium</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>n270</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>kvm64</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>kvm32</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>coreduo</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>core2duo</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>athlon</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>Westmere-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>Westmere</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Snowridge</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Server</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Skylake-Client</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>SandyBridge</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>Penryn</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Opteron_G5</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Opteron_G4</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Opteron_G3</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Opteron_G2</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>Opteron_G1</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>Nehalem</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>IvyBridge</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Icelake-Server</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Haswell</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>EPYC-Rome</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>EPYC-Milan</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>EPYC</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Dhyana</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Cooperlake</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>Conroe</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='no'>Broadwell</model>
Aug 14 16:31:51 user nova-compute[73056]:       <model usable='yes'>486</model>
Aug 14 16:31:51 user nova-compute[73056]:     </mode>
Aug 14 16:31:51 user nova-compute[73056]:   </cpu>
Aug 14 16:31:51 user nova-compute[73056]:   <memoryBacking supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:     <enum name='sourceType'>
Aug 14 16:31:51 user nova-compute[73056]:       <value>file</value>
Aug 14 16:31:51 user nova-compute[73056]:       <value>anonymous</value>
Aug 14 16:31:51 user nova-compute[73056]:       <value>memfd</value>
Aug 14 16:31:51 user nova-compute[73056]:     </enum>
Aug 14 16:31:51 user nova-compute[73056]:   </memoryBacking>
Aug 14 16:31:51 user nova-compute[73056]:   <devices>
Aug 14 16:31:51 user nova-compute[73056]:     <disk supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='diskDevice'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>disk</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>cdrom</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>floppy</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>lun</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='bus'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>fdc</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>scsi</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>usb</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>sata</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='model'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio-transitional</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio-non-transitional</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </disk>
Aug 14 16:31:51 user nova-compute[73056]:     <graphics supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='type'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>sdl</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>vnc</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>spice</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>egl-headless</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </graphics>
Aug 14 16:31:51 user nova-compute[73056]:     <video supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='modelType'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>vga</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>cirrus</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>vmvga</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>qxl</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>none</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>bochs</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>ramfb</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </video>
Aug 14 16:31:51 user nova-compute[73056]:     <hostdev supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='mode'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>subsystem</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='startupPolicy'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>default</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>mandatory</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>requisite</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>optional</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='subsysType'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>usb</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>pci</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>scsi</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='capsType'/>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='pciBackend'/>
Aug 14 16:31:51 user nova-compute[73056]:     </hostdev>
Aug 14 16:31:51 user nova-compute[73056]:     <rng supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='model'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio-transitional</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtio-non-transitional</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='backendModel'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>random</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>egd</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>builtin</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </rng>
Aug 14 16:31:51 user nova-compute[73056]:     <filesystem supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='driverType'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>path</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>handle</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>virtiofs</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </filesystem>
Aug 14 16:31:51 user nova-compute[73056]:     <tpm supported='yes'>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='model'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>tpm-tis</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>tpm-crb</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:       <enum name='backendModel'>
Aug 14 16:31:51 user nova-compute[73056]:         <value>passthrough</value>
Aug 14 16:31:51 user nova-compute[73056]:         <value>emulator</value>
Aug 14 16:31:51 user nova-compute[73056]:       </enum>
Aug 14 16:31:51 user nova-compute[73056]:     </tpm>
Aug 14 16:31:51 user nova-compute[73056]:   </devices>
Aug 14 16:31:51 user nova-compute[73056]:   <features>
Aug 14 16:31:51 user nova-compute[73056]:     <gic supported='no'/>
Aug 14 16:31:51 user nova-compute[73056]:     <vmcoreinfo supported='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:     <genid supported='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:     <backingStoreInput supported='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:     <backup supported='yes'/>
Aug 14 16:31:51 user nova-compute[73056]:     <sev supported='no'/>
Aug 14 16:31:51 user nova-compute[73056]:   </features>
Aug 14 16:31:51 user nova-compute[73056]: </domainCapabilities>
Aug 14 16:31:51 user nova-compute[73056]:  {{(pid=73056) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=73056) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=73056) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=73056) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=73056) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Checking secure boot support for host arch (x86_64) {{(pid=73056) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Checking secure boot support for host arch (x86_64) {{(pid=73056) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Checking secure boot support for host arch (x86_64) {{(pid=73056) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Checking secure boot support for host arch (x86_64) {{(pid=73056) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Checking secure boot support for host arch (x86_64) {{(pid=73056) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 14 16:31:51 user nova-compute[73056]: INFO nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Secure Boot support detected
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] cpu compare xml: <cpu match="exact">
Aug 14 16:31:51 user nova-compute[73056]:   <model>Nehalem</model>
Aug 14 16:31:51 user nova-compute[73056]: </cpu>
Aug 14 16:31:51 user nova-compute[73056]:  {{(pid=73056) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 14 16:31:51 user nova-compute[73056]: INFO nova.virt.node [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Generated node identity 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b
Aug 14 16:31:51 user nova-compute[73056]: INFO nova.virt.node [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Wrote node identity 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b to /opt/stack/data/nova/compute_id
Aug 14 16:31:51 user nova-compute[73056]: WARNING nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Compute nodes ['2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 14 16:31:51 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 14 16:31:51 user nova-compute[73056]: WARNING nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 14 16:31:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 16:31:51 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:31:51 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Hypervisor/Node resource view: name=user free_ram=10861MB free_disk=26.277915954589844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:31:51 user nova-compute[73056]: WARNING nova.compute.resource_tracker [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] No compute node record for user:2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b could not be found.
Aug 14 16:31:51 user nova-compute[73056]: INFO nova.compute.resource_tracker [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Compute node record created for user:user with uuid: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 16:31:51 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 16:31:52 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [req-92566cce-6e16-44b5-81f2-2cdb0c3eddcf] Created resource provider record via placement API for resource provider with UUID 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b and name user.
Aug 14 16:31:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=73056) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 14 16:31:52 user nova-compute[73056]: INFO nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] kernel doesn't support AMD SEV
Aug 14 16:31:52 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Updating inventory in ProviderTree for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 16:31:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:31:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Libvirt baseline CPU <cpu>
Aug 14 16:31:52 user nova-compute[73056]:   <arch>x86_64</arch>
Aug 14 16:31:52 user nova-compute[73056]:   <model>Nehalem</model>
Aug 14 16:31:52 user nova-compute[73056]:   <vendor>Intel</vendor>
Aug 14 16:31:52 user nova-compute[73056]:   <topology sockets="6" cores="1" threads="1"/>
Aug 14 16:31:52 user nova-compute[73056]: </cpu>
Aug 14 16:31:52 user nova-compute[73056]:  {{(pid=73056) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 14 16:31:52 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Updated inventory for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 14 16:31:52 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Updating resource provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b generation from 0 to 1 during operation: update_inventory {{(pid=73056) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 14 16:31:52 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Updating inventory in ProviderTree for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 16:31:52 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Updating resource provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b generation from 1 to 2 during operation: update_traits {{(pid=73056) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 14 16:31:52 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 16:31:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.637s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:31:52 user nova-compute[73056]: DEBUG nova.service [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Creating RPC server for service compute {{(pid=73056) start /opt/stack/nova/nova/service.py:182}}
Aug 14 16:31:52 user nova-compute[73056]: DEBUG nova.service [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Join ServiceGroup membership for this service compute {{(pid=73056) start /opt/stack/nova/nova/service.py:199}}
Aug 14 16:31:52 user nova-compute[73056]: DEBUG nova.servicegroup.drivers.db [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=73056) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 14 16:32:51 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:32:51 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:32:51 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 16:32:51 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Rebuilding the list of instances to heal {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 16:32:51 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Didn't find any instances for network info cache update. {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 16:32:51 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:32:51 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:32:51 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:32:51 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:32:51 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:32:51 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:32:51 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:32:51 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 16:32:51 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:32:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:32:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:32:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:32:51 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 16:32:51 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:32:51 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:32:51 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=10238MB free_disk=26.18151092529297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 16:32:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:32:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:32:51 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 16:32:51 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 16:32:51 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:32:51 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:32:52 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 16:32:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:32:52 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:33:43 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:33:43 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:33:44 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:33:44 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:33:44 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:33:44 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:33:44 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:33:44 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 16:33:44 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:33:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:33:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:33:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:33:44 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 16:33:44 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:33:44 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:33:44 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=10187MB free_disk=26.227676391601562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 16:33:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:33:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:33:44 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 16:33:44 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 16:33:44 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:33:44 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:33:44 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 16:33:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:33:45 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:33:45 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 16:33:45 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Rebuilding the list of instances to heal {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 16:33:45 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Didn't find any instances for network info cache update. {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 16:33:45 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:34:43 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:34:44 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:34:44 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:34:44 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:34:44 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:34:44 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 16:34:44 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:34:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:34:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:34:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:34:44 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 16:34:44 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:34:44 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:34:44 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=10170MB free_disk=26.011882781982422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 16:34:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:34:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:34:44 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 16:34:44 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 16:34:44 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:34:44 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:34:44 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 16:34:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.132s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:34:46 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:34:46 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 16:34:46 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Rebuilding the list of instances to heal {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 16:34:46 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Didn't find any instances for network info cache update. {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 16:34:46 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:34:47 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:35:43 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:35:43 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:35:45 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:35:45 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:35:45 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 16:35:45 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:35:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:35:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:35:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:35:45 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 16:35:45 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:35:45 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:35:45 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=9439MB free_disk=26.033794403076172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 16:35:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:35:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:35:45 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 16:35:45 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 16:35:45 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:35:45 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:35:45 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 16:35:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:35:46 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:35:46 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:35:47 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:35:47 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 16:35:47 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Rebuilding the list of instances to heal {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 16:35:47 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Didn't find any instances for network info cache update. {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 16:35:47 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:35:49 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:35:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Acquiring lock "6c9c38ee-426d-4dcf-8720-7ad5fad8492d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:35:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Lock "6c9c38ee-426d-4dcf-8720-7ad5fad8492d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:35:51 user nova-compute[73056]: DEBUG nova.compute.manager [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:35:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:35:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:35:51 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:35:51 user nova-compute[73056]: INFO nova.compute.claims [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Claim successful on node user
Aug 14 16:35:51 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:35:51 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:35:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.391s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:35:52 user nova-compute[73056]: DEBUG nova.compute.manager [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:35:52 user nova-compute[73056]: DEBUG nova.compute.manager [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:35:52 user nova-compute[73056]: DEBUG nova.network.neutron [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:35:52 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:35:52 user nova-compute[73056]: DEBUG nova.compute.manager [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:35:52 user nova-compute[73056]: DEBUG nova.compute.manager [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:35:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:35:52 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Creating image(s)
Aug 14 16:35:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Acquiring lock "/opt/stack/data/nova/instances/6c9c38ee-426d-4dcf-8720-7ad5fad8492d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:35:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Lock "/opt/stack/data/nova/instances/6c9c38ee-426d-4dcf-8720-7ad5fad8492d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:35:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Lock "/opt/stack/data/nova/instances/6c9c38ee-426d-4dcf-8720-7ad5fad8492d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:35:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Acquiring lock "c889592ab94cd0b0ce896f27a2af0323771db234" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:35:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:35:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234.part --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:35:53 user nova-compute[73056]: DEBUG nova.policy [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c27754fec0c34eec8656f8216928766e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bfccc8baa174f63976b821e58cc189c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:35:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234.part --force-share --output=json" returned: 0 in 0.180s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:35:53 user nova-compute[73056]: DEBUG nova.virt.images [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] 80fe003b-9902-44ab-86de-a284c1e79abd was qcow2, converting to raw {{(pid=73056) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 16:35:53 user nova-compute[73056]: DEBUG nova.privsep.utils [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73056) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 16:35:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234.part /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234.converted {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:35:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234.part /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234.converted" returned: 0 in 0.135s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:35:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234.converted --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:35:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:35:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.087s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:35:53 user nova-compute[73056]: INFO oslo.privsep.daemon [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp9apc27qq/privsep.sock']
Aug 14 16:35:53 user sudo[82307]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp9apc27qq/privsep.sock
Aug 14 16:35:53 user sudo[82307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 14 16:35:54 user nova-compute[73056]: DEBUG nova.network.neutron [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Successfully created port: 6854da1e-a228-4a49-bdcb-19df7a6704ac {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:35:55 user sudo[82307]: pam_unix(sudo:session): session closed for user root
Aug 14 16:35:55 user nova-compute[73056]: INFO oslo.privsep.daemon [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Spawned new privsep daemon via rootwrap
Aug 14 16:35:55 user nova-compute[73056]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 14 16:35:55 user nova-compute[73056]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 14 16:35:55 user nova-compute[73056]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 14 16:35:55 user nova-compute[73056]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82311
Aug 14 16:35:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:35:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.195s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:35:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Acquiring lock "c889592ab94cd0b0ce896f27a2af0323771db234" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:35:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:35:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:35:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.199s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:35:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/6c9c38ee-426d-4dcf-8720-7ad5fad8492d/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:35:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/6c9c38ee-426d-4dcf-8720-7ad5fad8492d/disk 1073741824" returned: 0 in 0.038s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:35:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:35:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:35:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.203s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:35:56 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6c9c38ee-426d-4dcf-8720-7ad5fad8492d/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 16:35:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9c38ee-426d-4dcf-8720-7ad5fad8492d/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:35:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9c38ee-426d-4dcf-8720-7ad5fad8492d/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:35:56 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Cannot resize image /opt/stack/data/nova/instances/6c9c38ee-426d-4dcf-8720-7ad5fad8492d/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 16:35:56 user nova-compute[73056]: DEBUG nova.objects.instance [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Lazy-loading 'migration_context' on Instance uuid 6c9c38ee-426d-4dcf-8720-7ad5fad8492d {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:35:56 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 16:35:56 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Ensure instance console log exists: /opt/stack/data/nova/instances/6c9c38ee-426d-4dcf-8720-7ad5fad8492d/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:35:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:35:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:35:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:35:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "9f3a7f8a-e3b9-4918-9663-968677fe5c90" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:35:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "9f3a7f8a-e3b9-4918-9663-968677fe5c90" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:35:57 user nova-compute[73056]: DEBUG nova.compute.manager [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:35:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:35:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:35:57 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:35:57 user nova-compute[73056]: INFO nova.compute.claims [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Claim successful on node user
Aug 14 16:35:57 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:35:57 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:35:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.250s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:35:57 user nova-compute[73056]: DEBUG nova.compute.manager [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:35:57 user nova-compute[73056]: DEBUG nova.compute.manager [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:35:57 user nova-compute[73056]: DEBUG nova.network.neutron [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:35:57 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:35:57 user nova-compute[73056]: DEBUG nova.compute.manager [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:35:57 user nova-compute[73056]: DEBUG nova.policy [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9404ed7386e14eed8d046e8c45942c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd5723fb8384aa985cf401d95aa7d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:35:57 user nova-compute[73056]: DEBUG nova.compute.manager [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:35:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:35:57 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Creating image(s)
Aug 14 16:35:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "/opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:35:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "/opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:35:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "/opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:35:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:35:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.177s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:35:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "c889592ab94cd0b0ce896f27a2af0323771db234" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:35:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:35:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:35:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.193s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:35:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:35:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk 1073741824" returned: 0 in 0.046s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:35:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:35:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:35:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.187s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:35:58 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 16:35:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:35:58 user nova-compute[73056]: DEBUG nova.network.neutron [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Successfully updated port: 6854da1e-a228-4a49-bdcb-19df7a6704ac {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:35:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Acquiring lock "refresh_cache-6c9c38ee-426d-4dcf-8720-7ad5fad8492d" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:35:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Acquired lock "refresh_cache-6c9c38ee-426d-4dcf-8720-7ad5fad8492d" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:35:58 user nova-compute[73056]: DEBUG nova.network.neutron [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:35:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:35:58 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Cannot resize image /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 16:35:58 user nova-compute[73056]: DEBUG nova.objects.instance [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lazy-loading 'migration_context' on Instance uuid 9f3a7f8a-e3b9-4918-9663-968677fe5c90 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:35:58 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 16:35:58 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Ensure instance console log exists: /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:35:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:35:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:35:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:35:58 user nova-compute[73056]: DEBUG nova.network.neutron [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:35:58 user nova-compute[73056]: DEBUG nova.compute.manager [req-444f55e4-e32f-42f7-ac95-12a0c7556845 req-ba0b27bf-2149-467c-bb3a-09d10a90288a service nova] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Received event network-changed-6854da1e-a228-4a49-bdcb-19df7a6704ac {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:35:58 user nova-compute[73056]: DEBUG nova.compute.manager [req-444f55e4-e32f-42f7-ac95-12a0c7556845 req-ba0b27bf-2149-467c-bb3a-09d10a90288a service nova] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Refreshing instance network info cache due to event network-changed-6854da1e-a228-4a49-bdcb-19df7a6704ac. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:35:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-444f55e4-e32f-42f7-ac95-12a0c7556845 req-ba0b27bf-2149-467c-bb3a-09d10a90288a service nova] Acquiring lock "refresh_cache-6c9c38ee-426d-4dcf-8720-7ad5fad8492d" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:35:59 user nova-compute[73056]: DEBUG nova.network.neutron [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Successfully created port: 312bec25-d19f-423b-aca3-a4117119fc1f {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG nova.network.neutron [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Updating instance_info_cache with network_info: [{"id": "6854da1e-a228-4a49-bdcb-19df7a6704ac", "address": "fa:16:3e:5d:3d:75", "network": {"id": "35512310-0629-426a-94a4-1d564653b88e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-997222200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfccc8baa174f63976b821e58cc189c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6854da1e-a2", "ovs_interfaceid": "6854da1e-a228-4a49-bdcb-19df7a6704ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Releasing lock "refresh_cache-6c9c38ee-426d-4dcf-8720-7ad5fad8492d" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG nova.compute.manager [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Instance network_info: |[{"id": "6854da1e-a228-4a49-bdcb-19df7a6704ac", "address": "fa:16:3e:5d:3d:75", "network": {"id": "35512310-0629-426a-94a4-1d564653b88e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-997222200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfccc8baa174f63976b821e58cc189c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6854da1e-a2", "ovs_interfaceid": "6854da1e-a228-4a49-bdcb-19df7a6704ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-444f55e4-e32f-42f7-ac95-12a0c7556845 req-ba0b27bf-2149-467c-bb3a-09d10a90288a service nova] Acquired lock "refresh_cache-6c9c38ee-426d-4dcf-8720-7ad5fad8492d" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG nova.network.neutron [req-444f55e4-e32f-42f7-ac95-12a0c7556845 req-ba0b27bf-2149-467c-bb3a-09d10a90288a service nova] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Refreshing network info cache for port 6854da1e-a228-4a49-bdcb-19df7a6704ac {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Start _get_guest_xml network_info=[{"id": "6854da1e-a228-4a49-bdcb-19df7a6704ac", "address": "fa:16:3e:5d:3d:75", "network": {"id": "35512310-0629-426a-94a4-1d564653b88e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-997222200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfccc8baa174f63976b821e58cc189c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6854da1e-a2", "ovs_interfaceid": "6854da1e-a228-4a49-bdcb-19df7a6704ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:36:00 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:36:00 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:36:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG nova.privsep.utils [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73056) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:35:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-901344255',display_name='tempest-DeleteServersTestJSON-server-901344255',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-901344255',id=1,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3bfccc8baa174f63976b821e58cc189c',ramdisk_id='',reservation_id='r-mzmc8pfy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-436563330',owner_user_name='tempest-DeleteServersTestJSON-436563330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:35:52Z,user_data=None,user_id='c27754fec0c34eec8656f8216928766e',uuid=6c9c38ee-426d-4dcf-8720-7ad5fad8492d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6854da1e-a228-4a49-bdcb-19df7a6704ac", "address": "fa:16:3e:5d:3d:75", "network": {"id": "35512310-0629-426a-94a4-1d564653b88e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-997222200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfccc8baa174f63976b821e58cc189c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6854da1e-a2", "ovs_interfaceid": "6854da1e-a228-4a49-bdcb-19df7a6704ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Converting VIF {"id": "6854da1e-a228-4a49-bdcb-19df7a6704ac", "address": "fa:16:3e:5d:3d:75", "network": {"id": "35512310-0629-426a-94a4-1d564653b88e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-997222200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfccc8baa174f63976b821e58cc189c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6854da1e-a2", "ovs_interfaceid": "6854da1e-a228-4a49-bdcb-19df7a6704ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:3d:75,bridge_name='br-int',has_traffic_filtering=True,id=6854da1e-a228-4a49-bdcb-19df7a6704ac,network=Network(35512310-0629-426a-94a4-1d564653b88e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6854da1e-a2') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG nova.objects.instance [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c9c38ee-426d-4dcf-8720-7ad5fad8492d {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:36:00 user nova-compute[73056]:   <uuid>6c9c38ee-426d-4dcf-8720-7ad5fad8492d</uuid>
Aug 14 16:36:00 user nova-compute[73056]:   <name>instance-00000001</name>
Aug 14 16:36:00 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:36:00 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:36:00 user nova-compute[73056]:   <metadata>
Aug 14 16:36:00 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:36:00 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:36:00 user nova-compute[73056]:       <nova:name>tempest-DeleteServersTestJSON-server-901344255</nova:name>
Aug 14 16:36:00 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:36:00</nova:creationTime>
Aug 14 16:36:00 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:36:00 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:36:00 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:36:00 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:36:00 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:36:00 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:36:00 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:36:00 user nova-compute[73056]:       <nova:owner>
Aug 14 16:36:00 user nova-compute[73056]:         <nova:user uuid="c27754fec0c34eec8656f8216928766e">tempest-DeleteServersTestJSON-436563330-project-member</nova:user>
Aug 14 16:36:00 user nova-compute[73056]:         <nova:project uuid="3bfccc8baa174f63976b821e58cc189c">tempest-DeleteServersTestJSON-436563330</nova:project>
Aug 14 16:36:00 user nova-compute[73056]:       </nova:owner>
Aug 14 16:36:00 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:36:00 user nova-compute[73056]:       <nova:ports>
Aug 14 16:36:00 user nova-compute[73056]:         <nova:port uuid="6854da1e-a228-4a49-bdcb-19df7a6704ac">
Aug 14 16:36:00 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 16:36:00 user nova-compute[73056]:         </nova:port>
Aug 14 16:36:00 user nova-compute[73056]:       </nova:ports>
Aug 14 16:36:00 user nova-compute[73056]:     </nova:instance>
Aug 14 16:36:00 user nova-compute[73056]:   </metadata>
Aug 14 16:36:00 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:36:00 user nova-compute[73056]:     <system>
Aug 14 16:36:00 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:36:00 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:36:00 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:36:00 user nova-compute[73056]:       <entry name="serial">6c9c38ee-426d-4dcf-8720-7ad5fad8492d</entry>
Aug 14 16:36:00 user nova-compute[73056]:       <entry name="uuid">6c9c38ee-426d-4dcf-8720-7ad5fad8492d</entry>
Aug 14 16:36:00 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:36:00 user nova-compute[73056]:     </system>
Aug 14 16:36:00 user nova-compute[73056]:   </sysinfo>
Aug 14 16:36:00 user nova-compute[73056]:   <os>
Aug 14 16:36:00 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:36:00 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:36:00 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:36:00 user nova-compute[73056]:   </os>
Aug 14 16:36:00 user nova-compute[73056]:   <features>
Aug 14 16:36:00 user nova-compute[73056]:     <acpi/>
Aug 14 16:36:00 user nova-compute[73056]:     <apic/>
Aug 14 16:36:00 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:36:00 user nova-compute[73056]:   </features>
Aug 14 16:36:00 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:36:00 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:36:00 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:36:00 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:36:00 user nova-compute[73056]:   </clock>
Aug 14 16:36:00 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:36:00 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:36:00 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:36:00 user nova-compute[73056]:   </cpu>
Aug 14 16:36:00 user nova-compute[73056]:   <devices>
Aug 14 16:36:00 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:36:00 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:36:00 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/6c9c38ee-426d-4dcf-8720-7ad5fad8492d/disk"/>
Aug 14 16:36:00 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:36:00 user nova-compute[73056]:     </disk>
Aug 14 16:36:00 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:36:00 user nova-compute[73056]:       <mac address="fa:16:3e:5d:3d:75"/>
Aug 14 16:36:00 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:36:00 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:36:00 user nova-compute[73056]:       <target dev="tap6854da1e-a2"/>
Aug 14 16:36:00 user nova-compute[73056]:     </interface>
Aug 14 16:36:00 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:36:00 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/6c9c38ee-426d-4dcf-8720-7ad5fad8492d/console.log" append="off"/>
Aug 14 16:36:00 user nova-compute[73056]:     </serial>
Aug 14 16:36:00 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:36:00 user nova-compute[73056]:     <video>
Aug 14 16:36:00 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:36:00 user nova-compute[73056]:     </video>
Aug 14 16:36:00 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:36:00 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:36:00 user nova-compute[73056]:     </rng>
Aug 14 16:36:00 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:36:00 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:36:00 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:36:00 user nova-compute[73056]:     </memballoon>
Aug 14 16:36:00 user nova-compute[73056]:   </devices>
Aug 14 16:36:00 user nova-compute[73056]: </domain>
Aug 14 16:36:00 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:35:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-901344255',display_name='tempest-DeleteServersTestJSON-server-901344255',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-901344255',id=1,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3bfccc8baa174f63976b821e58cc189c',ramdisk_id='',reservation_id='r-mzmc8pfy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-436563330',owner_user_name='tempest-DeleteServersTestJSON-436563330-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:35:52Z,user_data=None,user_id='c27754fec0c34eec8656f8216928766e',uuid=6c9c38ee-426d-4dcf-8720-7ad5fad8492d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6854da1e-a228-4a49-bdcb-19df7a6704ac", "address": "fa:16:3e:5d:3d:75", "network": {"id": "35512310-0629-426a-94a4-1d564653b88e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-997222200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfccc8baa174f63976b821e58cc189c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6854da1e-a2", "ovs_interfaceid": "6854da1e-a228-4a49-bdcb-19df7a6704ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Converting VIF {"id": "6854da1e-a228-4a49-bdcb-19df7a6704ac", "address": "fa:16:3e:5d:3d:75", "network": {"id": "35512310-0629-426a-94a4-1d564653b88e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-997222200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfccc8baa174f63976b821e58cc189c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6854da1e-a2", "ovs_interfaceid": "6854da1e-a228-4a49-bdcb-19df7a6704ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:3d:75,bridge_name='br-int',has_traffic_filtering=True,id=6854da1e-a228-4a49-bdcb-19df7a6704ac,network=Network(35512310-0629-426a-94a4-1d564653b88e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6854da1e-a2') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG os_vif [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:3d:75,bridge_name='br-int',has_traffic_filtering=True,id=6854da1e-a228-4a49-bdcb-19df7a6704ac,network=Network(35512310-0629-426a-94a4-1d564653b88e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6854da1e-a2') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Created schema index Interface.name {{(pid=73056) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Created schema index Port.name {{(pid=73056) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Created schema index Bridge.name {{(pid=73056) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [POLLOUT] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:36:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:36:00 user nova-compute[73056]: INFO oslo.privsep.daemon [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpoj_0wcfz/privsep.sock']
Aug 14 16:36:00 user sudo[82413]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpoj_0wcfz/privsep.sock
Aug 14 16:36:00 user sudo[82413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 14 16:36:02 user nova-compute[73056]: DEBUG nova.network.neutron [req-444f55e4-e32f-42f7-ac95-12a0c7556845 req-ba0b27bf-2149-467c-bb3a-09d10a90288a service nova] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Updated VIF entry in instance network info cache for port 6854da1e-a228-4a49-bdcb-19df7a6704ac. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:36:02 user nova-compute[73056]: DEBUG nova.network.neutron [req-444f55e4-e32f-42f7-ac95-12a0c7556845 req-ba0b27bf-2149-467c-bb3a-09d10a90288a service nova] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Updating instance_info_cache with network_info: [{"id": "6854da1e-a228-4a49-bdcb-19df7a6704ac", "address": "fa:16:3e:5d:3d:75", "network": {"id": "35512310-0629-426a-94a4-1d564653b88e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-997222200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfccc8baa174f63976b821e58cc189c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6854da1e-a2", "ovs_interfaceid": "6854da1e-a228-4a49-bdcb-19df7a6704ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:36:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-444f55e4-e32f-42f7-ac95-12a0c7556845 req-ba0b27bf-2149-467c-bb3a-09d10a90288a service nova] Releasing lock "refresh_cache-6c9c38ee-426d-4dcf-8720-7ad5fad8492d" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:36:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:02 user nova-compute[73056]: DEBUG nova.network.neutron [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Successfully updated port: 312bec25-d19f-423b-aca3-a4117119fc1f {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:36:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "refresh_cache-9f3a7f8a-e3b9-4918-9663-968677fe5c90" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:36:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquired lock "refresh_cache-9f3a7f8a-e3b9-4918-9663-968677fe5c90" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:36:02 user nova-compute[73056]: DEBUG nova.network.neutron [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:36:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:02 user sudo[82413]: pam_unix(sudo:session): session closed for user root
Aug 14 16:36:02 user nova-compute[73056]: INFO oslo.privsep.daemon [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Spawned new privsep daemon via rootwrap
Aug 14 16:36:02 user nova-compute[73056]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 14 16:36:02 user nova-compute[73056]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 14 16:36:02 user nova-compute[73056]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 14 16:36:02 user nova-compute[73056]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82419
Aug 14 16:36:02 user nova-compute[73056]: DEBUG nova.network.neutron [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:36:02 user nova-compute[73056]: DEBUG nova.compute.manager [req-dfd26d54-986b-446e-861d-c0f850a4033f req-44d81310-8d0d-46fb-a989-892e9c9032ca service nova] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Received event network-changed-312bec25-d19f-423b-aca3-a4117119fc1f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:36:02 user nova-compute[73056]: DEBUG nova.compute.manager [req-dfd26d54-986b-446e-861d-c0f850a4033f req-44d81310-8d0d-46fb-a989-892e9c9032ca service nova] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Refreshing instance network info cache due to event network-changed-312bec25-d19f-423b-aca3-a4117119fc1f. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:36:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-dfd26d54-986b-446e-861d-c0f850a4033f req-44d81310-8d0d-46fb-a989-892e9c9032ca service nova] Acquiring lock "refresh_cache-9f3a7f8a-e3b9-4918-9663-968677fe5c90" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:36:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6854da1e-a2, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6854da1e-a2, col_values=(('external_ids', {'iface-id': '6854da1e-a228-4a49-bdcb-19df7a6704ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:3d:75', 'vm-uuid': '6c9c38ee-426d-4dcf-8720-7ad5fad8492d'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:03 user nova-compute[73056]: INFO os_vif [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:3d:75,bridge_name='br-int',has_traffic_filtering=True,id=6854da1e-a228-4a49-bdcb-19df7a6704ac,network=Network(35512310-0629-426a-94a4-1d564653b88e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6854da1e-a2')
Aug 14 16:36:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] No VIF found with MAC fa:16:3e:5d:3d:75, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG nova.network.neutron [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Updating instance_info_cache with network_info: [{"id": "312bec25-d19f-423b-aca3-a4117119fc1f", "address": "fa:16:3e:03:ce:11", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312bec25-d1", "ovs_interfaceid": "312bec25-d19f-423b-aca3-a4117119fc1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Releasing lock "refresh_cache-9f3a7f8a-e3b9-4918-9663-968677fe5c90" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG nova.compute.manager [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Instance network_info: |[{"id": "312bec25-d19f-423b-aca3-a4117119fc1f", "address": "fa:16:3e:03:ce:11", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312bec25-d1", "ovs_interfaceid": "312bec25-d19f-423b-aca3-a4117119fc1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-dfd26d54-986b-446e-861d-c0f850a4033f req-44d81310-8d0d-46fb-a989-892e9c9032ca service nova] Acquired lock "refresh_cache-9f3a7f8a-e3b9-4918-9663-968677fe5c90" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG nova.network.neutron [req-dfd26d54-986b-446e-861d-c0f850a4033f req-44d81310-8d0d-46fb-a989-892e9c9032ca service nova] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Refreshing network info cache for port 312bec25-d19f-423b-aca3-a4117119fc1f {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Start _get_guest_xml network_info=[{"id": "312bec25-d19f-423b-aca3-a4117119fc1f", "address": "fa:16:3e:03:ce:11", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312bec25-d1", "ovs_interfaceid": "312bec25-d19f-423b-aca3-a4117119fc1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:36:03 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:36:03 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:36:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:35:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1036814563',display_name='tempest-ServerActionsTestOtherA-server-1036814563',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1036814563',id=2,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDU6ne8W7YSxsWIOL2ltT8/3A4Lay+Fa3EBjGBahsu1+va9jX8aVIvfUTXS/QOiNmJPitbbWTrcI3+h3fj8j4zOwrNCeF7Pt0QIdwz/ogo81jcw9PMYL2yia/QSf+KeHhA==',key_name='tempest-keypair-1415046919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2dd5723fb8384aa985cf401d95aa7d08',ramdisk_id='',reservation_id='r-aw7pyz1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-380813086',owner_user_name='tempest-ServerActionsTestOtherA-380813086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:35:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9404ed7386e14eed8d046e8c45942c75',uuid=9f3a7f8a-e3b9-4918-9663-968677fe5c90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "312bec25-d19f-423b-aca3-a4117119fc1f", "address": "fa:16:3e:03:ce:11", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312bec25-d1", "ovs_interfaceid": "312bec25-d19f-423b-aca3-a4117119fc1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Converting VIF {"id": "312bec25-d19f-423b-aca3-a4117119fc1f", "address": "fa:16:3e:03:ce:11", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312bec25-d1", "ovs_interfaceid": "312bec25-d19f-423b-aca3-a4117119fc1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:ce:11,bridge_name='br-int',has_traffic_filtering=True,id=312bec25-d19f-423b-aca3-a4117119fc1f,network=Network(2c5f0d57-9485-4a0b-a847-49eea5cd17c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312bec25-d1') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG nova.objects.instance [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f3a7f8a-e3b9-4918-9663-968677fe5c90 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:36:03 user nova-compute[73056]:   <uuid>9f3a7f8a-e3b9-4918-9663-968677fe5c90</uuid>
Aug 14 16:36:03 user nova-compute[73056]:   <name>instance-00000002</name>
Aug 14 16:36:03 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:36:03 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:36:03 user nova-compute[73056]:   <metadata>
Aug 14 16:36:03 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:36:03 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:36:03 user nova-compute[73056]:       <nova:name>tempest-ServerActionsTestOtherA-server-1036814563</nova:name>
Aug 14 16:36:03 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:36:03</nova:creationTime>
Aug 14 16:36:03 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:36:03 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:36:03 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:36:03 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:36:03 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:36:03 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:36:03 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:36:03 user nova-compute[73056]:       <nova:owner>
Aug 14 16:36:03 user nova-compute[73056]:         <nova:user uuid="9404ed7386e14eed8d046e8c45942c75">tempest-ServerActionsTestOtherA-380813086-project-member</nova:user>
Aug 14 16:36:03 user nova-compute[73056]:         <nova:project uuid="2dd5723fb8384aa985cf401d95aa7d08">tempest-ServerActionsTestOtherA-380813086</nova:project>
Aug 14 16:36:03 user nova-compute[73056]:       </nova:owner>
Aug 14 16:36:03 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:36:03 user nova-compute[73056]:       <nova:ports>
Aug 14 16:36:03 user nova-compute[73056]:         <nova:port uuid="312bec25-d19f-423b-aca3-a4117119fc1f">
Aug 14 16:36:03 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 14 16:36:03 user nova-compute[73056]:         </nova:port>
Aug 14 16:36:03 user nova-compute[73056]:       </nova:ports>
Aug 14 16:36:03 user nova-compute[73056]:     </nova:instance>
Aug 14 16:36:03 user nova-compute[73056]:   </metadata>
Aug 14 16:36:03 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:36:03 user nova-compute[73056]:     <system>
Aug 14 16:36:03 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:36:03 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:36:03 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:36:03 user nova-compute[73056]:       <entry name="serial">9f3a7f8a-e3b9-4918-9663-968677fe5c90</entry>
Aug 14 16:36:03 user nova-compute[73056]:       <entry name="uuid">9f3a7f8a-e3b9-4918-9663-968677fe5c90</entry>
Aug 14 16:36:03 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:36:03 user nova-compute[73056]:     </system>
Aug 14 16:36:03 user nova-compute[73056]:   </sysinfo>
Aug 14 16:36:03 user nova-compute[73056]:   <os>
Aug 14 16:36:03 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:36:03 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:36:03 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:36:03 user nova-compute[73056]:   </os>
Aug 14 16:36:03 user nova-compute[73056]:   <features>
Aug 14 16:36:03 user nova-compute[73056]:     <acpi/>
Aug 14 16:36:03 user nova-compute[73056]:     <apic/>
Aug 14 16:36:03 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:36:03 user nova-compute[73056]:   </features>
Aug 14 16:36:03 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:36:03 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:36:03 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:36:03 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:36:03 user nova-compute[73056]:   </clock>
Aug 14 16:36:03 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:36:03 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:36:03 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:36:03 user nova-compute[73056]:   </cpu>
Aug 14 16:36:03 user nova-compute[73056]:   <devices>
Aug 14 16:36:03 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:36:03 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:36:03 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk"/>
Aug 14 16:36:03 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:36:03 user nova-compute[73056]:     </disk>
Aug 14 16:36:03 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:36:03 user nova-compute[73056]:       <mac address="fa:16:3e:03:ce:11"/>
Aug 14 16:36:03 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:36:03 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:36:03 user nova-compute[73056]:       <target dev="tap312bec25-d1"/>
Aug 14 16:36:03 user nova-compute[73056]:     </interface>
Aug 14 16:36:03 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:36:03 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/console.log" append="off"/>
Aug 14 16:36:03 user nova-compute[73056]:     </serial>
Aug 14 16:36:03 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:36:03 user nova-compute[73056]:     <video>
Aug 14 16:36:03 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:36:03 user nova-compute[73056]:     </video>
Aug 14 16:36:03 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:36:03 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:36:03 user nova-compute[73056]:     </rng>
Aug 14 16:36:03 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:36:03 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:36:03 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:36:03 user nova-compute[73056]:     </memballoon>
Aug 14 16:36:03 user nova-compute[73056]:   </devices>
Aug 14 16:36:03 user nova-compute[73056]: </domain>
Aug 14 16:36:03 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:35:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1036814563',display_name='tempest-ServerActionsTestOtherA-server-1036814563',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1036814563',id=2,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDU6ne8W7YSxsWIOL2ltT8/3A4Lay+Fa3EBjGBahsu1+va9jX8aVIvfUTXS/QOiNmJPitbbWTrcI3+h3fj8j4zOwrNCeF7Pt0QIdwz/ogo81jcw9PMYL2yia/QSf+KeHhA==',key_name='tempest-keypair-1415046919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2dd5723fb8384aa985cf401d95aa7d08',ramdisk_id='',reservation_id='r-aw7pyz1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-380813086',owner_user_name='tempest-ServerActionsTestOtherA-380813086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:35:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9404ed7386e14eed8d046e8c45942c75',uuid=9f3a7f8a-e3b9-4918-9663-968677fe5c90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "312bec25-d19f-423b-aca3-a4117119fc1f", "address": "fa:16:3e:03:ce:11", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312bec25-d1", "ovs_interfaceid": "312bec25-d19f-423b-aca3-a4117119fc1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Converting VIF {"id": "312bec25-d19f-423b-aca3-a4117119fc1f", "address": "fa:16:3e:03:ce:11", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312bec25-d1", "ovs_interfaceid": "312bec25-d19f-423b-aca3-a4117119fc1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:ce:11,bridge_name='br-int',has_traffic_filtering=True,id=312bec25-d19f-423b-aca3-a4117119fc1f,network=Network(2c5f0d57-9485-4a0b-a847-49eea5cd17c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312bec25-d1') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG os_vif [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:ce:11,bridge_name='br-int',has_traffic_filtering=True,id=312bec25-d19f-423b-aca3-a4117119fc1f,network=Network(2c5f0d57-9485-4a0b-a847-49eea5cd17c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312bec25-d1') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap312bec25-d1, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap312bec25-d1, col_values=(('external_ids', {'iface-id': '312bec25-d19f-423b-aca3-a4117119fc1f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:ce:11', 'vm-uuid': '9f3a7f8a-e3b9-4918-9663-968677fe5c90'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:36:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:03 user nova-compute[73056]: INFO os_vif [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:ce:11,bridge_name='br-int',has_traffic_filtering=True,id=312bec25-d19f-423b-aca3-a4117119fc1f,network=Network(2c5f0d57-9485-4a0b-a847-49eea5cd17c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312bec25-d1')
Aug 14 16:36:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:36:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] No VIF found with MAC fa:16:3e:03:ce:11, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:36:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:06 user nova-compute[73056]: DEBUG nova.network.neutron [req-dfd26d54-986b-446e-861d-c0f850a4033f req-44d81310-8d0d-46fb-a989-892e9c9032ca service nova] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Updated VIF entry in instance network info cache for port 312bec25-d19f-423b-aca3-a4117119fc1f. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:36:06 user nova-compute[73056]: DEBUG nova.network.neutron [req-dfd26d54-986b-446e-861d-c0f850a4033f req-44d81310-8d0d-46fb-a989-892e9c9032ca service nova] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Updating instance_info_cache with network_info: [{"id": "312bec25-d19f-423b-aca3-a4117119fc1f", "address": "fa:16:3e:03:ce:11", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312bec25-d1", "ovs_interfaceid": "312bec25-d19f-423b-aca3-a4117119fc1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:36:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-dfd26d54-986b-446e-861d-c0f850a4033f req-44d81310-8d0d-46fb-a989-892e9c9032ca service nova] Releasing lock "refresh_cache-9f3a7f8a-e3b9-4918-9663-968677fe5c90" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:36:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:08 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692030968.541835, 9f3a7f8a-e3b9-4918-9663-968677fe5c90 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:36:08 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] VM Resumed (Lifecycle Event)
Aug 14 16:36:08 user nova-compute[73056]: DEBUG nova.compute.manager [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:36:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:36:08 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Instance spawned successfully.
Aug 14 16:36:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:36:08 user nova-compute[73056]: DEBUG nova.compute.manager [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:36:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:36:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:36:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:36:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:36:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:36:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:36:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:36:08 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:36:08 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Instance spawned successfully.
Aug 14 16:36:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:36:08 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:36:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:36:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:36:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:36:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:36:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:36:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:36:08 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:36:08 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692030968.5681672, 9f3a7f8a-e3b9-4918-9663-968677fe5c90 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:36:08 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] VM Started (Lifecycle Event)
Aug 14 16:36:08 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:36:08 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:36:08 user nova-compute[73056]: INFO nova.compute.manager [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Took 11.05 seconds to spawn the instance on the hypervisor.
Aug 14 16:36:08 user nova-compute[73056]: DEBUG nova.compute.manager [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:36:08 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:36:08 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692030968.5870025, 6c9c38ee-426d-4dcf-8720-7ad5fad8492d => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:36:08 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] VM Resumed (Lifecycle Event)
Aug 14 16:36:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:09 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:36:09 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:36:09 user nova-compute[73056]: INFO nova.compute.manager [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Took 16.65 seconds to spawn the instance on the hypervisor.
Aug 14 16:36:09 user nova-compute[73056]: DEBUG nova.compute.manager [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:36:09 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:36:09 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692030968.587252, 6c9c38ee-426d-4dcf-8720-7ad5fad8492d => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:36:09 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] VM Started (Lifecycle Event)
Aug 14 16:36:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:09 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:36:09 user nova-compute[73056]: INFO nova.compute.manager [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Took 12.00 seconds to build instance.
Aug 14 16:36:09 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:36:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-414d74cb-e78d-4ffd-a26e-ca148269fa13 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "9f3a7f8a-e3b9-4918-9663-968677fe5c90" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.193s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:09 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:36:09 user nova-compute[73056]: INFO nova.compute.manager [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Took 17.73 seconds to build instance.
Aug 14 16:36:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d8ce78cf-3130-4b89-bce9-95243302f3ec tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Lock "6c9c38ee-426d-4dcf-8720-7ad5fad8492d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.954s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:12 user nova-compute[73056]: DEBUG nova.compute.manager [req-69cc23e5-30db-47a6-9765-715af570547e req-43e8a998-327d-4f75-962a-05e5f95f3186 service nova] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Received event network-vif-plugged-312bec25-d19f-423b-aca3-a4117119fc1f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:36:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-69cc23e5-30db-47a6-9765-715af570547e req-43e8a998-327d-4f75-962a-05e5f95f3186 service nova] Acquiring lock "9f3a7f8a-e3b9-4918-9663-968677fe5c90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-69cc23e5-30db-47a6-9765-715af570547e req-43e8a998-327d-4f75-962a-05e5f95f3186 service nova] Lock "9f3a7f8a-e3b9-4918-9663-968677fe5c90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-69cc23e5-30db-47a6-9765-715af570547e req-43e8a998-327d-4f75-962a-05e5f95f3186 service nova] Lock "9f3a7f8a-e3b9-4918-9663-968677fe5c90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:12 user nova-compute[73056]: DEBUG nova.compute.manager [req-69cc23e5-30db-47a6-9765-715af570547e req-43e8a998-327d-4f75-962a-05e5f95f3186 service nova] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] No waiting events found dispatching network-vif-plugged-312bec25-d19f-423b-aca3-a4117119fc1f {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:36:12 user nova-compute[73056]: WARNING nova.compute.manager [req-69cc23e5-30db-47a6-9765-715af570547e req-43e8a998-327d-4f75-962a-05e5f95f3186 service nova] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Received unexpected event network-vif-plugged-312bec25-d19f-423b-aca3-a4117119fc1f for instance with vm_state active and task_state None.
Aug 14 16:36:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Acquiring lock "0fd5ba83-0612-4ce2-bd44-3ab55820022f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "0fd5ba83-0612-4ce2-bd44-3ab55820022f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:13 user nova-compute[73056]: DEBUG nova.compute.manager [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:36:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:14 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:36:14 user nova-compute[73056]: INFO nova.compute.claims [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Claim successful on node user
Aug 14 16:36:14 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:36:14 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:36:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.533s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:14 user nova-compute[73056]: DEBUG nova.compute.manager [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:36:14 user nova-compute[73056]: DEBUG nova.compute.manager [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:36:14 user nova-compute[73056]: DEBUG nova.network.neutron [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:36:14 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:36:14 user nova-compute[73056]: DEBUG nova.compute.manager [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:36:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:15 user nova-compute[73056]: DEBUG nova.compute.manager [req-c1f2a34b-9b04-471e-b753-28999b9aca97 req-2f986ec8-a61e-4ce0-a48b-c5be1160f485 service nova] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Received event network-vif-plugged-312bec25-d19f-423b-aca3-a4117119fc1f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:36:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c1f2a34b-9b04-471e-b753-28999b9aca97 req-2f986ec8-a61e-4ce0-a48b-c5be1160f485 service nova] Acquiring lock "9f3a7f8a-e3b9-4918-9663-968677fe5c90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c1f2a34b-9b04-471e-b753-28999b9aca97 req-2f986ec8-a61e-4ce0-a48b-c5be1160f485 service nova] Lock "9f3a7f8a-e3b9-4918-9663-968677fe5c90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c1f2a34b-9b04-471e-b753-28999b9aca97 req-2f986ec8-a61e-4ce0-a48b-c5be1160f485 service nova] Lock "9f3a7f8a-e3b9-4918-9663-968677fe5c90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:15 user nova-compute[73056]: DEBUG nova.compute.manager [req-c1f2a34b-9b04-471e-b753-28999b9aca97 req-2f986ec8-a61e-4ce0-a48b-c5be1160f485 service nova] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] No waiting events found dispatching network-vif-plugged-312bec25-d19f-423b-aca3-a4117119fc1f {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:36:15 user nova-compute[73056]: WARNING nova.compute.manager [req-c1f2a34b-9b04-471e-b753-28999b9aca97 req-2f986ec8-a61e-4ce0-a48b-c5be1160f485 service nova] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Received unexpected event network-vif-plugged-312bec25-d19f-423b-aca3-a4117119fc1f for instance with vm_state active and task_state None.
Aug 14 16:36:15 user nova-compute[73056]: DEBUG nova.compute.manager [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:36:15 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:36:15 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Creating image(s)
Aug 14 16:36:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Acquiring lock "/opt/stack/data/nova/instances/0fd5ba83-0612-4ce2-bd44-3ab55820022f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "/opt/stack/data/nova/instances/0fd5ba83-0612-4ce2-bd44-3ab55820022f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "/opt/stack/data/nova/instances/0fd5ba83-0612-4ce2-bd44-3ab55820022f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.046s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:15 user nova-compute[73056]: DEBUG nova.policy [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b76fb5a2ba84410584b31e9006c67f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf992869a24ad2b1d391e2baff2b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:36:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.248s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Acquiring lock "c889592ab94cd0b0ce896f27a2af0323771db234" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.270s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/0fd5ba83-0612-4ce2-bd44-3ab55820022f/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/0fd5ba83-0612-4ce2-bd44-3ab55820022f/disk 1073741824" returned: 0 in 0.076s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.354s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:16 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.327s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:16 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0fd5ba83-0612-4ce2-bd44-3ab55820022f/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 16:36:16 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5ba83-0612-4ce2-bd44-3ab55820022f/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:16 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5ba83-0612-4ce2-bd44-3ab55820022f/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:16 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Cannot resize image /opt/stack/data/nova/instances/0fd5ba83-0612-4ce2-bd44-3ab55820022f/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 16:36:16 user nova-compute[73056]: DEBUG nova.objects.instance [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lazy-loading 'migration_context' on Instance uuid 0fd5ba83-0612-4ce2-bd44-3ab55820022f {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:36:16 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 16:36:16 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Ensure instance console log exists: /opt/stack/data/nova/instances/0fd5ba83-0612-4ce2-bd44-3ab55820022f/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:36:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Acquiring lock "b990e37f-8611-430f-89b1-ae6aeed24b38" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Lock "b990e37f-8611-430f-89b1-ae6aeed24b38" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:16 user nova-compute[73056]: DEBUG nova.compute.manager [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:36:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:16 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:36:16 user nova-compute[73056]: INFO nova.compute.claims [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Claim successful on node user
Aug 14 16:36:17 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:36:17 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:36:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.447s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:17 user nova-compute[73056]: DEBUG nova.compute.manager [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:36:17 user nova-compute[73056]: DEBUG nova.network.neutron [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Successfully created port: 86a6c609-36e2-43e7-a675-670cdf35db58 {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:36:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:17 user nova-compute[73056]: DEBUG nova.compute.manager [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:36:17 user nova-compute[73056]: DEBUG nova.network.neutron [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:36:17 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 14 16:36:17 user nova-compute[73056]: DEBUG nova.compute.manager [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:36:17 user nova-compute[73056]: DEBUG nova.compute.manager [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:36:17 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:36:17 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Creating image(s)
Aug 14 16:36:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Acquiring lock "/opt/stack/data/nova/instances/b990e37f-8611-430f-89b1-ae6aeed24b38/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Lock "/opt/stack/data/nova/instances/b990e37f-8611-430f-89b1-ae6aeed24b38/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Lock "/opt/stack/data/nova/instances/b990e37f-8611-430f-89b1-ae6aeed24b38/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Acquiring lock "dd5774880873ec6b7e3cccda077c9d2494bee613" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Lock "dd5774880873ec6b7e3cccda077c9d2494bee613" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:17 user nova-compute[73056]: DEBUG nova.policy [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1a18eaacbc61402fbe681ff831089a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38887e3747844b33936f9b02b921c3d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:36:17 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd5774880873ec6b7e3cccda077c9d2494bee613.part --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd5774880873ec6b7e3cccda077c9d2494bee613.part --force-share --output=json" returned: 0 in 0.217s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:18 user nova-compute[73056]: DEBUG nova.virt.images [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] cf874659-9a84-4ee7-81ef-80e69b332ef7 was qcow2, converting to raw {{(pid=73056) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 16:36:18 user nova-compute[73056]: DEBUG nova.privsep.utils [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73056) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 16:36:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dd5774880873ec6b7e3cccda077c9d2494bee613.part /opt/stack/data/nova/instances/_base/dd5774880873ec6b7e3cccda077c9d2494bee613.converted {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dd5774880873ec6b7e3cccda077c9d2494bee613.part /opt/stack/data/nova/instances/_base/dd5774880873ec6b7e3cccda077c9d2494bee613.converted" returned: 0 in 0.394s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd5774880873ec6b7e3cccda077c9d2494bee613.converted --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:18 user nova-compute[73056]: DEBUG nova.network.neutron [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Successfully updated port: 86a6c609-36e2-43e7-a675-670cdf35db58 {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:36:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Acquiring lock "refresh_cache-0fd5ba83-0612-4ce2-bd44-3ab55820022f" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:36:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Acquired lock "refresh_cache-0fd5ba83-0612-4ce2-bd44-3ab55820022f" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:36:18 user nova-compute[73056]: DEBUG nova.network.neutron [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:36:18 user nova-compute[73056]: DEBUG nova.network.neutron [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:36:18 user nova-compute[73056]: DEBUG nova.compute.manager [req-a725108e-c0f9-4006-9e3a-db8ded2d0391 req-96e084f6-d23b-40c4-948a-2b88c81fd5c8 service nova] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Received event network-changed-86a6c609-36e2-43e7-a675-670cdf35db58 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:36:18 user nova-compute[73056]: DEBUG nova.compute.manager [req-a725108e-c0f9-4006-9e3a-db8ded2d0391 req-96e084f6-d23b-40c4-948a-2b88c81fd5c8 service nova] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Refreshing instance network info cache due to event network-changed-86a6c609-36e2-43e7-a675-670cdf35db58. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:36:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a725108e-c0f9-4006-9e3a-db8ded2d0391 req-96e084f6-d23b-40c4-948a-2b88c81fd5c8 service nova] Acquiring lock "refresh_cache-0fd5ba83-0612-4ce2-bd44-3ab55820022f" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:36:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd5774880873ec6b7e3cccda077c9d2494bee613.converted --force-share --output=json" returned: 0 in 0.221s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Lock "dd5774880873ec6b7e3cccda077c9d2494bee613" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.267s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd5774880873ec6b7e3cccda077c9d2494bee613 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd5774880873ec6b7e3cccda077c9d2494bee613 --force-share --output=json" returned: 0 in 0.195s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Acquiring lock "dd5774880873ec6b7e3cccda077c9d2494bee613" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Lock "dd5774880873ec6b7e3cccda077c9d2494bee613" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd5774880873ec6b7e3cccda077c9d2494bee613 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG nova.network.neutron [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Successfully created port: 56271c0a-c509-463b-88eb-05e97b76e470 {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG nova.network.neutron [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Updating instance_info_cache with network_info: [{"id": "86a6c609-36e2-43e7-a675-670cdf35db58", "address": "fa:16:3e:eb:73:c7", "network": {"id": "2b53e507-f50b-411d-bce8-8769fc50bc28", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-515017098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4bf992869a24ad2b1d391e2baff2b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a6c609-36", "ovs_interfaceid": "86a6c609-36e2-43e7-a675-670cdf35db58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd5774880873ec6b7e3cccda077c9d2494bee613 --force-share --output=json" returned: 0 in 0.216s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd5774880873ec6b7e3cccda077c9d2494bee613,backing_fmt=raw /opt/stack/data/nova/instances/b990e37f-8611-430f-89b1-ae6aeed24b38/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Releasing lock "refresh_cache-0fd5ba83-0612-4ce2-bd44-3ab55820022f" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG nova.compute.manager [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Instance network_info: |[{"id": "86a6c609-36e2-43e7-a675-670cdf35db58", "address": "fa:16:3e:eb:73:c7", "network": {"id": "2b53e507-f50b-411d-bce8-8769fc50bc28", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-515017098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4bf992869a24ad2b1d391e2baff2b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a6c609-36", "ovs_interfaceid": "86a6c609-36e2-43e7-a675-670cdf35db58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a725108e-c0f9-4006-9e3a-db8ded2d0391 req-96e084f6-d23b-40c4-948a-2b88c81fd5c8 service nova] Acquired lock "refresh_cache-0fd5ba83-0612-4ce2-bd44-3ab55820022f" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG nova.network.neutron [req-a725108e-c0f9-4006-9e3a-db8ded2d0391 req-96e084f6-d23b-40c4-948a-2b88c81fd5c8 service nova] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Refreshing network info cache for port 86a6c609-36e2-43e7-a675-670cdf35db58 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Start _get_guest_xml network_info=[{"id": "86a6c609-36e2-43e7-a675-670cdf35db58", "address": "fa:16:3e:eb:73:c7", "network": {"id": "2b53e507-f50b-411d-bce8-8769fc50bc28", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-515017098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4bf992869a24ad2b1d391e2baff2b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a6c609-36", "ovs_interfaceid": "86a6c609-36e2-43e7-a675-670cdf35db58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd5774880873ec6b7e3cccda077c9d2494bee613,backing_fmt=raw /opt/stack/data/nova/instances/b990e37f-8611-430f-89b1-ae6aeed24b38/disk 1073741824" returned: 0 in 0.076s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Lock "dd5774880873ec6b7e3cccda077c9d2494bee613" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.298s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd5774880873ec6b7e3cccda077c9d2494bee613 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:19 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:36:19 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:36:19 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:36:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-498074295',display_name='tempest-VolumesAdminNegativeTest-server-498074295',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-498074295',id=3,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/0vU3HnKRG9rpjc5H2uxQKlyyAwpIusoCgH/Y/hhnjCtdnXDZ3eXcSDOWAEMecoqCaXZDbNfjdCPjEcdr6ttmUXsXmC+M+alfpqkGA1bv+tU67mp4F+YXj6mZh84t5Kw==',key_name='tempest-keypair-170937755',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4bf992869a24ad2b1d391e2baff2b34',ramdisk_id='',reservation_id='r-c8z5r1xj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1902234353',owner_user_name='tempest-VolumesAdminNegativeTest-1902234353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:36:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b76fb5a2ba84410584b31e9006c67f37',uuid=0fd5ba83-0612-4ce2-bd44-3ab55820022f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86a6c609-36e2-43e7-a675-670cdf35db58", "address": "fa:16:3e:eb:73:c7", "network": {"id": "2b53e507-f50b-411d-bce8-8769fc50bc28", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-515017098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4bf992869a24ad2b1d391e2baff2b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a6c609-36", "ovs_interfaceid": "86a6c609-36e2-43e7-a675-670cdf35db58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Converting VIF {"id": "86a6c609-36e2-43e7-a675-670cdf35db58", "address": "fa:16:3e:eb:73:c7", "network": {"id": "2b53e507-f50b-411d-bce8-8769fc50bc28", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-515017098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4bf992869a24ad2b1d391e2baff2b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a6c609-36", "ovs_interfaceid": "86a6c609-36e2-43e7-a675-670cdf35db58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:73:c7,bridge_name='br-int',has_traffic_filtering=True,id=86a6c609-36e2-43e7-a675-670cdf35db58,network=Network(2b53e507-f50b-411d-bce8-8769fc50bc28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86a6c609-36') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG nova.objects.instance [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lazy-loading 'pci_devices' on Instance uuid 0fd5ba83-0612-4ce2-bd44-3ab55820022f {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:36:19 user nova-compute[73056]:   <uuid>0fd5ba83-0612-4ce2-bd44-3ab55820022f</uuid>
Aug 14 16:36:19 user nova-compute[73056]:   <name>instance-00000003</name>
Aug 14 16:36:19 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:36:19 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:36:19 user nova-compute[73056]:   <metadata>
Aug 14 16:36:19 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:36:19 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:36:19 user nova-compute[73056]:       <nova:name>tempest-VolumesAdminNegativeTest-server-498074295</nova:name>
Aug 14 16:36:19 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:36:19</nova:creationTime>
Aug 14 16:36:19 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:36:19 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:36:19 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:36:19 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:36:19 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:36:19 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:36:19 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:36:19 user nova-compute[73056]:       <nova:owner>
Aug 14 16:36:19 user nova-compute[73056]:         <nova:user uuid="b76fb5a2ba84410584b31e9006c67f37">tempest-VolumesAdminNegativeTest-1902234353-project-member</nova:user>
Aug 14 16:36:19 user nova-compute[73056]:         <nova:project uuid="a4bf992869a24ad2b1d391e2baff2b34">tempest-VolumesAdminNegativeTest-1902234353</nova:project>
Aug 14 16:36:19 user nova-compute[73056]:       </nova:owner>
Aug 14 16:36:19 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:36:19 user nova-compute[73056]:       <nova:ports>
Aug 14 16:36:19 user nova-compute[73056]:         <nova:port uuid="86a6c609-36e2-43e7-a675-670cdf35db58">
Aug 14 16:36:19 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 16:36:19 user nova-compute[73056]:         </nova:port>
Aug 14 16:36:19 user nova-compute[73056]:       </nova:ports>
Aug 14 16:36:19 user nova-compute[73056]:     </nova:instance>
Aug 14 16:36:19 user nova-compute[73056]:   </metadata>
Aug 14 16:36:19 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:36:19 user nova-compute[73056]:     <system>
Aug 14 16:36:19 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:36:19 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:36:19 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:36:19 user nova-compute[73056]:       <entry name="serial">0fd5ba83-0612-4ce2-bd44-3ab55820022f</entry>
Aug 14 16:36:19 user nova-compute[73056]:       <entry name="uuid">0fd5ba83-0612-4ce2-bd44-3ab55820022f</entry>
Aug 14 16:36:19 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:36:19 user nova-compute[73056]:     </system>
Aug 14 16:36:19 user nova-compute[73056]:   </sysinfo>
Aug 14 16:36:19 user nova-compute[73056]:   <os>
Aug 14 16:36:19 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:36:19 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:36:19 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:36:19 user nova-compute[73056]:   </os>
Aug 14 16:36:19 user nova-compute[73056]:   <features>
Aug 14 16:36:19 user nova-compute[73056]:     <acpi/>
Aug 14 16:36:19 user nova-compute[73056]:     <apic/>
Aug 14 16:36:19 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:36:19 user nova-compute[73056]:   </features>
Aug 14 16:36:19 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:36:19 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:36:19 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:36:19 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:36:19 user nova-compute[73056]:   </clock>
Aug 14 16:36:19 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:36:19 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:36:19 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:36:19 user nova-compute[73056]:   </cpu>
Aug 14 16:36:19 user nova-compute[73056]:   <devices>
Aug 14 16:36:19 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:36:19 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:36:19 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/0fd5ba83-0612-4ce2-bd44-3ab55820022f/disk"/>
Aug 14 16:36:19 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:36:19 user nova-compute[73056]:     </disk>
Aug 14 16:36:19 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:36:19 user nova-compute[73056]:       <mac address="fa:16:3e:eb:73:c7"/>
Aug 14 16:36:19 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:36:19 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:36:19 user nova-compute[73056]:       <target dev="tap86a6c609-36"/>
Aug 14 16:36:19 user nova-compute[73056]:     </interface>
Aug 14 16:36:19 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:36:19 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/0fd5ba83-0612-4ce2-bd44-3ab55820022f/console.log" append="off"/>
Aug 14 16:36:19 user nova-compute[73056]:     </serial>
Aug 14 16:36:19 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:36:19 user nova-compute[73056]:     <video>
Aug 14 16:36:19 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:36:19 user nova-compute[73056]:     </video>
Aug 14 16:36:19 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:36:19 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:36:19 user nova-compute[73056]:     </rng>
Aug 14 16:36:19 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:36:19 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:36:19 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:36:19 user nova-compute[73056]:     </memballoon>
Aug 14 16:36:19 user nova-compute[73056]:   </devices>
Aug 14 16:36:19 user nova-compute[73056]: </domain>
Aug 14 16:36:19 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:36:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-498074295',display_name='tempest-VolumesAdminNegativeTest-server-498074295',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-498074295',id=3,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/0vU3HnKRG9rpjc5H2uxQKlyyAwpIusoCgH/Y/hhnjCtdnXDZ3eXcSDOWAEMecoqCaXZDbNfjdCPjEcdr6ttmUXsXmC+M+alfpqkGA1bv+tU67mp4F+YXj6mZh84t5Kw==',key_name='tempest-keypair-170937755',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4bf992869a24ad2b1d391e2baff2b34',ramdisk_id='',reservation_id='r-c8z5r1xj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1902234353',owner_user_name='tempest-VolumesAdminNegativeTest-1902234353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:36:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b76fb5a2ba84410584b31e9006c67f37',uuid=0fd5ba83-0612-4ce2-bd44-3ab55820022f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86a6c609-36e2-43e7-a675-670cdf35db58", "address": "fa:16:3e:eb:73:c7", "network": {"id": "2b53e507-f50b-411d-bce8-8769fc50bc28", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-515017098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4bf992869a24ad2b1d391e2baff2b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a6c609-36", "ovs_interfaceid": "86a6c609-36e2-43e7-a675-670cdf35db58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Converting VIF {"id": "86a6c609-36e2-43e7-a675-670cdf35db58", "address": "fa:16:3e:eb:73:c7", "network": {"id": "2b53e507-f50b-411d-bce8-8769fc50bc28", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-515017098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4bf992869a24ad2b1d391e2baff2b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a6c609-36", "ovs_interfaceid": "86a6c609-36e2-43e7-a675-670cdf35db58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:73:c7,bridge_name='br-int',has_traffic_filtering=True,id=86a6c609-36e2-43e7-a675-670cdf35db58,network=Network(2b53e507-f50b-411d-bce8-8769fc50bc28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86a6c609-36') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG os_vif [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:73:c7,bridge_name='br-int',has_traffic_filtering=True,id=86a6c609-36e2-43e7-a675-670cdf35db58,network=Network(2b53e507-f50b-411d-bce8-8769fc50bc28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86a6c609-36') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86a6c609-36, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap86a6c609-36, col_values=(('external_ids', {'iface-id': '86a6c609-36e2-43e7-a675-670cdf35db58', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:73:c7', 'vm-uuid': '0fd5ba83-0612-4ce2-bd44-3ab55820022f'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:19 user nova-compute[73056]: INFO os_vif [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:73:c7,bridge_name='br-int',has_traffic_filtering=True,id=86a6c609-36e2-43e7-a675-670cdf35db58,network=Network(2b53e507-f50b-411d-bce8-8769fc50bc28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86a6c609-36')
Aug 14 16:36:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd5774880873ec6b7e3cccda077c9d2494bee613 --force-share --output=json" returned: 0 in 0.269s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b990e37f-8611-430f-89b1-ae6aeed24b38/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b990e37f-8611-430f-89b1-ae6aeed24b38/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Acquiring lock "3a013b1e-7fc9-4ad7-a023-95827e2a4228" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Lock "3a013b1e-7fc9-4ad7-a023-95827e2a4228" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG nova.compute.manager [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] No VIF found with MAC fa:16:3e:eb:73:c7, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b990e37f-8611-430f-89b1-ae6aeed24b38/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Cannot resize image /opt/stack/data/nova/instances/b990e37f-8611-430f-89b1-ae6aeed24b38/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG nova.objects.instance [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Lazy-loading 'migration_context' on Instance uuid b990e37f-8611-430f-89b1-ae6aeed24b38 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:36:19 user nova-compute[73056]: INFO nova.compute.claims [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Claim successful on node user
Aug 14 16:36:19 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Ensure instance console log exists: /opt/stack/data/nova/instances/b990e37f-8611-430f-89b1-ae6aeed24b38/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:20 user nova-compute[73056]: DEBUG nova.network.neutron [req-a725108e-c0f9-4006-9e3a-db8ded2d0391 req-96e084f6-d23b-40c4-948a-2b88c81fd5c8 service nova] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Updated VIF entry in instance network info cache for port 86a6c609-36e2-43e7-a675-670cdf35db58. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:36:20 user nova-compute[73056]: DEBUG nova.network.neutron [req-a725108e-c0f9-4006-9e3a-db8ded2d0391 req-96e084f6-d23b-40c4-948a-2b88c81fd5c8 service nova] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Updating instance_info_cache with network_info: [{"id": "86a6c609-36e2-43e7-a675-670cdf35db58", "address": "fa:16:3e:eb:73:c7", "network": {"id": "2b53e507-f50b-411d-bce8-8769fc50bc28", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-515017098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4bf992869a24ad2b1d391e2baff2b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a6c609-36", "ovs_interfaceid": "86a6c609-36e2-43e7-a675-670cdf35db58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:36:20 user nova-compute[73056]: DEBUG nova.network.neutron [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Successfully updated port: 56271c0a-c509-463b-88eb-05e97b76e470 {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:36:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a725108e-c0f9-4006-9e3a-db8ded2d0391 req-96e084f6-d23b-40c4-948a-2b88c81fd5c8 service nova] Releasing lock "refresh_cache-0fd5ba83-0612-4ce2-bd44-3ab55820022f" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:36:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Acquiring lock "refresh_cache-b990e37f-8611-430f-89b1-ae6aeed24b38" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:36:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Acquired lock "refresh_cache-b990e37f-8611-430f-89b1-ae6aeed24b38" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:36:20 user nova-compute[73056]: DEBUG nova.network.neutron [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:36:20 user nova-compute[73056]: DEBUG nova.compute.manager [req-f0e44f62-a73d-43fe-a53e-3f5da2177c99 req-a574b57b-1168-4e91-a6cf-713b65facb65 service nova] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Received event network-changed-56271c0a-c509-463b-88eb-05e97b76e470 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:36:20 user nova-compute[73056]: DEBUG nova.compute.manager [req-f0e44f62-a73d-43fe-a53e-3f5da2177c99 req-a574b57b-1168-4e91-a6cf-713b65facb65 service nova] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Refreshing instance network info cache due to event network-changed-56271c0a-c509-463b-88eb-05e97b76e470. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:36:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f0e44f62-a73d-43fe-a53e-3f5da2177c99 req-a574b57b-1168-4e91-a6cf-713b65facb65 service nova] Acquiring lock "refresh_cache-b990e37f-8611-430f-89b1-ae6aeed24b38" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:36:20 user nova-compute[73056]: DEBUG nova.network.neutron [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:36:20 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:36:20 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:36:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.527s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:20 user nova-compute[73056]: DEBUG nova.compute.manager [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:36:20 user nova-compute[73056]: DEBUG nova.compute.manager [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:36:20 user nova-compute[73056]: DEBUG nova.network.neutron [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:36:20 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:36:20 user nova-compute[73056]: DEBUG nova.compute.manager [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:36:20 user nova-compute[73056]: DEBUG nova.policy [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ab6fc2872964eb2b0059a09c0959db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea76956556248748abedf58955cf248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:36:20 user nova-compute[73056]: DEBUG nova.compute.manager [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:36:20 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:36:20 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Creating image(s)
Aug 14 16:36:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a013b1e-7fc9-4ad7-a023-95827e2a4228/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Lock "/opt/stack/data/nova/instances/3a013b1e-7fc9-4ad7-a023-95827e2a4228/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Lock "/opt/stack/data/nova/instances/3a013b1e-7fc9-4ad7-a023-95827e2a4228/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.205s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Acquiring lock "c889592ab94cd0b0ce896f27a2af0323771db234" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.250s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/3a013b1e-7fc9-4ad7-a023-95827e2a4228/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/3a013b1e-7fc9-4ad7-a023-95827e2a4228/disk 1073741824" returned: 0 in 0.100s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.356s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.245s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3a013b1e-7fc9-4ad7-a023-95827e2a4228/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a013b1e-7fc9-4ad7-a023-95827e2a4228/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG nova.network.neutron [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Successfully created port: fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a013b1e-7fc9-4ad7-a023-95827e2a4228/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Cannot resize image /opt/stack/data/nova/instances/3a013b1e-7fc9-4ad7-a023-95827e2a4228/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG nova.objects.instance [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Lazy-loading 'migration_context' on Instance uuid 3a013b1e-7fc9-4ad7-a023-95827e2a4228 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG nova.network.neutron [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Updating instance_info_cache with network_info: [{"id": "56271c0a-c509-463b-88eb-05e97b76e470", "address": "fa:16:3e:52:e6:55", "network": {"id": "0aca6007-75fe-4253-9996-634b8f099215", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1016531183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38887e3747844b33936f9b02b921c3d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56271c0a-c5", "ovs_interfaceid": "56271c0a-c509-463b-88eb-05e97b76e470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Ensure instance console log exists: /opt/stack/data/nova/instances/3a013b1e-7fc9-4ad7-a023-95827e2a4228/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Releasing lock "refresh_cache-b990e37f-8611-430f-89b1-ae6aeed24b38" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG nova.compute.manager [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Instance network_info: |[{"id": "56271c0a-c509-463b-88eb-05e97b76e470", "address": "fa:16:3e:52:e6:55", "network": {"id": "0aca6007-75fe-4253-9996-634b8f099215", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1016531183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38887e3747844b33936f9b02b921c3d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56271c0a-c5", "ovs_interfaceid": "56271c0a-c509-463b-88eb-05e97b76e470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f0e44f62-a73d-43fe-a53e-3f5da2177c99 req-a574b57b-1168-4e91-a6cf-713b65facb65 service nova] Acquired lock "refresh_cache-b990e37f-8611-430f-89b1-ae6aeed24b38" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG nova.network.neutron [req-f0e44f62-a73d-43fe-a53e-3f5da2177c99 req-a574b57b-1168-4e91-a6cf-713b65facb65 service nova] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Refreshing network info cache for port 56271c0a-c509-463b-88eb-05e97b76e470 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Start _get_guest_xml network_info=[{"id": "56271c0a-c509-463b-88eb-05e97b76e470", "address": "fa:16:3e:52:e6:55", "network": {"id": "0aca6007-75fe-4253-9996-634b8f099215", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1016531183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38887e3747844b33936f9b02b921c3d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56271c0a-c5", "ovs_interfaceid": "56271c0a-c509-463b-88eb-05e97b76e470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:36:08Z,direct_url=<?>,disk_format='qcow2',id=cf874659-9a84-4ee7-81ef-80e69b332ef7,min_disk=0,min_ram=0,name='',owner='4e34d396d35b48b4adad0e2dada67875',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:36:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'disk_bus': 'scsi', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/sda', 'encryption_secret_uuid': None, 'image_id': 'cf874659-9a84-4ee7-81ef-80e69b332ef7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:36:21 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:36:21 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:36:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:36:08Z,direct_url=<?>,disk_format='qcow2',id=cf874659-9a84-4ee7-81ef-80e69b332ef7,min_disk=0,min_ram=0,name='',owner='4e34d396d35b48b4adad0e2dada67875',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:36:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:36:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-813253946',display_name='tempest-AttachSCSIVolumeTestJSON-server-813253946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-813253946',id=4,image_ref='cf874659-9a84-4ee7-81ef-80e69b332ef7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEBPpP93nZ8Sgk6bPlP2IPg9GfXAicLSRf2Hru7i9HNqz/4nVRI19B8iL9AI2VYIqA+I2VlGMKPUF6KrA3yvgBK2LH30YKtXnAJYfBSi6OqDJc913PAHY4laEJRhn84J0Q==',key_name='tempest-keypair-729882717',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38887e3747844b33936f9b02b921c3d4',ramdisk_id='',reservation_id='r-hhkh1c9t',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf874659-9a84-4ee7-81ef-80e69b332ef7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1372218985',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1372218985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:36:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a18eaacbc61402fbe681ff831089a2f',uuid=b990e37f-8611-430f-89b1-ae6aeed24b38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56271c0a-c509-463b-88eb-05e97b76e470", "address": "fa:16:3e:52:e6:55", "network": {"id": "0aca6007-75fe-4253-9996-634b8f099215", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1016531183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38887e3747844b33936f9b02b921c3d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56271c0a-c5", "ovs_interfaceid": "56271c0a-c509-463b-88eb-05e97b76e470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Converting VIF {"id": "56271c0a-c509-463b-88eb-05e97b76e470", "address": "fa:16:3e:52:e6:55", "network": {"id": "0aca6007-75fe-4253-9996-634b8f099215", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1016531183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38887e3747844b33936f9b02b921c3d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56271c0a-c5", "ovs_interfaceid": "56271c0a-c509-463b-88eb-05e97b76e470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:e6:55,bridge_name='br-int',has_traffic_filtering=True,id=56271c0a-c509-463b-88eb-05e97b76e470,network=Network(0aca6007-75fe-4253-9996-634b8f099215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56271c0a-c5') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG nova.objects.instance [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Lazy-loading 'pci_devices' on Instance uuid b990e37f-8611-430f-89b1-ae6aeed24b38 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:36:21 user nova-compute[73056]:   <uuid>b990e37f-8611-430f-89b1-ae6aeed24b38</uuid>
Aug 14 16:36:21 user nova-compute[73056]:   <name>instance-00000004</name>
Aug 14 16:36:21 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:36:21 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:36:21 user nova-compute[73056]:   <metadata>
Aug 14 16:36:21 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:36:21 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:36:21 user nova-compute[73056]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-813253946</nova:name>
Aug 14 16:36:21 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:36:21</nova:creationTime>
Aug 14 16:36:21 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:36:21 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:36:21 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:36:21 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:36:21 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:36:21 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:36:21 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:36:21 user nova-compute[73056]:       <nova:owner>
Aug 14 16:36:21 user nova-compute[73056]:         <nova:user uuid="1a18eaacbc61402fbe681ff831089a2f">tempest-AttachSCSIVolumeTestJSON-1372218985-project-member</nova:user>
Aug 14 16:36:21 user nova-compute[73056]:         <nova:project uuid="38887e3747844b33936f9b02b921c3d4">tempest-AttachSCSIVolumeTestJSON-1372218985</nova:project>
Aug 14 16:36:21 user nova-compute[73056]:       </nova:owner>
Aug 14 16:36:21 user nova-compute[73056]:       <nova:root type="image" uuid="cf874659-9a84-4ee7-81ef-80e69b332ef7"/>
Aug 14 16:36:21 user nova-compute[73056]:       <nova:ports>
Aug 14 16:36:21 user nova-compute[73056]:         <nova:port uuid="56271c0a-c509-463b-88eb-05e97b76e470">
Aug 14 16:36:21 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 16:36:21 user nova-compute[73056]:         </nova:port>
Aug 14 16:36:21 user nova-compute[73056]:       </nova:ports>
Aug 14 16:36:21 user nova-compute[73056]:     </nova:instance>
Aug 14 16:36:21 user nova-compute[73056]:   </metadata>
Aug 14 16:36:21 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:36:21 user nova-compute[73056]:     <system>
Aug 14 16:36:21 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:36:21 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:36:21 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:36:21 user nova-compute[73056]:       <entry name="serial">b990e37f-8611-430f-89b1-ae6aeed24b38</entry>
Aug 14 16:36:21 user nova-compute[73056]:       <entry name="uuid">b990e37f-8611-430f-89b1-ae6aeed24b38</entry>
Aug 14 16:36:21 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:36:21 user nova-compute[73056]:     </system>
Aug 14 16:36:21 user nova-compute[73056]:   </sysinfo>
Aug 14 16:36:21 user nova-compute[73056]:   <os>
Aug 14 16:36:21 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:36:21 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:36:21 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:36:21 user nova-compute[73056]:   </os>
Aug 14 16:36:21 user nova-compute[73056]:   <features>
Aug 14 16:36:21 user nova-compute[73056]:     <acpi/>
Aug 14 16:36:21 user nova-compute[73056]:     <apic/>
Aug 14 16:36:21 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:36:21 user nova-compute[73056]:   </features>
Aug 14 16:36:21 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:36:21 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:36:21 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:36:21 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:36:21 user nova-compute[73056]:   </clock>
Aug 14 16:36:21 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:36:21 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:36:21 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:36:21 user nova-compute[73056]:   </cpu>
Aug 14 16:36:21 user nova-compute[73056]:   <devices>
Aug 14 16:36:21 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:36:21 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:36:21 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/b990e37f-8611-430f-89b1-ae6aeed24b38/disk"/>
Aug 14 16:36:21 user nova-compute[73056]:       <target dev="sda" bus="scsi"/>
Aug 14 16:36:21 user nova-compute[73056]:       <address type="drive" controller="0" unit="0"/>
Aug 14 16:36:21 user nova-compute[73056]:     </disk>
Aug 14 16:36:21 user nova-compute[73056]:     <disk type="file" device="cdrom">
Aug 14 16:36:21 user nova-compute[73056]:       <driver name="qemu" type="raw" cache="none"/>
Aug 14 16:36:21 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/b990e37f-8611-430f-89b1-ae6aeed24b38/disk.config"/>
Aug 14 16:36:21 user nova-compute[73056]:       <target dev="sdb" bus="scsi"/>
Aug 14 16:36:21 user nova-compute[73056]:       <address type="drive" controller="0" unit="1"/>
Aug 14 16:36:21 user nova-compute[73056]:     </disk>
Aug 14 16:36:21 user nova-compute[73056]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 14 16:36:21 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:36:21 user nova-compute[73056]:       <mac address="fa:16:3e:52:e6:55"/>
Aug 14 16:36:21 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:36:21 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:36:21 user nova-compute[73056]:       <target dev="tap56271c0a-c5"/>
Aug 14 16:36:21 user nova-compute[73056]:     </interface>
Aug 14 16:36:21 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:36:21 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/b990e37f-8611-430f-89b1-ae6aeed24b38/console.log" append="off"/>
Aug 14 16:36:21 user nova-compute[73056]:     </serial>
Aug 14 16:36:21 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:36:21 user nova-compute[73056]:     <video>
Aug 14 16:36:21 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:36:21 user nova-compute[73056]:     </video>
Aug 14 16:36:21 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:36:21 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:36:21 user nova-compute[73056]:     </rng>
Aug 14 16:36:21 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:36:21 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:36:21 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:36:21 user nova-compute[73056]:     </memballoon>
Aug 14 16:36:21 user nova-compute[73056]:   </devices>
Aug 14 16:36:21 user nova-compute[73056]: </domain>
Aug 14 16:36:21 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:36:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-813253946',display_name='tempest-AttachSCSIVolumeTestJSON-server-813253946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-813253946',id=4,image_ref='cf874659-9a84-4ee7-81ef-80e69b332ef7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEBPpP93nZ8Sgk6bPlP2IPg9GfXAicLSRf2Hru7i9HNqz/4nVRI19B8iL9AI2VYIqA+I2VlGMKPUF6KrA3yvgBK2LH30YKtXnAJYfBSi6OqDJc913PAHY4laEJRhn84J0Q==',key_name='tempest-keypair-729882717',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38887e3747844b33936f9b02b921c3d4',ramdisk_id='',reservation_id='r-hhkh1c9t',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf874659-9a84-4ee7-81ef-80e69b332ef7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1372218985',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1372218985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:36:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a18eaacbc61402fbe681ff831089a2f',uuid=b990e37f-8611-430f-89b1-ae6aeed24b38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56271c0a-c509-463b-88eb-05e97b76e470", "address": "fa:16:3e:52:e6:55", "network": {"id": "0aca6007-75fe-4253-9996-634b8f099215", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1016531183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38887e3747844b33936f9b02b921c3d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56271c0a-c5", "ovs_interfaceid": "56271c0a-c509-463b-88eb-05e97b76e470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Converting VIF {"id": "56271c0a-c509-463b-88eb-05e97b76e470", "address": "fa:16:3e:52:e6:55", "network": {"id": "0aca6007-75fe-4253-9996-634b8f099215", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1016531183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38887e3747844b33936f9b02b921c3d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56271c0a-c5", "ovs_interfaceid": "56271c0a-c509-463b-88eb-05e97b76e470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:e6:55,bridge_name='br-int',has_traffic_filtering=True,id=56271c0a-c509-463b-88eb-05e97b76e470,network=Network(0aca6007-75fe-4253-9996-634b8f099215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56271c0a-c5') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG os_vif [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:e6:55,bridge_name='br-int',has_traffic_filtering=True,id=56271c0a-c509-463b-88eb-05e97b76e470,network=Network(0aca6007-75fe-4253-9996-634b8f099215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56271c0a-c5') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56271c0a-c5, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap56271c0a-c5, col_values=(('external_ids', {'iface-id': '56271c0a-c509-463b-88eb-05e97b76e470', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:e6:55', 'vm-uuid': 'b990e37f-8611-430f-89b1-ae6aeed24b38'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:21 user nova-compute[73056]: INFO os_vif [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:e6:55,bridge_name='br-int',has_traffic_filtering=True,id=56271c0a-c509-463b-88eb-05e97b76e470,network=Network(0aca6007-75fe-4253-9996-634b8f099215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56271c0a-c5')
Aug 14 16:36:21 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:21 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:22 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:22 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:22 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] No BDM found with device name sda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:36:22 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:36:22 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] No VIF found with MAC fa:16:3e:52:e6:55, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:36:22 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Using config drive
Aug 14 16:36:22 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:22 user nova-compute[73056]: DEBUG nova.network.neutron [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Successfully updated port: fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:36:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Acquiring lock "refresh_cache-3a013b1e-7fc9-4ad7-a023-95827e2a4228" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:36:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Acquired lock "refresh_cache-3a013b1e-7fc9-4ad7-a023-95827e2a4228" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:36:22 user nova-compute[73056]: DEBUG nova.network.neutron [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:36:22 user nova-compute[73056]: DEBUG nova.network.neutron [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:36:22 user nova-compute[73056]: DEBUG nova.network.neutron [req-f0e44f62-a73d-43fe-a53e-3f5da2177c99 req-a574b57b-1168-4e91-a6cf-713b65facb65 service nova] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Updated VIF entry in instance network info cache for port 56271c0a-c509-463b-88eb-05e97b76e470. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:36:22 user nova-compute[73056]: DEBUG nova.network.neutron [req-f0e44f62-a73d-43fe-a53e-3f5da2177c99 req-a574b57b-1168-4e91-a6cf-713b65facb65 service nova] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Updating instance_info_cache with network_info: [{"id": "56271c0a-c509-463b-88eb-05e97b76e470", "address": "fa:16:3e:52:e6:55", "network": {"id": "0aca6007-75fe-4253-9996-634b8f099215", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1016531183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38887e3747844b33936f9b02b921c3d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56271c0a-c5", "ovs_interfaceid": "56271c0a-c509-463b-88eb-05e97b76e470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:36:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f0e44f62-a73d-43fe-a53e-3f5da2177c99 req-a574b57b-1168-4e91-a6cf-713b65facb65 service nova] Releasing lock "refresh_cache-b990e37f-8611-430f-89b1-ae6aeed24b38" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:36:22 user nova-compute[73056]: DEBUG nova.compute.manager [req-bd8000ec-8ba5-4578-9275-25139297dd14 req-be414298-2803-4408-8391-4b4c76339314 service nova] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Received event network-changed-fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:36:22 user nova-compute[73056]: DEBUG nova.compute.manager [req-bd8000ec-8ba5-4578-9275-25139297dd14 req-be414298-2803-4408-8391-4b4c76339314 service nova] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Refreshing instance network info cache due to event network-changed-fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:36:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-bd8000ec-8ba5-4578-9275-25139297dd14 req-be414298-2803-4408-8391-4b4c76339314 service nova] Acquiring lock "refresh_cache-3a013b1e-7fc9-4ad7-a023-95827e2a4228" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:36:22 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Creating config drive at /opt/stack/data/nova/instances/b990e37f-8611-430f-89b1-ae6aeed24b38/disk.config
Aug 14 16:36:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b990e37f-8611-430f-89b1-ae6aeed24b38/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpu0fenyhg {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b990e37f-8611-430f-89b1-ae6aeed24b38/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpu0fenyhg" returned: 0 in 0.068s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.network.neutron [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Updating instance_info_cache with network_info: [{"id": "fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd", "address": "fa:16:3e:88:c3:7f", "network": {"id": "4d2c0fab-5e0a-40dd-a124-3ceb55f395bf", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1914390784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ea76956556248748abedf58955cf248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe86f39-73", "ovs_interfaceid": "fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Releasing lock "refresh_cache-3a013b1e-7fc9-4ad7-a023-95827e2a4228" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.compute.manager [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Instance network_info: |[{"id": "fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd", "address": "fa:16:3e:88:c3:7f", "network": {"id": "4d2c0fab-5e0a-40dd-a124-3ceb55f395bf", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1914390784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ea76956556248748abedf58955cf248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe86f39-73", "ovs_interfaceid": "fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-bd8000ec-8ba5-4578-9275-25139297dd14 req-be414298-2803-4408-8391-4b4c76339314 service nova] Acquired lock "refresh_cache-3a013b1e-7fc9-4ad7-a023-95827e2a4228" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.network.neutron [req-bd8000ec-8ba5-4578-9275-25139297dd14 req-be414298-2803-4408-8391-4b4c76339314 service nova] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Refreshing network info cache for port fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Start _get_guest_xml network_info=[{"id": "fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd", "address": "fa:16:3e:88:c3:7f", "network": {"id": "4d2c0fab-5e0a-40dd-a124-3ceb55f395bf", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1914390784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ea76956556248748abedf58955cf248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe86f39-73", "ovs_interfaceid": "fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:36:23 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:36:23 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:36:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1710600714',display_name='tempest-VolumesAssistedSnapshotsTest-server-1710600714',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1710600714',id=5,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZcSqhzk1kqSRnaZZuziYCuXITAT6BbhK/ghNk/p+jMRpb4ejOBmpC8OJemJskt86tCSHqFNuUP5K4Xuo8gj0/I3zS+QgKFK2mjTT+kCdYm8Je2sqQ+amF5kvBmxouufQ==',key_name='tempest-keypair-68602083',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ea76956556248748abedf58955cf248',ramdisk_id='',reservation_id='r-94hhfcd7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-354409156',owner_user_name='tempest-VolumesAssistedSnapshotsTest-354409156-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:36:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ab6fc2872964eb2b0059a09c0959db2',uuid=3a013b1e-7fc9-4ad7-a023-95827e2a4228,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd", "address": "fa:16:3e:88:c3:7f", "network": {"id": "4d2c0fab-5e0a-40dd-a124-3ceb55f395bf", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1914390784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ea76956556248748abedf58955cf248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe86f39-73", "ovs_interfaceid": "fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Converting VIF {"id": "fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd", "address": "fa:16:3e:88:c3:7f", "network": {"id": "4d2c0fab-5e0a-40dd-a124-3ceb55f395bf", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1914390784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ea76956556248748abedf58955cf248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe86f39-73", "ovs_interfaceid": "fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:c3:7f,bridge_name='br-int',has_traffic_filtering=True,id=fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd,network=Network(4d2c0fab-5e0a-40dd-a124-3ceb55f395bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbe86f39-73') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.objects.instance [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a013b1e-7fc9-4ad7-a023-95827e2a4228 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:36:23 user nova-compute[73056]:   <uuid>3a013b1e-7fc9-4ad7-a023-95827e2a4228</uuid>
Aug 14 16:36:23 user nova-compute[73056]:   <name>instance-00000005</name>
Aug 14 16:36:23 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:36:23 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:36:23 user nova-compute[73056]:   <metadata>
Aug 14 16:36:23 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:36:23 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:36:23 user nova-compute[73056]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1710600714</nova:name>
Aug 14 16:36:23 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:36:23</nova:creationTime>
Aug 14 16:36:23 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:36:23 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:36:23 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:36:23 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:36:23 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:36:23 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:36:23 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:36:23 user nova-compute[73056]:       <nova:owner>
Aug 14 16:36:23 user nova-compute[73056]:         <nova:user uuid="8ab6fc2872964eb2b0059a09c0959db2">tempest-VolumesAssistedSnapshotsTest-354409156-project-member</nova:user>
Aug 14 16:36:23 user nova-compute[73056]:         <nova:project uuid="7ea76956556248748abedf58955cf248">tempest-VolumesAssistedSnapshotsTest-354409156</nova:project>
Aug 14 16:36:23 user nova-compute[73056]:       </nova:owner>
Aug 14 16:36:23 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:36:23 user nova-compute[73056]:       <nova:ports>
Aug 14 16:36:23 user nova-compute[73056]:         <nova:port uuid="fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd">
Aug 14 16:36:23 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 16:36:23 user nova-compute[73056]:         </nova:port>
Aug 14 16:36:23 user nova-compute[73056]:       </nova:ports>
Aug 14 16:36:23 user nova-compute[73056]:     </nova:instance>
Aug 14 16:36:23 user nova-compute[73056]:   </metadata>
Aug 14 16:36:23 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:36:23 user nova-compute[73056]:     <system>
Aug 14 16:36:23 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:36:23 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:36:23 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:36:23 user nova-compute[73056]:       <entry name="serial">3a013b1e-7fc9-4ad7-a023-95827e2a4228</entry>
Aug 14 16:36:23 user nova-compute[73056]:       <entry name="uuid">3a013b1e-7fc9-4ad7-a023-95827e2a4228</entry>
Aug 14 16:36:23 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:36:23 user nova-compute[73056]:     </system>
Aug 14 16:36:23 user nova-compute[73056]:   </sysinfo>
Aug 14 16:36:23 user nova-compute[73056]:   <os>
Aug 14 16:36:23 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:36:23 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:36:23 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:36:23 user nova-compute[73056]:   </os>
Aug 14 16:36:23 user nova-compute[73056]:   <features>
Aug 14 16:36:23 user nova-compute[73056]:     <acpi/>
Aug 14 16:36:23 user nova-compute[73056]:     <apic/>
Aug 14 16:36:23 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:36:23 user nova-compute[73056]:   </features>
Aug 14 16:36:23 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:36:23 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:36:23 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:36:23 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:36:23 user nova-compute[73056]:   </clock>
Aug 14 16:36:23 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:36:23 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:36:23 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:36:23 user nova-compute[73056]:   </cpu>
Aug 14 16:36:23 user nova-compute[73056]:   <devices>
Aug 14 16:36:23 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:36:23 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:36:23 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/3a013b1e-7fc9-4ad7-a023-95827e2a4228/disk"/>
Aug 14 16:36:23 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:36:23 user nova-compute[73056]:     </disk>
Aug 14 16:36:23 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:36:23 user nova-compute[73056]:       <mac address="fa:16:3e:88:c3:7f"/>
Aug 14 16:36:23 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:36:23 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:36:23 user nova-compute[73056]:       <target dev="tapfbe86f39-73"/>
Aug 14 16:36:23 user nova-compute[73056]:     </interface>
Aug 14 16:36:23 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:36:23 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/3a013b1e-7fc9-4ad7-a023-95827e2a4228/console.log" append="off"/>
Aug 14 16:36:23 user nova-compute[73056]:     </serial>
Aug 14 16:36:23 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:36:23 user nova-compute[73056]:     <video>
Aug 14 16:36:23 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:36:23 user nova-compute[73056]:     </video>
Aug 14 16:36:23 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:36:23 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:36:23 user nova-compute[73056]:     </rng>
Aug 14 16:36:23 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:36:23 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:36:23 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:36:23 user nova-compute[73056]:     </memballoon>
Aug 14 16:36:23 user nova-compute[73056]:   </devices>
Aug 14 16:36:23 user nova-compute[73056]: </domain>
Aug 14 16:36:23 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:36:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1710600714',display_name='tempest-VolumesAssistedSnapshotsTest-server-1710600714',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1710600714',id=5,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZcSqhzk1kqSRnaZZuziYCuXITAT6BbhK/ghNk/p+jMRpb4ejOBmpC8OJemJskt86tCSHqFNuUP5K4Xuo8gj0/I3zS+QgKFK2mjTT+kCdYm8Je2sqQ+amF5kvBmxouufQ==',key_name='tempest-keypair-68602083',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ea76956556248748abedf58955cf248',ramdisk_id='',reservation_id='r-94hhfcd7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-354409156',owner_user_name='tempest-VolumesAssistedSnapshotsTest-354409156-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:36:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ab6fc2872964eb2b0059a09c0959db2',uuid=3a013b1e-7fc9-4ad7-a023-95827e2a4228,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd", "address": "fa:16:3e:88:c3:7f", "network": {"id": "4d2c0fab-5e0a-40dd-a124-3ceb55f395bf", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1914390784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ea76956556248748abedf58955cf248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe86f39-73", "ovs_interfaceid": "fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Converting VIF {"id": "fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd", "address": "fa:16:3e:88:c3:7f", "network": {"id": "4d2c0fab-5e0a-40dd-a124-3ceb55f395bf", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1914390784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ea76956556248748abedf58955cf248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe86f39-73", "ovs_interfaceid": "fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:c3:7f,bridge_name='br-int',has_traffic_filtering=True,id=fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd,network=Network(4d2c0fab-5e0a-40dd-a124-3ceb55f395bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbe86f39-73') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG os_vif [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:c3:7f,bridge_name='br-int',has_traffic_filtering=True,id=fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd,network=Network(4d2c0fab-5e0a-40dd-a124-3ceb55f395bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbe86f39-73') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfbe86f39-73, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfbe86f39-73, col_values=(('external_ids', {'iface-id': 'fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:c3:7f', 'vm-uuid': '3a013b1e-7fc9-4ad7-a023-95827e2a4228'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:23 user nova-compute[73056]: INFO os_vif [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:c3:7f,bridge_name='br-int',has_traffic_filtering=True,id=fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd,network=Network(4d2c0fab-5e0a-40dd-a124-3ceb55f395bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbe86f39-73')
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] No VIF found with MAC fa:16:3e:88:c3:7f, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692030983.8023522, 0fd5ba83-0612-4ce2-bd44-3ab55820022f => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:36:23 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] VM Resumed (Lifecycle Event)
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.compute.manager [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:36:23 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Instance spawned successfully.
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:36:23 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692030983.807098, 0fd5ba83-0612-4ce2-bd44-3ab55820022f => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:36:23 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] VM Started (Lifecycle Event)
Aug 14 16:36:23 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:36:24 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:36:24 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:36:24 user nova-compute[73056]: INFO nova.compute.manager [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Took 8.92 seconds to spawn the instance on the hypervisor.
Aug 14 16:36:24 user nova-compute[73056]: DEBUG nova.compute.manager [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:36:24 user nova-compute[73056]: DEBUG nova.network.neutron [req-bd8000ec-8ba5-4578-9275-25139297dd14 req-be414298-2803-4408-8391-4b4c76339314 service nova] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Updated VIF entry in instance network info cache for port fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:36:24 user nova-compute[73056]: DEBUG nova.network.neutron [req-bd8000ec-8ba5-4578-9275-25139297dd14 req-be414298-2803-4408-8391-4b4c76339314 service nova] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Updating instance_info_cache with network_info: [{"id": "fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd", "address": "fa:16:3e:88:c3:7f", "network": {"id": "4d2c0fab-5e0a-40dd-a124-3ceb55f395bf", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1914390784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ea76956556248748abedf58955cf248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe86f39-73", "ovs_interfaceid": "fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:36:24 user nova-compute[73056]: INFO nova.compute.manager [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Took 10.19 seconds to build instance.
Aug 14 16:36:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-bd8000ec-8ba5-4578-9275-25139297dd14 req-be414298-2803-4408-8391-4b4c76339314 service nova] Releasing lock "refresh_cache-3a013b1e-7fc9-4ad7-a023-95827e2a4228" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:36:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-95062b4f-e742-4ab3-80a8-b22ba9faf346 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "0fd5ba83-0612-4ce2-bd44-3ab55820022f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.341s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Acquiring lock "9927d1d6-6e26-4408-b509-c96df5f314d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Lock "9927d1d6-6e26-4408-b509-c96df5f314d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:25 user nova-compute[73056]: DEBUG nova.compute.manager [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:36:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:25 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:36:25 user nova-compute[73056]: INFO nova.compute.claims [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Claim successful on node user
Aug 14 16:36:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:26 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:36:26 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:36:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.716s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:26 user nova-compute[73056]: DEBUG nova.compute.manager [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:36:26 user nova-compute[73056]: DEBUG nova.compute.manager [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:36:26 user nova-compute[73056]: DEBUG nova.network.neutron [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:36:26 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:36:26 user nova-compute[73056]: DEBUG nova.compute.manager [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:36:26 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:26 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:26 user nova-compute[73056]: DEBUG nova.policy [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05b6713fd6a7426a9cf2960272a30cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35b1eb775b143e19a9d2fa193d946b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:36:26 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:26 user nova-compute[73056]: DEBUG nova.compute.manager [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:36:26 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:36:26 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Creating image(s)
Aug 14 16:36:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Acquiring lock "/opt/stack/data/nova/instances/9927d1d6-6e26-4408-b509-c96df5f314d6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Lock "/opt/stack/data/nova/instances/9927d1d6-6e26-4408-b509-c96df5f314d6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Lock "/opt/stack/data/nova/instances/9927d1d6-6e26-4408-b509-c96df5f314d6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.234s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Acquiring lock "c889592ab94cd0b0ce896f27a2af0323771db234" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:27 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.230s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:27 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/9927d1d6-6e26-4408-b509-c96df5f314d6/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:27 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/9927d1d6-6e26-4408-b509-c96df5f314d6/disk 1073741824" returned: 0 in 0.072s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.311s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:27 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:27 user nova-compute[73056]: DEBUG nova.compute.manager [req-2891216a-763f-44e6-adbe-0aaff5b15344 req-91fb76c7-1005-42d5-876f-8ed46d138664 service nova] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Received event network-vif-plugged-6854da1e-a228-4a49-bdcb-19df7a6704ac {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:36:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2891216a-763f-44e6-adbe-0aaff5b15344 req-91fb76c7-1005-42d5-876f-8ed46d138664 service nova] Acquiring lock "6c9c38ee-426d-4dcf-8720-7ad5fad8492d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2891216a-763f-44e6-adbe-0aaff5b15344 req-91fb76c7-1005-42d5-876f-8ed46d138664 service nova] Lock "6c9c38ee-426d-4dcf-8720-7ad5fad8492d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2891216a-763f-44e6-adbe-0aaff5b15344 req-91fb76c7-1005-42d5-876f-8ed46d138664 service nova] Lock "6c9c38ee-426d-4dcf-8720-7ad5fad8492d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:27 user nova-compute[73056]: DEBUG nova.compute.manager [req-2891216a-763f-44e6-adbe-0aaff5b15344 req-91fb76c7-1005-42d5-876f-8ed46d138664 service nova] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] No waiting events found dispatching network-vif-plugged-6854da1e-a228-4a49-bdcb-19df7a6704ac {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:36:27 user nova-compute[73056]: WARNING nova.compute.manager [req-2891216a-763f-44e6-adbe-0aaff5b15344 req-91fb76c7-1005-42d5-876f-8ed46d138664 service nova] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Received unexpected event network-vif-plugged-6854da1e-a228-4a49-bdcb-19df7a6704ac for instance with vm_state active and task_state None.
Aug 14 16:36:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:27 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.220s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:27 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9927d1d6-6e26-4408-b509-c96df5f314d6/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 16:36:27 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9927d1d6-6e26-4408-b509-c96df5f314d6/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:27 user nova-compute[73056]: DEBUG nova.network.neutron [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Successfully created port: f706d56a-af89-4224-ad47-4fc43bbebbfb {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:36:27 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9927d1d6-6e26-4408-b509-c96df5f314d6/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:27 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Cannot resize image /opt/stack/data/nova/instances/9927d1d6-6e26-4408-b509-c96df5f314d6/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 16:36:27 user nova-compute[73056]: DEBUG nova.objects.instance [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Lazy-loading 'migration_context' on Instance uuid 9927d1d6-6e26-4408-b509-c96df5f314d6 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:36:27 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 16:36:27 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Ensure instance console log exists: /opt/stack/data/nova/instances/9927d1d6-6e26-4408-b509-c96df5f314d6/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:36:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:28 user nova-compute[73056]: DEBUG nova.network.neutron [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Successfully updated port: f706d56a-af89-4224-ad47-4fc43bbebbfb {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:36:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Acquiring lock "refresh_cache-9927d1d6-6e26-4408-b509-c96df5f314d6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:36:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Acquired lock "refresh_cache-9927d1d6-6e26-4408-b509-c96df5f314d6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:36:28 user nova-compute[73056]: DEBUG nova.network.neutron [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:36:28 user nova-compute[73056]: DEBUG nova.compute.manager [req-62645e5f-6ad3-4473-8de2-48266549668b req-e3969ced-bc62-414d-a2ea-98cc7ce16d9b service nova] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Received event network-changed-f706d56a-af89-4224-ad47-4fc43bbebbfb {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:36:28 user nova-compute[73056]: DEBUG nova.compute.manager [req-62645e5f-6ad3-4473-8de2-48266549668b req-e3969ced-bc62-414d-a2ea-98cc7ce16d9b service nova] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Refreshing instance network info cache due to event network-changed-f706d56a-af89-4224-ad47-4fc43bbebbfb. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:36:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-62645e5f-6ad3-4473-8de2-48266549668b req-e3969ced-bc62-414d-a2ea-98cc7ce16d9b service nova] Acquiring lock "refresh_cache-9927d1d6-6e26-4408-b509-c96df5f314d6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:36:28 user nova-compute[73056]: DEBUG nova.network.neutron [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:36:28 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692030988.8458865, b990e37f-8611-430f-89b1-ae6aeed24b38 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:36:28 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] VM Resumed (Lifecycle Event)
Aug 14 16:36:28 user nova-compute[73056]: DEBUG nova.compute.manager [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:36:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:36:28 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Instance spawned successfully.
Aug 14 16:36:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:36:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:36:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:36:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:36:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:36:28 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:36:28 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:36:28 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:36:28 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692030988.847903, b990e37f-8611-430f-89b1-ae6aeed24b38 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:36:28 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] VM Started (Lifecycle Event)
Aug 14 16:36:28 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:36:28 user nova-compute[73056]: DEBUG nova.network.neutron [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Updating instance_info_cache with network_info: [{"id": "f706d56a-af89-4224-ad47-4fc43bbebbfb", "address": "fa:16:3e:b2:34:a0", "network": {"id": "bf1db71c-8d0e-447f-bf4a-90a8bb7751e4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-592839111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b35b1eb775b143e19a9d2fa193d946b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf706d56a-af", "ovs_interfaceid": "f706d56a-af89-4224-ad47-4fc43bbebbfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:36:28 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:36:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Releasing lock "refresh_cache-9927d1d6-6e26-4408-b509-c96df5f314d6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:36:28 user nova-compute[73056]: DEBUG nova.compute.manager [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Instance network_info: |[{"id": "f706d56a-af89-4224-ad47-4fc43bbebbfb", "address": "fa:16:3e:b2:34:a0", "network": {"id": "bf1db71c-8d0e-447f-bf4a-90a8bb7751e4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-592839111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b35b1eb775b143e19a9d2fa193d946b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf706d56a-af", "ovs_interfaceid": "f706d56a-af89-4224-ad47-4fc43bbebbfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:36:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-62645e5f-6ad3-4473-8de2-48266549668b req-e3969ced-bc62-414d-a2ea-98cc7ce16d9b service nova] Acquired lock "refresh_cache-9927d1d6-6e26-4408-b509-c96df5f314d6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:36:28 user nova-compute[73056]: DEBUG nova.network.neutron [req-62645e5f-6ad3-4473-8de2-48266549668b req-e3969ced-bc62-414d-a2ea-98cc7ce16d9b service nova] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Refreshing network info cache for port f706d56a-af89-4224-ad47-4fc43bbebbfb {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:36:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Start _get_guest_xml network_info=[{"id": "f706d56a-af89-4224-ad47-4fc43bbebbfb", "address": "fa:16:3e:b2:34:a0", "network": {"id": "bf1db71c-8d0e-447f-bf4a-90a8bb7751e4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-592839111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b35b1eb775b143e19a9d2fa193d946b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf706d56a-af", "ovs_interfaceid": "f706d56a-af89-4224-ad47-4fc43bbebbfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:36:28 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:36:28 user nova-compute[73056]: INFO nova.compute.manager [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Took 11.52 seconds to spawn the instance on the hypervisor.
Aug 14 16:36:28 user nova-compute[73056]: DEBUG nova.compute.manager [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692030989.0149667, 3a013b1e-7fc9-4ad7-a023-95827e2a4228 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:36:29 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] VM Resumed (Lifecycle Event)
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.compute.manager [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:36:29 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:36:29 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:36:29 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Instance spawned successfully.
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:36:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-754208431',display_name='tempest-TestVolumeSwap-server-754208431',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-754208431',id=6,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBQX4Xd7SD2D6XANTCY7NSXMHZmL+GTjGneCvhm/fPXDzcd9BFU1gT/lJt8cmLBBK0q/H7Lorr6sntdIrk2gATSxa6mmtEMEoe9aPeeyRKQxEwRFbFSpsFrWMlUsnU6HQ==',key_name='tempest-keypair-1513784064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b35b1eb775b143e19a9d2fa193d946b9',ramdisk_id='',reservation_id='r-2qox5df2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1906153172',owner_user_name='tempest-TestVolumeSwap-1906153172-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:36:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05b6713fd6a7426a9cf2960272a30cd3',uuid=9927d1d6-6e26-4408-b509-c96df5f314d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f706d56a-af89-4224-ad47-4fc43bbebbfb", "address": "fa:16:3e:b2:34:a0", "network": {"id": "bf1db71c-8d0e-447f-bf4a-90a8bb7751e4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-592839111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b35b1eb775b143e19a9d2fa193d946b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf706d56a-af", "ovs_interfaceid": "f706d56a-af89-4224-ad47-4fc43bbebbfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Converting VIF {"id": "f706d56a-af89-4224-ad47-4fc43bbebbfb", "address": "fa:16:3e:b2:34:a0", "network": {"id": "bf1db71c-8d0e-447f-bf4a-90a8bb7751e4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-592839111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b35b1eb775b143e19a9d2fa193d946b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf706d56a-af", "ovs_interfaceid": "f706d56a-af89-4224-ad47-4fc43bbebbfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:34:a0,bridge_name='br-int',has_traffic_filtering=True,id=f706d56a-af89-4224-ad47-4fc43bbebbfb,network=Network(bf1db71c-8d0e-447f-bf4a-90a8bb7751e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf706d56a-af') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.objects.instance [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Lazy-loading 'pci_devices' on Instance uuid 9927d1d6-6e26-4408-b509-c96df5f314d6 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:36:29 user nova-compute[73056]:   <uuid>9927d1d6-6e26-4408-b509-c96df5f314d6</uuid>
Aug 14 16:36:29 user nova-compute[73056]:   <name>instance-00000006</name>
Aug 14 16:36:29 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:36:29 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:36:29 user nova-compute[73056]:   <metadata>
Aug 14 16:36:29 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:36:29 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:36:29 user nova-compute[73056]:       <nova:name>tempest-TestVolumeSwap-server-754208431</nova:name>
Aug 14 16:36:29 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:36:29</nova:creationTime>
Aug 14 16:36:29 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:36:29 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:36:29 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:36:29 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:36:29 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:36:29 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:36:29 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:36:29 user nova-compute[73056]:       <nova:owner>
Aug 14 16:36:29 user nova-compute[73056]:         <nova:user uuid="05b6713fd6a7426a9cf2960272a30cd3">tempest-TestVolumeSwap-1906153172-project-member</nova:user>
Aug 14 16:36:29 user nova-compute[73056]:         <nova:project uuid="b35b1eb775b143e19a9d2fa193d946b9">tempest-TestVolumeSwap-1906153172</nova:project>
Aug 14 16:36:29 user nova-compute[73056]:       </nova:owner>
Aug 14 16:36:29 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:36:29 user nova-compute[73056]:       <nova:ports>
Aug 14 16:36:29 user nova-compute[73056]:         <nova:port uuid="f706d56a-af89-4224-ad47-4fc43bbebbfb">
Aug 14 16:36:29 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 16:36:29 user nova-compute[73056]:         </nova:port>
Aug 14 16:36:29 user nova-compute[73056]:       </nova:ports>
Aug 14 16:36:29 user nova-compute[73056]:     </nova:instance>
Aug 14 16:36:29 user nova-compute[73056]:   </metadata>
Aug 14 16:36:29 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:36:29 user nova-compute[73056]:     <system>
Aug 14 16:36:29 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:36:29 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:36:29 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:36:29 user nova-compute[73056]:       <entry name="serial">9927d1d6-6e26-4408-b509-c96df5f314d6</entry>
Aug 14 16:36:29 user nova-compute[73056]:       <entry name="uuid">9927d1d6-6e26-4408-b509-c96df5f314d6</entry>
Aug 14 16:36:29 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:36:29 user nova-compute[73056]:     </system>
Aug 14 16:36:29 user nova-compute[73056]:   </sysinfo>
Aug 14 16:36:29 user nova-compute[73056]:   <os>
Aug 14 16:36:29 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:36:29 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:36:29 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:36:29 user nova-compute[73056]:   </os>
Aug 14 16:36:29 user nova-compute[73056]:   <features>
Aug 14 16:36:29 user nova-compute[73056]:     <acpi/>
Aug 14 16:36:29 user nova-compute[73056]:     <apic/>
Aug 14 16:36:29 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:36:29 user nova-compute[73056]:   </features>
Aug 14 16:36:29 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:36:29 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:36:29 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:36:29 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:36:29 user nova-compute[73056]:   </clock>
Aug 14 16:36:29 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:36:29 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:36:29 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:36:29 user nova-compute[73056]:   </cpu>
Aug 14 16:36:29 user nova-compute[73056]:   <devices>
Aug 14 16:36:29 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:36:29 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:36:29 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/9927d1d6-6e26-4408-b509-c96df5f314d6/disk"/>
Aug 14 16:36:29 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:36:29 user nova-compute[73056]:     </disk>
Aug 14 16:36:29 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:36:29 user nova-compute[73056]:       <mac address="fa:16:3e:b2:34:a0"/>
Aug 14 16:36:29 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:36:29 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:36:29 user nova-compute[73056]:       <target dev="tapf706d56a-af"/>
Aug 14 16:36:29 user nova-compute[73056]:     </interface>
Aug 14 16:36:29 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:36:29 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/9927d1d6-6e26-4408-b509-c96df5f314d6/console.log" append="off"/>
Aug 14 16:36:29 user nova-compute[73056]:     </serial>
Aug 14 16:36:29 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:36:29 user nova-compute[73056]:     <video>
Aug 14 16:36:29 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:36:29 user nova-compute[73056]:     </video>
Aug 14 16:36:29 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:36:29 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:36:29 user nova-compute[73056]:     </rng>
Aug 14 16:36:29 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:36:29 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:36:29 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:36:29 user nova-compute[73056]:     </memballoon>
Aug 14 16:36:29 user nova-compute[73056]:   </devices>
Aug 14 16:36:29 user nova-compute[73056]: </domain>
Aug 14 16:36:29 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:36:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-754208431',display_name='tempest-TestVolumeSwap-server-754208431',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-754208431',id=6,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBQX4Xd7SD2D6XANTCY7NSXMHZmL+GTjGneCvhm/fPXDzcd9BFU1gT/lJt8cmLBBK0q/H7Lorr6sntdIrk2gATSxa6mmtEMEoe9aPeeyRKQxEwRFbFSpsFrWMlUsnU6HQ==',key_name='tempest-keypair-1513784064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b35b1eb775b143e19a9d2fa193d946b9',ramdisk_id='',reservation_id='r-2qox5df2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1906153172',owner_user_name='tempest-TestVolumeSwap-1906153172-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:36:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05b6713fd6a7426a9cf2960272a30cd3',uuid=9927d1d6-6e26-4408-b509-c96df5f314d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f706d56a-af89-4224-ad47-4fc43bbebbfb", "address": "fa:16:3e:b2:34:a0", "network": {"id": "bf1db71c-8d0e-447f-bf4a-90a8bb7751e4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-592839111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b35b1eb775b143e19a9d2fa193d946b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf706d56a-af", "ovs_interfaceid": "f706d56a-af89-4224-ad47-4fc43bbebbfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Converting VIF {"id": "f706d56a-af89-4224-ad47-4fc43bbebbfb", "address": "fa:16:3e:b2:34:a0", "network": {"id": "bf1db71c-8d0e-447f-bf4a-90a8bb7751e4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-592839111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b35b1eb775b143e19a9d2fa193d946b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf706d56a-af", "ovs_interfaceid": "f706d56a-af89-4224-ad47-4fc43bbebbfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:34:a0,bridge_name='br-int',has_traffic_filtering=True,id=f706d56a-af89-4224-ad47-4fc43bbebbfb,network=Network(bf1db71c-8d0e-447f-bf4a-90a8bb7751e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf706d56a-af') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG os_vif [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:34:a0,bridge_name='br-int',has_traffic_filtering=True,id=f706d56a-af89-4224-ad47-4fc43bbebbfb,network=Network(bf1db71c-8d0e-447f-bf4a-90a8bb7751e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf706d56a-af') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:36:29 user nova-compute[73056]: INFO nova.compute.manager [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Took 12.46 seconds to build instance.
Aug 14 16:36:29 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf706d56a-af, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf706d56a-af, col_values=(('external_ids', {'iface-id': 'f706d56a-af89-4224-ad47-4fc43bbebbfb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:34:a0', 'vm-uuid': '9927d1d6-6e26-4408-b509-c96df5f314d6'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:29 user nova-compute[73056]: INFO os_vif [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:34:a0,bridge_name='br-int',has_traffic_filtering=True,id=f706d56a-af89-4224-ad47-4fc43bbebbfb,network=Network(bf1db71c-8d0e-447f-bf4a-90a8bb7751e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf706d56a-af')
Aug 14 16:36:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9b59bd8a-1b38-4fc7-aac5-7631c322320c tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Lock "b990e37f-8611-430f-89b1-ae6aeed24b38" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.648s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:29 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692030989.0163248, 3a013b1e-7fc9-4ad7-a023-95827e2a4228 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:36:29 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] VM Started (Lifecycle Event)
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] No VIF found with MAC fa:16:3e:b2:34:a0, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:36:29 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:36:29 user nova-compute[73056]: INFO nova.compute.manager [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Took 8.64 seconds to spawn the instance on the hypervisor.
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.compute.manager [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.compute.manager [req-6b42d7eb-dd97-4cf3-ab28-4365442bc12d req-bdf772b1-2a22-423f-93bf-edac1f2cb8ef service nova] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Received event network-vif-plugged-6854da1e-a228-4a49-bdcb-19df7a6704ac {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6b42d7eb-dd97-4cf3-ab28-4365442bc12d req-bdf772b1-2a22-423f-93bf-edac1f2cb8ef service nova] Acquiring lock "6c9c38ee-426d-4dcf-8720-7ad5fad8492d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6b42d7eb-dd97-4cf3-ab28-4365442bc12d req-bdf772b1-2a22-423f-93bf-edac1f2cb8ef service nova] Lock "6c9c38ee-426d-4dcf-8720-7ad5fad8492d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6b42d7eb-dd97-4cf3-ab28-4365442bc12d req-bdf772b1-2a22-423f-93bf-edac1f2cb8ef service nova] Lock "6c9c38ee-426d-4dcf-8720-7ad5fad8492d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.compute.manager [req-6b42d7eb-dd97-4cf3-ab28-4365442bc12d req-bdf772b1-2a22-423f-93bf-edac1f2cb8ef service nova] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] No waiting events found dispatching network-vif-plugged-6854da1e-a228-4a49-bdcb-19df7a6704ac {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:36:29 user nova-compute[73056]: WARNING nova.compute.manager [req-6b42d7eb-dd97-4cf3-ab28-4365442bc12d req-bdf772b1-2a22-423f-93bf-edac1f2cb8ef service nova] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Received unexpected event network-vif-plugged-6854da1e-a228-4a49-bdcb-19df7a6704ac for instance with vm_state active and task_state None.
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.compute.manager [req-6b42d7eb-dd97-4cf3-ab28-4365442bc12d req-bdf772b1-2a22-423f-93bf-edac1f2cb8ef service nova] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Received event network-vif-plugged-86a6c609-36e2-43e7-a675-670cdf35db58 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6b42d7eb-dd97-4cf3-ab28-4365442bc12d req-bdf772b1-2a22-423f-93bf-edac1f2cb8ef service nova] Acquiring lock "0fd5ba83-0612-4ce2-bd44-3ab55820022f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6b42d7eb-dd97-4cf3-ab28-4365442bc12d req-bdf772b1-2a22-423f-93bf-edac1f2cb8ef service nova] Lock "0fd5ba83-0612-4ce2-bd44-3ab55820022f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6b42d7eb-dd97-4cf3-ab28-4365442bc12d req-bdf772b1-2a22-423f-93bf-edac1f2cb8ef service nova] Lock "0fd5ba83-0612-4ce2-bd44-3ab55820022f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.compute.manager [req-6b42d7eb-dd97-4cf3-ab28-4365442bc12d req-bdf772b1-2a22-423f-93bf-edac1f2cb8ef service nova] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] No waiting events found dispatching network-vif-plugged-86a6c609-36e2-43e7-a675-670cdf35db58 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:36:29 user nova-compute[73056]: WARNING nova.compute.manager [req-6b42d7eb-dd97-4cf3-ab28-4365442bc12d req-bdf772b1-2a22-423f-93bf-edac1f2cb8ef service nova] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Received unexpected event network-vif-plugged-86a6c609-36e2-43e7-a675-670cdf35db58 for instance with vm_state active and task_state None.
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.compute.manager [req-6b42d7eb-dd97-4cf3-ab28-4365442bc12d req-bdf772b1-2a22-423f-93bf-edac1f2cb8ef service nova] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Received event network-vif-plugged-86a6c609-36e2-43e7-a675-670cdf35db58 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6b42d7eb-dd97-4cf3-ab28-4365442bc12d req-bdf772b1-2a22-423f-93bf-edac1f2cb8ef service nova] Acquiring lock "0fd5ba83-0612-4ce2-bd44-3ab55820022f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6b42d7eb-dd97-4cf3-ab28-4365442bc12d req-bdf772b1-2a22-423f-93bf-edac1f2cb8ef service nova] Lock "0fd5ba83-0612-4ce2-bd44-3ab55820022f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6b42d7eb-dd97-4cf3-ab28-4365442bc12d req-bdf772b1-2a22-423f-93bf-edac1f2cb8ef service nova] Lock "0fd5ba83-0612-4ce2-bd44-3ab55820022f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.compute.manager [req-6b42d7eb-dd97-4cf3-ab28-4365442bc12d req-bdf772b1-2a22-423f-93bf-edac1f2cb8ef service nova] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] No waiting events found dispatching network-vif-plugged-86a6c609-36e2-43e7-a675-670cdf35db58 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:36:29 user nova-compute[73056]: WARNING nova.compute.manager [req-6b42d7eb-dd97-4cf3-ab28-4365442bc12d req-bdf772b1-2a22-423f-93bf-edac1f2cb8ef service nova] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Received unexpected event network-vif-plugged-86a6c609-36e2-43e7-a675-670cdf35db58 for instance with vm_state active and task_state None.
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.compute.manager [req-6b42d7eb-dd97-4cf3-ab28-4365442bc12d req-bdf772b1-2a22-423f-93bf-edac1f2cb8ef service nova] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Received event network-vif-plugged-fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6b42d7eb-dd97-4cf3-ab28-4365442bc12d req-bdf772b1-2a22-423f-93bf-edac1f2cb8ef service nova] Acquiring lock "3a013b1e-7fc9-4ad7-a023-95827e2a4228-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6b42d7eb-dd97-4cf3-ab28-4365442bc12d req-bdf772b1-2a22-423f-93bf-edac1f2cb8ef service nova] Lock "3a013b1e-7fc9-4ad7-a023-95827e2a4228-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6b42d7eb-dd97-4cf3-ab28-4365442bc12d req-bdf772b1-2a22-423f-93bf-edac1f2cb8ef service nova] Lock "3a013b1e-7fc9-4ad7-a023-95827e2a4228-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.compute.manager [req-6b42d7eb-dd97-4cf3-ab28-4365442bc12d req-bdf772b1-2a22-423f-93bf-edac1f2cb8ef service nova] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] No waiting events found dispatching network-vif-plugged-fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:36:29 user nova-compute[73056]: WARNING nova.compute.manager [req-6b42d7eb-dd97-4cf3-ab28-4365442bc12d req-bdf772b1-2a22-423f-93bf-edac1f2cb8ef service nova] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Received unexpected event network-vif-plugged-fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd for instance with vm_state building and task_state spawning.
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.compute.manager [req-6b42d7eb-dd97-4cf3-ab28-4365442bc12d req-bdf772b1-2a22-423f-93bf-edac1f2cb8ef service nova] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Received event network-vif-plugged-fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6b42d7eb-dd97-4cf3-ab28-4365442bc12d req-bdf772b1-2a22-423f-93bf-edac1f2cb8ef service nova] Acquiring lock "3a013b1e-7fc9-4ad7-a023-95827e2a4228-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6b42d7eb-dd97-4cf3-ab28-4365442bc12d req-bdf772b1-2a22-423f-93bf-edac1f2cb8ef service nova] Lock "3a013b1e-7fc9-4ad7-a023-95827e2a4228-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6b42d7eb-dd97-4cf3-ab28-4365442bc12d req-bdf772b1-2a22-423f-93bf-edac1f2cb8ef service nova] Lock "3a013b1e-7fc9-4ad7-a023-95827e2a4228-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.compute.manager [req-6b42d7eb-dd97-4cf3-ab28-4365442bc12d req-bdf772b1-2a22-423f-93bf-edac1f2cb8ef service nova] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] No waiting events found dispatching network-vif-plugged-fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:36:29 user nova-compute[73056]: WARNING nova.compute.manager [req-6b42d7eb-dd97-4cf3-ab28-4365442bc12d req-bdf772b1-2a22-423f-93bf-edac1f2cb8ef service nova] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Received unexpected event network-vif-plugged-fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd for instance with vm_state building and task_state spawning.
Aug 14 16:36:29 user nova-compute[73056]: INFO nova.compute.manager [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Took 9.69 seconds to build instance.
Aug 14 16:36:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25c0c3d9-5a54-41d8-b8f2-6e394c98d6b1 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Lock "3a013b1e-7fc9-4ad7-a023-95827e2a4228" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.857s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.network.neutron [req-62645e5f-6ad3-4473-8de2-48266549668b req-e3969ced-bc62-414d-a2ea-98cc7ce16d9b service nova] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Updated VIF entry in instance network info cache for port f706d56a-af89-4224-ad47-4fc43bbebbfb. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG nova.network.neutron [req-62645e5f-6ad3-4473-8de2-48266549668b req-e3969ced-bc62-414d-a2ea-98cc7ce16d9b service nova] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Updating instance_info_cache with network_info: [{"id": "f706d56a-af89-4224-ad47-4fc43bbebbfb", "address": "fa:16:3e:b2:34:a0", "network": {"id": "bf1db71c-8d0e-447f-bf4a-90a8bb7751e4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-592839111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b35b1eb775b143e19a9d2fa193d946b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf706d56a-af", "ovs_interfaceid": "f706d56a-af89-4224-ad47-4fc43bbebbfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:36:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-62645e5f-6ad3-4473-8de2-48266549668b req-e3969ced-bc62-414d-a2ea-98cc7ce16d9b service nova] Releasing lock "refresh_cache-9927d1d6-6e26-4408-b509-c96df5f314d6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:36:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:31 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:31 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:31 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:31 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:33 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692030993.8298516, 9927d1d6-6e26-4408-b509-c96df5f314d6 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:36:33 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] VM Resumed (Lifecycle Event)
Aug 14 16:36:33 user nova-compute[73056]: DEBUG nova.compute.manager [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:36:33 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:36:33 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Instance spawned successfully.
Aug 14 16:36:33 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:36:33 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:36:33 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:36:33 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:36:34 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692030993.8332253, 9927d1d6-6e26-4408-b509-c96df5f314d6 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:36:34 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] VM Started (Lifecycle Event)
Aug 14 16:36:34 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:36:34 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:34 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:36:34 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:36:34 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:36:34 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:36:34 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:36:34 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:36:34 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:36:34 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:36:34 user nova-compute[73056]: INFO nova.compute.manager [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Took 7.78 seconds to spawn the instance on the hypervisor.
Aug 14 16:36:34 user nova-compute[73056]: DEBUG nova.compute.manager [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:36:34 user nova-compute[73056]: INFO nova.compute.manager [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Took 9.07 seconds to build instance.
Aug 14 16:36:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b2ac18cb-7765-4caf-b6f9-258e04fca7a2 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Lock "9927d1d6-6e26-4408-b509-c96df5f314d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.214s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:37 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:39 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:39 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:42 user nova-compute[73056]: DEBUG nova.compute.manager [req-962ea51c-bc29-4f8f-bf47-cbbc04795e16 req-31750a93-0402-43e1-93cd-9898f8cd6bc1 service nova] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Received event network-vif-plugged-56271c0a-c509-463b-88eb-05e97b76e470 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:36:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-962ea51c-bc29-4f8f-bf47-cbbc04795e16 req-31750a93-0402-43e1-93cd-9898f8cd6bc1 service nova] Acquiring lock "b990e37f-8611-430f-89b1-ae6aeed24b38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-962ea51c-bc29-4f8f-bf47-cbbc04795e16 req-31750a93-0402-43e1-93cd-9898f8cd6bc1 service nova] Lock "b990e37f-8611-430f-89b1-ae6aeed24b38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-962ea51c-bc29-4f8f-bf47-cbbc04795e16 req-31750a93-0402-43e1-93cd-9898f8cd6bc1 service nova] Lock "b990e37f-8611-430f-89b1-ae6aeed24b38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:42 user nova-compute[73056]: DEBUG nova.compute.manager [req-962ea51c-bc29-4f8f-bf47-cbbc04795e16 req-31750a93-0402-43e1-93cd-9898f8cd6bc1 service nova] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] No waiting events found dispatching network-vif-plugged-56271c0a-c509-463b-88eb-05e97b76e470 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:36:42 user nova-compute[73056]: WARNING nova.compute.manager [req-962ea51c-bc29-4f8f-bf47-cbbc04795e16 req-31750a93-0402-43e1-93cd-9898f8cd6bc1 service nova] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Received unexpected event network-vif-plugged-56271c0a-c509-463b-88eb-05e97b76e470 for instance with vm_state active and task_state None.
Aug 14 16:36:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Acquiring lock "a329b987-231e-47a8-9f2d-71c15573f9f0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lock "a329b987-231e-47a8-9f2d-71c15573f9f0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:42 user nova-compute[73056]: DEBUG nova.compute.manager [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:36:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:42 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:36:42 user nova-compute[73056]: INFO nova.compute.claims [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Claim successful on node user
Aug 14 16:36:43 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:36:43 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:36:43 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Cleaning up deleted instances {{(pid=73056) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 16:36:43 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:36:43 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] There are 0 instances to clean {{(pid=73056) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 16:36:43 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:36:43 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73056) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 16:36:43 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:36:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.541s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:43 user nova-compute[73056]: DEBUG nova.compute.manager [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:36:43 user nova-compute[73056]: DEBUG nova.compute.manager [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:36:43 user nova-compute[73056]: DEBUG nova.network.neutron [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:36:43 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:36:43 user nova-compute[73056]: DEBUG nova.compute.manager [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:36:43 user nova-compute[73056]: INFO nova.virt.block_device [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Booting with volume 663decc6-865c-4b8c-90f2-d6c4918e27d4 at /dev/vda
Aug 14 16:36:43 user nova-compute[73056]: DEBUG os_brick.utils [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:36:43 user nova-compute[73056]: INFO oslo.privsep.daemon [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp23__eftq/privsep.sock']
Aug 14 16:36:43 user nova-compute[73056]: DEBUG nova.policy [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'da42a829953a49519d1e52647597e48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858651f51ffd49a48f3e98e7de4d87e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:36:43 user sudo[83390]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp23__eftq/privsep.sock
Aug 14 16:36:43 user sudo[83390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 14 16:36:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:44 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:36:44 user nova-compute[73056]: DEBUG nova.compute.manager [req-72fe764a-e79b-4461-b6ec-645cdac4c295 req-c5dc95bb-d8fb-4685-8399-7cbd985ca8d0 service nova] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Received event network-vif-plugged-56271c0a-c509-463b-88eb-05e97b76e470 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:36:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-72fe764a-e79b-4461-b6ec-645cdac4c295 req-c5dc95bb-d8fb-4685-8399-7cbd985ca8d0 service nova] Acquiring lock "b990e37f-8611-430f-89b1-ae6aeed24b38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-72fe764a-e79b-4461-b6ec-645cdac4c295 req-c5dc95bb-d8fb-4685-8399-7cbd985ca8d0 service nova] Lock "b990e37f-8611-430f-89b1-ae6aeed24b38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-72fe764a-e79b-4461-b6ec-645cdac4c295 req-c5dc95bb-d8fb-4685-8399-7cbd985ca8d0 service nova] Lock "b990e37f-8611-430f-89b1-ae6aeed24b38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:44 user nova-compute[73056]: DEBUG nova.compute.manager [req-72fe764a-e79b-4461-b6ec-645cdac4c295 req-c5dc95bb-d8fb-4685-8399-7cbd985ca8d0 service nova] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] No waiting events found dispatching network-vif-plugged-56271c0a-c509-463b-88eb-05e97b76e470 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:36:44 user nova-compute[73056]: WARNING nova.compute.manager [req-72fe764a-e79b-4461-b6ec-645cdac4c295 req-c5dc95bb-d8fb-4685-8399-7cbd985ca8d0 service nova] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Received unexpected event network-vif-plugged-56271c0a-c509-463b-88eb-05e97b76e470 for instance with vm_state active and task_state None.
Aug 14 16:36:44 user nova-compute[73056]: DEBUG nova.compute.manager [req-72fe764a-e79b-4461-b6ec-645cdac4c295 req-c5dc95bb-d8fb-4685-8399-7cbd985ca8d0 service nova] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Received event network-vif-plugged-f706d56a-af89-4224-ad47-4fc43bbebbfb {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:36:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-72fe764a-e79b-4461-b6ec-645cdac4c295 req-c5dc95bb-d8fb-4685-8399-7cbd985ca8d0 service nova] Acquiring lock "9927d1d6-6e26-4408-b509-c96df5f314d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-72fe764a-e79b-4461-b6ec-645cdac4c295 req-c5dc95bb-d8fb-4685-8399-7cbd985ca8d0 service nova] Lock "9927d1d6-6e26-4408-b509-c96df5f314d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-72fe764a-e79b-4461-b6ec-645cdac4c295 req-c5dc95bb-d8fb-4685-8399-7cbd985ca8d0 service nova] Lock "9927d1d6-6e26-4408-b509-c96df5f314d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:44 user nova-compute[73056]: DEBUG nova.compute.manager [req-72fe764a-e79b-4461-b6ec-645cdac4c295 req-c5dc95bb-d8fb-4685-8399-7cbd985ca8d0 service nova] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] No waiting events found dispatching network-vif-plugged-f706d56a-af89-4224-ad47-4fc43bbebbfb {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:36:44 user nova-compute[73056]: WARNING nova.compute.manager [req-72fe764a-e79b-4461-b6ec-645cdac4c295 req-c5dc95bb-d8fb-4685-8399-7cbd985ca8d0 service nova] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Received unexpected event network-vif-plugged-f706d56a-af89-4224-ad47-4fc43bbebbfb for instance with vm_state active and task_state None.
Aug 14 16:36:44 user nova-compute[73056]: DEBUG nova.compute.manager [req-72fe764a-e79b-4461-b6ec-645cdac4c295 req-c5dc95bb-d8fb-4685-8399-7cbd985ca8d0 service nova] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Received event network-vif-plugged-f706d56a-af89-4224-ad47-4fc43bbebbfb {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:36:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-72fe764a-e79b-4461-b6ec-645cdac4c295 req-c5dc95bb-d8fb-4685-8399-7cbd985ca8d0 service nova] Acquiring lock "9927d1d6-6e26-4408-b509-c96df5f314d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-72fe764a-e79b-4461-b6ec-645cdac4c295 req-c5dc95bb-d8fb-4685-8399-7cbd985ca8d0 service nova] Lock "9927d1d6-6e26-4408-b509-c96df5f314d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-72fe764a-e79b-4461-b6ec-645cdac4c295 req-c5dc95bb-d8fb-4685-8399-7cbd985ca8d0 service nova] Lock "9927d1d6-6e26-4408-b509-c96df5f314d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:44 user nova-compute[73056]: DEBUG nova.compute.manager [req-72fe764a-e79b-4461-b6ec-645cdac4c295 req-c5dc95bb-d8fb-4685-8399-7cbd985ca8d0 service nova] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] No waiting events found dispatching network-vif-plugged-f706d56a-af89-4224-ad47-4fc43bbebbfb {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:36:44 user nova-compute[73056]: WARNING nova.compute.manager [req-72fe764a-e79b-4461-b6ec-645cdac4c295 req-c5dc95bb-d8fb-4685-8399-7cbd985ca8d0 service nova] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Received unexpected event network-vif-plugged-f706d56a-af89-4224-ad47-4fc43bbebbfb for instance with vm_state active and task_state None.
Aug 14 16:36:45 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:36:45 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 16:36:45 user nova-compute[73056]: DEBUG nova.network.neutron [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Successfully created port: 17d6adb4-b6f5-4c34-936d-35d1a4920106 {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:36:45 user sudo[83390]: pam_unix(sudo:session): session closed for user root
Aug 14 16:36:45 user nova-compute[73056]: INFO oslo.privsep.daemon [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Spawned new privsep daemon via rootwrap
Aug 14 16:36:45 user nova-compute[73056]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 14 16:36:45 user nova-compute[73056]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 14 16:36:45 user nova-compute[73056]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 14 16:36:45 user nova-compute[73056]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83519
Aug 14 16:36:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec5fc8c-44c6-492e-a543-9940be1046f8]: (2,) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:36:46 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:46 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:46 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f653f4-ab17-4cc2-ac5f-d59898c90c15]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:36:46 user nova-compute[73056]: WARNING os_brick.initiator.connectors.nvmeof [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 14 16:36:46 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:46 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:46 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d15cad-504a-446e-b7d4-eb6d7f59b793]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:36:46 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:46 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:46 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc58d080-f45f-45ff-af7d-c91768d424c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:36:46 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cbd988-60c9-489e-afa6-63a2644414ce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:36:46 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:46 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:36:46 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:36:46 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:46 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:36:46 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:36:46 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ba7091-b116-45ab-8198-d3b3a62a39f8]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:36:46 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:36:46 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:36:46 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:36:46 user nova-compute[73056]: DEBUG os_brick.utils [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] <== get_connector_properties: return (2515ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:36:46 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Updating existing volume attachment record: 5be6c15c-22d0-412a-b264-df782d6d087c {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 16:36:46 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:36:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:46 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 16:36:46 user nova-compute[73056]: DEBUG nova.network.neutron [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Successfully updated port: 17d6adb4-b6f5-4c34-936d-35d1a4920106 {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:36:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Acquiring lock "refresh_cache-a329b987-231e-47a8-9f2d-71c15573f9f0" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:36:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Acquired lock "refresh_cache-a329b987-231e-47a8-9f2d-71c15573f9f0" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:36:46 user nova-compute[73056]: DEBUG nova.network.neutron [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:36:46 user nova-compute[73056]: DEBUG nova.network.neutron [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:36:46 user nova-compute[73056]: DEBUG nova.compute.manager [req-127e4563-29e2-4656-b3bf-27002bb143bf req-521bac97-84ab-4ee4-90f1-ee049a4312c8 service nova] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Received event network-changed-17d6adb4-b6f5-4c34-936d-35d1a4920106 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:36:46 user nova-compute[73056]: DEBUG nova.compute.manager [req-127e4563-29e2-4656-b3bf-27002bb143bf req-521bac97-84ab-4ee4-90f1-ee049a4312c8 service nova] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Refreshing instance network info cache due to event network-changed-17d6adb4-b6f5-4c34-936d-35d1a4920106. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:36:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-127e4563-29e2-4656-b3bf-27002bb143bf req-521bac97-84ab-4ee4-90f1-ee049a4312c8 service nova] Acquiring lock "refresh_cache-a329b987-231e-47a8-9f2d-71c15573f9f0" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:36:46 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:46 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:46 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:46 user nova-compute[73056]: DEBUG nova.network.neutron [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Updating instance_info_cache with network_info: [{"id": "17d6adb4-b6f5-4c34-936d-35d1a4920106", "address": "fa:16:3e:b5:bf:bb", "network": {"id": "e6b5cbb1-4f9c-4d4e-9a5a-c6b9fb6f2c0a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-787940559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "858651f51ffd49a48f3e98e7de4d87e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d6adb4-b6", "ovs_interfaceid": "17d6adb4-b6f5-4c34-936d-35d1a4920106", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:36:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Releasing lock "refresh_cache-a329b987-231e-47a8-9f2d-71c15573f9f0" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:36:46 user nova-compute[73056]: DEBUG nova.compute.manager [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Instance network_info: |[{"id": "17d6adb4-b6f5-4c34-936d-35d1a4920106", "address": "fa:16:3e:b5:bf:bb", "network": {"id": "e6b5cbb1-4f9c-4d4e-9a5a-c6b9fb6f2c0a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-787940559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "858651f51ffd49a48f3e98e7de4d87e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d6adb4-b6", "ovs_interfaceid": "17d6adb4-b6f5-4c34-936d-35d1a4920106", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:36:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-127e4563-29e2-4656-b3bf-27002bb143bf req-521bac97-84ab-4ee4-90f1-ee049a4312c8 service nova] Acquired lock "refresh_cache-a329b987-231e-47a8-9f2d-71c15573f9f0" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:36:46 user nova-compute[73056]: DEBUG nova.network.neutron [req-127e4563-29e2-4656-b3bf-27002bb143bf req-521bac97-84ab-4ee4-90f1-ee049a4312c8 service nova] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Refreshing network info cache for port 17d6adb4-b6f5-4c34-936d-35d1a4920106 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:36:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5ba83-0612-4ce2-bd44-3ab55820022f/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5ba83-0612-4ce2-bd44-3ab55820022f/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5ba83-0612-4ce2-bd44-3ab55820022f/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:47 user nova-compute[73056]: DEBUG nova.network.neutron [req-127e4563-29e2-4656-b3bf-27002bb143bf req-521bac97-84ab-4ee4-90f1-ee049a4312c8 service nova] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Updated VIF entry in instance network info cache for port 17d6adb4-b6f5-4c34-936d-35d1a4920106. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:36:47 user nova-compute[73056]: DEBUG nova.network.neutron [req-127e4563-29e2-4656-b3bf-27002bb143bf req-521bac97-84ab-4ee4-90f1-ee049a4312c8 service nova] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Updating instance_info_cache with network_info: [{"id": "17d6adb4-b6f5-4c34-936d-35d1a4920106", "address": "fa:16:3e:b5:bf:bb", "network": {"id": "e6b5cbb1-4f9c-4d4e-9a5a-c6b9fb6f2c0a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-787940559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "858651f51ffd49a48f3e98e7de4d87e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d6adb4-b6", "ovs_interfaceid": "17d6adb4-b6f5-4c34-936d-35d1a4920106", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:36:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5ba83-0612-4ce2-bd44-3ab55820022f/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9c38ee-426d-4dcf-8720-7ad5fad8492d/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-127e4563-29e2-4656-b3bf-27002bb143bf req-521bac97-84ab-4ee4-90f1-ee049a4312c8 service nova] Releasing lock "refresh_cache-a329b987-231e-47a8-9f2d-71c15573f9f0" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:36:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9c38ee-426d-4dcf-8720-7ad5fad8492d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9c38ee-426d-4dcf-8720-7ad5fad8492d/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9c38ee-426d-4dcf-8720-7ad5fad8492d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a013b1e-7fc9-4ad7-a023-95827e2a4228/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a013b1e-7fc9-4ad7-a023-95827e2a4228/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a013b1e-7fc9-4ad7-a023-95827e2a4228/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a013b1e-7fc9-4ad7-a023-95827e2a4228/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9927d1d6-6e26-4408-b509-c96df5f314d6/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9927d1d6-6e26-4408-b509-c96df5f314d6/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9927d1d6-6e26-4408-b509-c96df5f314d6/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9927d1d6-6e26-4408-b509-c96df5f314d6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b990e37f-8611-430f-89b1-ae6aeed24b38/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b990e37f-8611-430f-89b1-ae6aeed24b38/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b990e37f-8611-430f-89b1-ae6aeed24b38/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b990e37f-8611-430f-89b1-ae6aeed24b38/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:49 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:36:49 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:36:49 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=7658MB free_disk=25.764114379882812GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 16:36:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:50 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 6c9c38ee-426d-4dcf-8720-7ad5fad8492d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:36:50 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 9f3a7f8a-e3b9-4918-9663-968677fe5c90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:36:50 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 0fd5ba83-0612-4ce2-bd44-3ab55820022f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:36:50 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance b990e37f-8611-430f-89b1-ae6aeed24b38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:36:50 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 3a013b1e-7fc9-4ad7-a023-95827e2a4228 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:36:50 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 9927d1d6-6e26-4408-b509-c96df5f314d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:36:50 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance a329b987-231e-47a8-9f2d-71c15573f9f0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:36:50 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 16:36:50 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 16:36:50 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:36:50 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:36:50 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 16:36:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.619s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:51 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:36:51 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:36:51 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 16:36:51 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Rebuilding the list of instances to heal {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 16:36:51 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Skipping network cache update for instance because it is Building. {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 14 16:36:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-6c9c38ee-426d-4dcf-8720-7ad5fad8492d" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:36:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-6c9c38ee-426d-4dcf-8720-7ad5fad8492d" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:36:51 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 16:36:51 user nova-compute[73056]: DEBUG nova.objects.instance [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lazy-loading 'info_cache' on Instance uuid 6c9c38ee-426d-4dcf-8720-7ad5fad8492d {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:36:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:52 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Updating instance_info_cache with network_info: [{"id": "6854da1e-a228-4a49-bdcb-19df7a6704ac", "address": "fa:16:3e:5d:3d:75", "network": {"id": "35512310-0629-426a-94a4-1d564653b88e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-997222200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfccc8baa174f63976b821e58cc189c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6854da1e-a2", "ovs_interfaceid": "6854da1e-a228-4a49-bdcb-19df7a6704ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:36:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-6c9c38ee-426d-4dcf-8720-7ad5fad8492d" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:36:52 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 16:36:52 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:36:52 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:36:52 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:36:52 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:36:54 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquiring lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:57 user nova-compute[73056]: DEBUG nova.compute.manager [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:36:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:57 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:36:57 user nova-compute[73056]: INFO nova.compute.claims [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Claim successful on node user
Aug 14 16:36:58 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Refreshing inventories for resource provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 16:36:58 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Updating ProviderTree inventory for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 16:36:58 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Updating inventory in ProviderTree for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 16:36:58 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Refreshing aggregate associations for resource provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b, aggregates: None {{(pid=73056) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 16:36:58 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Refreshing trait associations for resource provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=73056) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 16:36:58 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:36:58 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:36:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.657s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:58 user nova-compute[73056]: DEBUG nova.compute.manager [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:36:58 user nova-compute[73056]: DEBUG nova.compute.manager [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:36:58 user nova-compute[73056]: DEBUG nova.network.neutron [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:36:58 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:36:58 user nova-compute[73056]: DEBUG nova.compute.manager [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:36:58 user nova-compute[73056]: DEBUG nova.policy [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '78a1ab88047b4199bb611c0d7c8d6dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e6131531ab4553b55ea090d5e7f47d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:36:58 user nova-compute[73056]: DEBUG nova.compute.manager [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:36:58 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:36:58 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Creating image(s)
Aug 14 16:36:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquiring lock "/opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "/opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "/opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquiring lock "42e35594cd1db4c7dfc03dd6291c1035e6fb08b0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "42e35594cd1db4c7dfc03dd6291c1035e6fb08b0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.003s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42e35594cd1db4c7dfc03dd6291c1035e6fb08b0.part --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:36:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42e35594cd1db4c7dfc03dd6291c1035e6fb08b0.part --force-share --output=json" returned: 0 in 0.174s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:59 user nova-compute[73056]: DEBUG nova.virt.images [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] db2f8653-21f9-470f-aa59-8a25169ac11e was qcow2, converting to raw {{(pid=73056) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 16:36:59 user nova-compute[73056]: DEBUG nova.privsep.utils [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73056) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 16:36:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/42e35594cd1db4c7dfc03dd6291c1035e6fb08b0.part /opt/stack/data/nova/instances/_base/42e35594cd1db4c7dfc03dd6291c1035e6fb08b0.converted {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:59 user nova-compute[73056]: DEBUG nova.network.neutron [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Successfully created port: 1f7ab99b-ea66-43bf-91e2-da6938d28d2f {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:36:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/42e35594cd1db4c7dfc03dd6291c1035e6fb08b0.part /opt/stack/data/nova/instances/_base/42e35594cd1db4c7dfc03dd6291c1035e6fb08b0.converted" returned: 0 in 0.147s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42e35594cd1db4c7dfc03dd6291c1035e6fb08b0.converted --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42e35594cd1db4c7dfc03dd6291c1035e6fb08b0.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "42e35594cd1db4c7dfc03dd6291c1035e6fb08b0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.892s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:36:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42e35594cd1db4c7dfc03dd6291c1035e6fb08b0 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:36:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42e35594cd1db4c7dfc03dd6291c1035e6fb08b0 --force-share --output=json" returned: 0 in 0.188s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:36:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquiring lock "42e35594cd1db4c7dfc03dd6291c1035e6fb08b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:36:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "42e35594cd1db4c7dfc03dd6291c1035e6fb08b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:36:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42e35594cd1db4c7dfc03dd6291c1035e6fb08b0 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42e35594cd1db4c7dfc03dd6291c1035e6fb08b0 --force-share --output=json" returned: 0 in 0.227s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/42e35594cd1db4c7dfc03dd6291c1035e6fb08b0,backing_fmt=raw /opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/42e35594cd1db4c7dfc03dd6291c1035e6fb08b0,backing_fmt=raw /opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/disk 1073741824" returned: 0 in 0.052s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "42e35594cd1db4c7dfc03dd6291c1035e6fb08b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42e35594cd1db4c7dfc03dd6291c1035e6fb08b0 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42e35594cd1db4c7dfc03dd6291c1035e6fb08b0 --force-share --output=json" returned: 0 in 0.194s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:00 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 16:37:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:00 user nova-compute[73056]: DEBUG nova.network.neutron [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Successfully updated port: 1f7ab99b-ea66-43bf-91e2-da6938d28d2f {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:37:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:00 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Cannot resize image /opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 16:37:00 user nova-compute[73056]: DEBUG nova.objects.instance [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lazy-loading 'migration_context' on Instance uuid 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:37:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquiring lock "refresh_cache-9bb2cf77-cd65-49fd-a85b-d7961c2db3bf" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:37:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquired lock "refresh_cache-9bb2cf77-cd65-49fd-a85b-d7961c2db3bf" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:37:00 user nova-compute[73056]: DEBUG nova.network.neutron [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:37:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 16:37:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Ensure instance console log exists: /opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:37:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:37:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:37:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:00 user nova-compute[73056]: DEBUG nova.compute.manager [req-298ce1a1-900a-4766-9b32-e8d0ec746a79 req-27f01aef-fb6b-404a-a954-0b5169cfd290 service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Received event network-changed-1f7ab99b-ea66-43bf-91e2-da6938d28d2f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:37:00 user nova-compute[73056]: DEBUG nova.compute.manager [req-298ce1a1-900a-4766-9b32-e8d0ec746a79 req-27f01aef-fb6b-404a-a954-0b5169cfd290 service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Refreshing instance network info cache due to event network-changed-1f7ab99b-ea66-43bf-91e2-da6938d28d2f. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:37:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-298ce1a1-900a-4766-9b32-e8d0ec746a79 req-27f01aef-fb6b-404a-a954-0b5169cfd290 service nova] Acquiring lock "refresh_cache-9bb2cf77-cd65-49fd-a85b-d7961c2db3bf" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:37:00 user nova-compute[73056]: DEBUG nova.network.neutron [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG nova.network.neutron [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Updating instance_info_cache with network_info: [{"id": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "address": "fa:16:3e:8d:d8:88", "network": {"id": "dd844e8d-9264-4868-819d-0b01ad3b1d41", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-568480417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e6131531ab4553b55ea090d5e7f47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7ab99b-ea", "ovs_interfaceid": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Releasing lock "refresh_cache-9bb2cf77-cd65-49fd-a85b-d7961c2db3bf" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG nova.compute.manager [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Instance network_info: |[{"id": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "address": "fa:16:3e:8d:d8:88", "network": {"id": "dd844e8d-9264-4868-819d-0b01ad3b1d41", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-568480417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e6131531ab4553b55ea090d5e7f47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7ab99b-ea", "ovs_interfaceid": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-298ce1a1-900a-4766-9b32-e8d0ec746a79 req-27f01aef-fb6b-404a-a954-0b5169cfd290 service nova] Acquired lock "refresh_cache-9bb2cf77-cd65-49fd-a85b-d7961c2db3bf" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG nova.network.neutron [req-298ce1a1-900a-4766-9b32-e8d0ec746a79 req-27f01aef-fb6b-404a-a954-0b5169cfd290 service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Refreshing network info cache for port 1f7ab99b-ea66-43bf-91e2-da6938d28d2f {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Start _get_guest_xml network_info=[{"id": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "address": "fa:16:3e:8d:d8:88", "network": {"id": "dd844e8d-9264-4868-819d-0b01ad3b1d41", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-568480417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e6131531ab4553b55ea090d5e7f47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7ab99b-ea", "ovs_interfaceid": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:36:53Z,direct_url=<?>,disk_format='qcow2',id=db2f8653-21f9-470f-aa59-8a25169ac11e,min_disk=0,min_ram=0,name='tempest-scenario-img--484452849',owner='95e6131531ab4553b55ea090d5e7f47d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:36:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'db2f8653-21f9-470f-aa59-8a25169ac11e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:37:01 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:37:01 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:37:01 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:36:53Z,direct_url=<?>,disk_format='qcow2',id=db2f8653-21f9-470f-aa59-8a25169ac11e,min_disk=0,min_ram=0,name='tempest-scenario-img--484452849',owner='95e6131531ab4553b55ea090d5e7f47d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:36:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-364355732',display_name='tempest-TestMinimumBasicScenario-server-364355732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-364355732',id=8,image_ref='db2f8653-21f9-470f-aa59-8a25169ac11e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuQWFEsEgmiiXIvuQi3N5xOhs1P8YjYnRlzicPQUcOOw+2bb9wXe4RzvSbe0On1iDTJZMKYHX2WGcWfSPj8whHQVrmn2R8JQ6dGhqXQ/Yqt8WAGBvV80bIdSH+vTO7dOA==',key_name='tempest-TestMinimumBasicScenario-2085563484',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95e6131531ab4553b55ea090d5e7f47d',ramdisk_id='',reservation_id='r-3mcfhmfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='db2f8653-21f9-470f-aa59-8a25169ac11e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2039952053',owner_user_name='tempest-TestMinimumBasicScenario-2039952053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:36:59Z,user_data=None,user_id='78a1ab88047b4199bb611c0d7c8d6dee',uuid=9bb2cf77-cd65-49fd-a85b-d7961c2db3bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "address": "fa:16:3e:8d:d8:88", "network": {"id": "dd844e8d-9264-4868-819d-0b01ad3b1d41", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-568480417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e6131531ab4553b55ea090d5e7f47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7ab99b-ea", "ovs_interfaceid": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Converting VIF {"id": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "address": "fa:16:3e:8d:d8:88", "network": {"id": "dd844e8d-9264-4868-819d-0b01ad3b1d41", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-568480417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e6131531ab4553b55ea090d5e7f47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7ab99b-ea", "ovs_interfaceid": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:d8:88,bridge_name='br-int',has_traffic_filtering=True,id=1f7ab99b-ea66-43bf-91e2-da6938d28d2f,network=Network(dd844e8d-9264-4868-819d-0b01ad3b1d41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7ab99b-ea') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG nova.objects.instance [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lazy-loading 'pci_devices' on Instance uuid 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:37:01 user nova-compute[73056]:   <uuid>9bb2cf77-cd65-49fd-a85b-d7961c2db3bf</uuid>
Aug 14 16:37:01 user nova-compute[73056]:   <name>instance-00000008</name>
Aug 14 16:37:01 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:37:01 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:37:01 user nova-compute[73056]:   <metadata>
Aug 14 16:37:01 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:37:01 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:37:01 user nova-compute[73056]:       <nova:name>tempest-TestMinimumBasicScenario-server-364355732</nova:name>
Aug 14 16:37:01 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:37:01</nova:creationTime>
Aug 14 16:37:01 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:37:01 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:37:01 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:37:01 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:37:01 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:37:01 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:37:01 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:37:01 user nova-compute[73056]:       <nova:owner>
Aug 14 16:37:01 user nova-compute[73056]:         <nova:user uuid="78a1ab88047b4199bb611c0d7c8d6dee">tempest-TestMinimumBasicScenario-2039952053-project-member</nova:user>
Aug 14 16:37:01 user nova-compute[73056]:         <nova:project uuid="95e6131531ab4553b55ea090d5e7f47d">tempest-TestMinimumBasicScenario-2039952053</nova:project>
Aug 14 16:37:01 user nova-compute[73056]:       </nova:owner>
Aug 14 16:37:01 user nova-compute[73056]:       <nova:root type="image" uuid="db2f8653-21f9-470f-aa59-8a25169ac11e"/>
Aug 14 16:37:01 user nova-compute[73056]:       <nova:ports>
Aug 14 16:37:01 user nova-compute[73056]:         <nova:port uuid="1f7ab99b-ea66-43bf-91e2-da6938d28d2f">
Aug 14 16:37:01 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 16:37:01 user nova-compute[73056]:         </nova:port>
Aug 14 16:37:01 user nova-compute[73056]:       </nova:ports>
Aug 14 16:37:01 user nova-compute[73056]:     </nova:instance>
Aug 14 16:37:01 user nova-compute[73056]:   </metadata>
Aug 14 16:37:01 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:37:01 user nova-compute[73056]:     <system>
Aug 14 16:37:01 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:37:01 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:37:01 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:37:01 user nova-compute[73056]:       <entry name="serial">9bb2cf77-cd65-49fd-a85b-d7961c2db3bf</entry>
Aug 14 16:37:01 user nova-compute[73056]:       <entry name="uuid">9bb2cf77-cd65-49fd-a85b-d7961c2db3bf</entry>
Aug 14 16:37:01 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:37:01 user nova-compute[73056]:     </system>
Aug 14 16:37:01 user nova-compute[73056]:   </sysinfo>
Aug 14 16:37:01 user nova-compute[73056]:   <os>
Aug 14 16:37:01 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:37:01 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:37:01 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:37:01 user nova-compute[73056]:   </os>
Aug 14 16:37:01 user nova-compute[73056]:   <features>
Aug 14 16:37:01 user nova-compute[73056]:     <acpi/>
Aug 14 16:37:01 user nova-compute[73056]:     <apic/>
Aug 14 16:37:01 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:37:01 user nova-compute[73056]:   </features>
Aug 14 16:37:01 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:37:01 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:37:01 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:37:01 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:37:01 user nova-compute[73056]:   </clock>
Aug 14 16:37:01 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:37:01 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:37:01 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:37:01 user nova-compute[73056]:   </cpu>
Aug 14 16:37:01 user nova-compute[73056]:   <devices>
Aug 14 16:37:01 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:37:01 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:37:01 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/disk"/>
Aug 14 16:37:01 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:37:01 user nova-compute[73056]:     </disk>
Aug 14 16:37:01 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:37:01 user nova-compute[73056]:       <mac address="fa:16:3e:8d:d8:88"/>
Aug 14 16:37:01 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:37:01 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:37:01 user nova-compute[73056]:       <target dev="tap1f7ab99b-ea"/>
Aug 14 16:37:01 user nova-compute[73056]:     </interface>
Aug 14 16:37:01 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:37:01 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/console.log" append="off"/>
Aug 14 16:37:01 user nova-compute[73056]:     </serial>
Aug 14 16:37:01 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:37:01 user nova-compute[73056]:     <video>
Aug 14 16:37:01 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:37:01 user nova-compute[73056]:     </video>
Aug 14 16:37:01 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:37:01 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:37:01 user nova-compute[73056]:     </rng>
Aug 14 16:37:01 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:37:01 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:37:01 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:37:01 user nova-compute[73056]:     </memballoon>
Aug 14 16:37:01 user nova-compute[73056]:   </devices>
Aug 14 16:37:01 user nova-compute[73056]: </domain>
Aug 14 16:37:01 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:36:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-364355732',display_name='tempest-TestMinimumBasicScenario-server-364355732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-364355732',id=8,image_ref='db2f8653-21f9-470f-aa59-8a25169ac11e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuQWFEsEgmiiXIvuQi3N5xOhs1P8YjYnRlzicPQUcOOw+2bb9wXe4RzvSbe0On1iDTJZMKYHX2WGcWfSPj8whHQVrmn2R8JQ6dGhqXQ/Yqt8WAGBvV80bIdSH+vTO7dOA==',key_name='tempest-TestMinimumBasicScenario-2085563484',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95e6131531ab4553b55ea090d5e7f47d',ramdisk_id='',reservation_id='r-3mcfhmfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='db2f8653-21f9-470f-aa59-8a25169ac11e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2039952053',owner_user_name='tempest-TestMinimumBasicScenario-2039952053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:36:59Z,user_data=None,user_id='78a1ab88047b4199bb611c0d7c8d6dee',uuid=9bb2cf77-cd65-49fd-a85b-d7961c2db3bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "address": "fa:16:3e:8d:d8:88", "network": {"id": "dd844e8d-9264-4868-819d-0b01ad3b1d41", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-568480417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e6131531ab4553b55ea090d5e7f47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7ab99b-ea", "ovs_interfaceid": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Converting VIF {"id": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "address": "fa:16:3e:8d:d8:88", "network": {"id": "dd844e8d-9264-4868-819d-0b01ad3b1d41", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-568480417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e6131531ab4553b55ea090d5e7f47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7ab99b-ea", "ovs_interfaceid": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:d8:88,bridge_name='br-int',has_traffic_filtering=True,id=1f7ab99b-ea66-43bf-91e2-da6938d28d2f,network=Network(dd844e8d-9264-4868-819d-0b01ad3b1d41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7ab99b-ea') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG os_vif [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:d8:88,bridge_name='br-int',has_traffic_filtering=True,id=1f7ab99b-ea66-43bf-91e2-da6938d28d2f,network=Network(dd844e8d-9264-4868-819d-0b01ad3b1d41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7ab99b-ea') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f7ab99b-ea, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1f7ab99b-ea, col_values=(('external_ids', {'iface-id': '1f7ab99b-ea66-43bf-91e2-da6938d28d2f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:d8:88', 'vm-uuid': '9bb2cf77-cd65-49fd-a85b-d7961c2db3bf'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:01 user nova-compute[73056]: INFO os_vif [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:d8:88,bridge_name='br-int',has_traffic_filtering=True,id=1f7ab99b-ea66-43bf-91e2-da6938d28d2f,network=Network(dd844e8d-9264-4868-819d-0b01ad3b1d41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7ab99b-ea')
Aug 14 16:37:01 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] No VIF found with MAC fa:16:3e:8d:d8:88, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG nova.network.neutron [req-298ce1a1-900a-4766-9b32-e8d0ec746a79 req-27f01aef-fb6b-404a-a954-0b5169cfd290 service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Updated VIF entry in instance network info cache for port 1f7ab99b-ea66-43bf-91e2-da6938d28d2f. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG nova.network.neutron [req-298ce1a1-900a-4766-9b32-e8d0ec746a79 req-27f01aef-fb6b-404a-a954-0b5169cfd290 service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Updating instance_info_cache with network_info: [{"id": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "address": "fa:16:3e:8d:d8:88", "network": {"id": "dd844e8d-9264-4868-819d-0b01ad3b1d41", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-568480417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e6131531ab4553b55ea090d5e7f47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7ab99b-ea", "ovs_interfaceid": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:37:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-298ce1a1-900a-4766-9b32-e8d0ec746a79 req-27f01aef-fb6b-404a-a954-0b5169cfd290 service nova] Releasing lock "refresh_cache-9bb2cf77-cd65-49fd-a85b-d7961c2db3bf" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:37:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:02 user nova-compute[73056]: DEBUG nova.compute.manager [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:37:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:37:02 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Creating image(s)
Aug 14 16:37:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Did not create local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 16:37:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Ensure instance console log exists: /opt/stack/data/nova/instances/a329b987-231e-47a8-9f2d-71c15573f9f0/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:37:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:37:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:37:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Start _get_guest_xml network_info=[{"id": "17d6adb4-b6f5-4c34-936d-35d1a4920106", "address": "fa:16:3e:b5:bf:bb", "network": {"id": "e6b5cbb1-4f9c-4d4e-9a5a-c6b9fb6f2c0a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-787940559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "858651f51ffd49a48f3e98e7de4d87e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d6adb4-b6", "ovs_interfaceid": "17d6adb4-b6f5-4c34-936d-35d1a4920106", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mCfQgvrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a329b987-231e-47a8-9f2d-71c15573f9f0', 'attached_at': '', 'detached_at': '', 'volume_id': '663decc6-865c-4b8c-90f2-d6c4918e27d4', 'serial': '663decc6-865c-4b8c-90f2-d6c4918e27d4'}, 'attachment_id': '5be6c15c-22d0-412a-b264-df782d6d087c', 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:37:02 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:37:02 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:37:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:37:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:37:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:37:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:37:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:37:02 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:37:02 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:37:02 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:37:02 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:37:02 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:37:02 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:37:02 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:37:02 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:37:02 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:37:02 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:37:02 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:37:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:37:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:37:02 user nova-compute[73056]: DEBUG os_brick.initiator.connector [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Factory for ISCSI on None {{(pid=73056) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 14 16:37:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.013s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:37:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mCfQgvrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:37:02 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:37:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:37:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:37:02 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:37:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:37:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:37:02 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:37:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac96de8-dfd1-4823-ab80-316059750ed9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:37:03 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d8da0a-156a-445e-a5a8-161e79a2c7f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4] added
Aug 14 16:37:03 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[be869b09-c443-4499-b14d-1a030f968d89]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e21cf3-8fc9-4273-9001-eadfb59e8f2a]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mCfQgvrh {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mCfQgvrh" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[39164f64-ebe5-438f-bfb8-6e251131e1cf]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mCfQgvrh'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad88e14-8a01-4924-8638-5a892d6de7ab]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[73603341-011c-46fd-bddb-7d7dfd33ab52]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 16:37:03 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 16:37:03 user nova-compute[73056]:  {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:37:03 user nova-compute[73056]: WARNING os_brick.initiator.connectors.iscsi [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 16:37:03 user nova-compute[73056]: 
Aug 14 16:37:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc1412f-5c44-4af2-bb0a-b6f7044f7a09]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4, portal: 172.16.0.220,3260]
Aug 14 16:37:03 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4, portal: 172.16.0.220,3260] successful.
Aug 14 16:37:03 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9569f9-c216-4adb-a4ad-4ea4bf9dce9b]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d839f72d-392e-4e6f-bb1a-e254418d8e46]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:37:03 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:37:03 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e3084a-57de-481a-bbe3-1b5523702dcb]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mCfQgvrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:37:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '26436353862626335', 'path': '/dev/sdb'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:37:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436353862626335', 'path': '/dev/sdb'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:37:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:36:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-816611793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-816611793',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrF6zQFCvY9I3Tx9Li4l8oLTxmzYxKp1UXPWnmTcCEWQmNrSST0nsa4EPNdzwiM8Sv72y8YAykbLtymkPXgs3ARLo+xvw/dSjjcHO5qsCxzDKWOJT1CHZ5oKqFnSSvojQ==',key_name='tempest-keypair-1364462886',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='858651f51ffd49a48f3e98e7de4d87e3',ramdisk_id='',reservation_id='r-2hejxwxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-153336784',owner_user_name='tempest-ServerActionsV293TestJSON-153336784-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:36:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da42a829953a49519d1e52647597e48a',uuid=a329b987-231e-47a8-9f2d-71c15573f9f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17d6adb4-b6f5-4c34-936d-35d1a4920106", "address": "fa:16:3e:b5:bf:bb", "network": {"id": "e6b5cbb1-4f9c-4d4e-9a5a-c6b9fb6f2c0a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-787940559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "858651f51ffd49a48f3e98e7de4d87e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d6adb4-b6", "ovs_interfaceid": "17d6adb4-b6f5-4c34-936d-35d1a4920106", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:37:04 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Converting VIF {"id": "17d6adb4-b6f5-4c34-936d-35d1a4920106", "address": "fa:16:3e:b5:bf:bb", "network": {"id": "e6b5cbb1-4f9c-4d4e-9a5a-c6b9fb6f2c0a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-787940559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "858651f51ffd49a48f3e98e7de4d87e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d6adb4-b6", "ovs_interfaceid": "17d6adb4-b6f5-4c34-936d-35d1a4920106", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:37:04 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:bf:bb,bridge_name='br-int',has_traffic_filtering=True,id=17d6adb4-b6f5-4c34-936d-35d1a4920106,network=Network(e6b5cbb1-4f9c-4d4e-9a5a-c6b9fb6f2c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17d6adb4-b6') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:37:04 user nova-compute[73056]: DEBUG nova.objects.instance [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lazy-loading 'pci_devices' on Instance uuid a329b987-231e-47a8-9f2d-71c15573f9f0 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:37:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:37:04 user nova-compute[73056]:   <uuid>a329b987-231e-47a8-9f2d-71c15573f9f0</uuid>
Aug 14 16:37:04 user nova-compute[73056]:   <name>instance-00000007</name>
Aug 14 16:37:04 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:37:04 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:37:04 user nova-compute[73056]:   <metadata>
Aug 14 16:37:04 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:37:04 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:37:04 user nova-compute[73056]:       <nova:name>tempest-ServerActionsV293TestJSON-server-816611793</nova:name>
Aug 14 16:37:04 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:37:02</nova:creationTime>
Aug 14 16:37:04 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:37:04 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:37:04 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:37:04 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:37:04 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:37:04 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:37:04 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:37:04 user nova-compute[73056]:       <nova:owner>
Aug 14 16:37:04 user nova-compute[73056]:         <nova:user uuid="da42a829953a49519d1e52647597e48a">tempest-ServerActionsV293TestJSON-153336784-project-member</nova:user>
Aug 14 16:37:04 user nova-compute[73056]:         <nova:project uuid="858651f51ffd49a48f3e98e7de4d87e3">tempest-ServerActionsV293TestJSON-153336784</nova:project>
Aug 14 16:37:04 user nova-compute[73056]:       </nova:owner>
Aug 14 16:37:04 user nova-compute[73056]:       <nova:ports>
Aug 14 16:37:04 user nova-compute[73056]:         <nova:port uuid="17d6adb4-b6f5-4c34-936d-35d1a4920106">
Aug 14 16:37:04 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 14 16:37:04 user nova-compute[73056]:         </nova:port>
Aug 14 16:37:04 user nova-compute[73056]:       </nova:ports>
Aug 14 16:37:04 user nova-compute[73056]:     </nova:instance>
Aug 14 16:37:04 user nova-compute[73056]:   </metadata>
Aug 14 16:37:04 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:37:04 user nova-compute[73056]:     <system>
Aug 14 16:37:04 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:37:04 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:37:04 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:37:04 user nova-compute[73056]:       <entry name="serial">a329b987-231e-47a8-9f2d-71c15573f9f0</entry>
Aug 14 16:37:04 user nova-compute[73056]:       <entry name="uuid">a329b987-231e-47a8-9f2d-71c15573f9f0</entry>
Aug 14 16:37:04 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:37:04 user nova-compute[73056]:     </system>
Aug 14 16:37:04 user nova-compute[73056]:   </sysinfo>
Aug 14 16:37:04 user nova-compute[73056]:   <os>
Aug 14 16:37:04 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:37:04 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:37:04 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:37:04 user nova-compute[73056]:   </os>
Aug 14 16:37:04 user nova-compute[73056]:   <features>
Aug 14 16:37:04 user nova-compute[73056]:     <acpi/>
Aug 14 16:37:04 user nova-compute[73056]:     <apic/>
Aug 14 16:37:04 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:37:04 user nova-compute[73056]:   </features>
Aug 14 16:37:04 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:37:04 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:37:04 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:37:04 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:37:04 user nova-compute[73056]:   </clock>
Aug 14 16:37:04 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:37:04 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:37:04 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:37:04 user nova-compute[73056]:   </cpu>
Aug 14 16:37:04 user nova-compute[73056]:   <devices>
Aug 14 16:37:04 user nova-compute[73056]:     <disk type="block" device="disk">
Aug 14 16:37:04 user nova-compute[73056]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:37:04 user nova-compute[73056]:       <source dev="/dev/sdb"/>
Aug 14 16:37:04 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:37:04 user nova-compute[73056]:       <serial>663decc6-865c-4b8c-90f2-d6c4918e27d4</serial>
Aug 14 16:37:04 user nova-compute[73056]:     </disk>
Aug 14 16:37:04 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:37:04 user nova-compute[73056]:       <mac address="fa:16:3e:b5:bf:bb"/>
Aug 14 16:37:04 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:37:04 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:37:04 user nova-compute[73056]:       <target dev="tap17d6adb4-b6"/>
Aug 14 16:37:04 user nova-compute[73056]:     </interface>
Aug 14 16:37:04 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:37:04 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/a329b987-231e-47a8-9f2d-71c15573f9f0/console.log" append="off"/>
Aug 14 16:37:04 user nova-compute[73056]:     </serial>
Aug 14 16:37:04 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:37:04 user nova-compute[73056]:     <video>
Aug 14 16:37:04 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:37:04 user nova-compute[73056]:     </video>
Aug 14 16:37:04 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:37:04 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:37:04 user nova-compute[73056]:     </rng>
Aug 14 16:37:04 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:37:04 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:37:04 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:37:04 user nova-compute[73056]:     </memballoon>
Aug 14 16:37:04 user nova-compute[73056]:   </devices>
Aug 14 16:37:04 user nova-compute[73056]: </domain>
Aug 14 16:37:04 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:37:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:36:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-816611793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-816611793',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrF6zQFCvY9I3Tx9Li4l8oLTxmzYxKp1UXPWnmTcCEWQmNrSST0nsa4EPNdzwiM8Sv72y8YAykbLtymkPXgs3ARLo+xvw/dSjjcHO5qsCxzDKWOJT1CHZ5oKqFnSSvojQ==',key_name='tempest-keypair-1364462886',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='858651f51ffd49a48f3e98e7de4d87e3',ramdisk_id='',reservation_id='r-2hejxwxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-153336784',owner_user_name='tempest-ServerActionsV293TestJSON-153336784-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:36:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da42a829953a49519d1e52647597e48a',uuid=a329b987-231e-47a8-9f2d-71c15573f9f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17d6adb4-b6f5-4c34-936d-35d1a4920106", "address": "fa:16:3e:b5:bf:bb", "network": {"id": "e6b5cbb1-4f9c-4d4e-9a5a-c6b9fb6f2c0a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-787940559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "858651f51ffd49a48f3e98e7de4d87e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d6adb4-b6", "ovs_interfaceid": "17d6adb4-b6f5-4c34-936d-35d1a4920106", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:37:04 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Converting VIF {"id": "17d6adb4-b6f5-4c34-936d-35d1a4920106", "address": "fa:16:3e:b5:bf:bb", "network": {"id": "e6b5cbb1-4f9c-4d4e-9a5a-c6b9fb6f2c0a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-787940559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "858651f51ffd49a48f3e98e7de4d87e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d6adb4-b6", "ovs_interfaceid": "17d6adb4-b6f5-4c34-936d-35d1a4920106", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:37:04 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:bf:bb,bridge_name='br-int',has_traffic_filtering=True,id=17d6adb4-b6f5-4c34-936d-35d1a4920106,network=Network(e6b5cbb1-4f9c-4d4e-9a5a-c6b9fb6f2c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17d6adb4-b6') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:37:04 user nova-compute[73056]: DEBUG os_vif [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:bf:bb,bridge_name='br-int',has_traffic_filtering=True,id=17d6adb4-b6f5-4c34-936d-35d1a4920106,network=Network(e6b5cbb1-4f9c-4d4e-9a5a-c6b9fb6f2c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17d6adb4-b6') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:37:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:37:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:37:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap17d6adb4-b6, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:37:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap17d6adb4-b6, col_values=(('external_ids', {'iface-id': '17d6adb4-b6f5-4c34-936d-35d1a4920106', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:bf:bb', 'vm-uuid': 'a329b987-231e-47a8-9f2d-71c15573f9f0'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:37:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:37:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:04 user nova-compute[73056]: INFO os_vif [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:bf:bb,bridge_name='br-int',has_traffic_filtering=True,id=17d6adb4-b6f5-4c34-936d-35d1a4920106,network=Network(e6b5cbb1-4f9c-4d4e-9a5a-c6b9fb6f2c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17d6adb4-b6')
Aug 14 16:37:04 user nova-compute[73056]: DEBUG nova.compute.manager [req-a17fcbdf-8ba3-4d25-b51a-7c216627adf1 req-461687c2-ba6e-4c43-b55a-c40e5f54b4f3 service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Received event network-vif-plugged-1f7ab99b-ea66-43bf-91e2-da6938d28d2f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:37:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a17fcbdf-8ba3-4d25-b51a-7c216627adf1 req-461687c2-ba6e-4c43-b55a-c40e5f54b4f3 service nova] Acquiring lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:37:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a17fcbdf-8ba3-4d25-b51a-7c216627adf1 req-461687c2-ba6e-4c43-b55a-c40e5f54b4f3 service nova] Lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:37:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a17fcbdf-8ba3-4d25-b51a-7c216627adf1 req-461687c2-ba6e-4c43-b55a-c40e5f54b4f3 service nova] Lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:04 user nova-compute[73056]: DEBUG nova.compute.manager [req-a17fcbdf-8ba3-4d25-b51a-7c216627adf1 req-461687c2-ba6e-4c43-b55a-c40e5f54b4f3 service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] No waiting events found dispatching network-vif-plugged-1f7ab99b-ea66-43bf-91e2-da6938d28d2f {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:37:04 user nova-compute[73056]: WARNING nova.compute.manager [req-a17fcbdf-8ba3-4d25-b51a-7c216627adf1 req-461687c2-ba6e-4c43-b55a-c40e5f54b4f3 service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Received unexpected event network-vif-plugged-1f7ab99b-ea66-43bf-91e2-da6938d28d2f for instance with vm_state building and task_state spawning.
Aug 14 16:37:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:37:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] No VIF found with MAC fa:16:3e:b5:bf:bb, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:37:05 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031025.4836836, 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:37:05 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] VM Resumed (Lifecycle Event)
Aug 14 16:37:05 user nova-compute[73056]: DEBUG nova.compute.manager [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:37:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:37:05 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Instance spawned successfully.
Aug 14 16:37:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:37:05 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:37:05 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:37:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:37:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:37:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:37:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:37:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:37:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:37:05 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:37:05 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031025.4839668, 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:37:05 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] VM Started (Lifecycle Event)
Aug 14 16:37:05 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:37:05 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:37:05 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:37:05 user nova-compute[73056]: INFO nova.compute.manager [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Took 6.93 seconds to spawn the instance on the hypervisor.
Aug 14 16:37:05 user nova-compute[73056]: DEBUG nova.compute.manager [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:37:05 user nova-compute[73056]: INFO nova.compute.manager [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Took 8.11 seconds to build instance.
Aug 14 16:37:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bf447f8d-8a8a-4ad5-af6a-8f4a67c8b87f tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.225s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Acquiring lock "10d46e97-4721-49a0-beed-c022e9045b18" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:37:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Lock "10d46e97-4721-49a0-beed-c022e9045b18" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:37:05 user nova-compute[73056]: DEBUG nova.compute.manager [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:37:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:37:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:37:06 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:37:06 user nova-compute[73056]: INFO nova.compute.claims [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Claim successful on node user
Aug 14 16:37:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:06 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:37:06 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:37:06 user nova-compute[73056]: DEBUG nova.compute.manager [req-adef7c45-b61c-43dd-b539-d89220ed6aef req-5ba467f2-7642-4315-87b4-589839d55689 service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Received event network-vif-plugged-1f7ab99b-ea66-43bf-91e2-da6938d28d2f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:37:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-adef7c45-b61c-43dd-b539-d89220ed6aef req-5ba467f2-7642-4315-87b4-589839d55689 service nova] Acquiring lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:37:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-adef7c45-b61c-43dd-b539-d89220ed6aef req-5ba467f2-7642-4315-87b4-589839d55689 service nova] Lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:37:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-adef7c45-b61c-43dd-b539-d89220ed6aef req-5ba467f2-7642-4315-87b4-589839d55689 service nova] Lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:06 user nova-compute[73056]: DEBUG nova.compute.manager [req-adef7c45-b61c-43dd-b539-d89220ed6aef req-5ba467f2-7642-4315-87b4-589839d55689 service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] No waiting events found dispatching network-vif-plugged-1f7ab99b-ea66-43bf-91e2-da6938d28d2f {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:37:06 user nova-compute[73056]: WARNING nova.compute.manager [req-adef7c45-b61c-43dd-b539-d89220ed6aef req-5ba467f2-7642-4315-87b4-589839d55689 service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Received unexpected event network-vif-plugged-1f7ab99b-ea66-43bf-91e2-da6938d28d2f for instance with vm_state active and task_state None.
Aug 14 16:37:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.612s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:06 user nova-compute[73056]: DEBUG nova.compute.manager [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:37:06 user nova-compute[73056]: DEBUG nova.compute.manager [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:37:06 user nova-compute[73056]: DEBUG nova.network.neutron [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:37:06 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:37:06 user nova-compute[73056]: DEBUG nova.compute.manager [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:37:06 user nova-compute[73056]: INFO nova.virt.block_device [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Booting with volume 7667d00d-8180-4d28-a276-7ac9edddae18 at /dev/vda
Aug 14 16:37:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:06 user nova-compute[73056]: DEBUG os_brick.utils [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:37:06 user nova-compute[73056]: DEBUG nova.policy [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73371a938fc04253bcd7aaf2a86983ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '735e2905caf34b2fb25a17e674daca9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:37:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:06 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[020823f4-20c4-4697-84a6-a72e4487e7f3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:07 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f5feb8-8129-40e6-a1cb-698665f45ec2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:07 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea1181a-357f-42bd-a7ad-54442efbe023]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:07 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67e045a-43e8-49f9-b2c3-9f32a5dd6eee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:37:07 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:37:07 user nova-compute[73056]: DEBUG nova.compute.manager [req-7cd69d3e-295a-400e-a321-28c0fae8764c req-df50526c-d40c-4b2c-a303-dc0f95f07624 service nova] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Received event network-vif-plugged-17d6adb4-b6f5-4c34-936d-35d1a4920106 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:37:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-7cd69d3e-295a-400e-a321-28c0fae8764c req-df50526c-d40c-4b2c-a303-dc0f95f07624 service nova] Acquiring lock "a329b987-231e-47a8-9f2d-71c15573f9f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:37:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-7cd69d3e-295a-400e-a321-28c0fae8764c req-df50526c-d40c-4b2c-a303-dc0f95f07624 service nova] Lock "a329b987-231e-47a8-9f2d-71c15573f9f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:37:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-7cd69d3e-295a-400e-a321-28c0fae8764c req-df50526c-d40c-4b2c-a303-dc0f95f07624 service nova] Lock "a329b987-231e-47a8-9f2d-71c15573f9f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:07 user nova-compute[73056]: DEBUG nova.compute.manager [req-7cd69d3e-295a-400e-a321-28c0fae8764c req-df50526c-d40c-4b2c-a303-dc0f95f07624 service nova] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] No waiting events found dispatching network-vif-plugged-17d6adb4-b6f5-4c34-936d-35d1a4920106 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:37:07 user nova-compute[73056]: WARNING nova.compute.manager [req-7cd69d3e-295a-400e-a321-28c0fae8764c req-df50526c-d40c-4b2c-a303-dc0f95f07624 service nova] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Received unexpected event network-vif-plugged-17d6adb4-b6f5-4c34-936d-35d1a4920106 for instance with vm_state building and task_state spawning.
Aug 14 16:37:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:37:07 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:37:07 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[65319cd3-bccc-43fd-a164-1b4b8542686a]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:07 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:37:07 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:37:07 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:37:07 user nova-compute[73056]: DEBUG os_brick.utils [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:37:07 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Updating existing volume attachment record: f1b39bd0-a4e9-48bd-b165-ee8cd1edbbf0 {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 16:37:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:07 user nova-compute[73056]: DEBUG nova.network.neutron [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Successfully created port: 5240a3a2-cb9a-4df3-a1c1-0c4531c248ac {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:37:08 user nova-compute[73056]: DEBUG nova.network.neutron [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Successfully created port: 2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586 {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:37:08 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031028.7422254, a329b987-231e-47a8-9f2d-71c15573f9f0 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:37:08 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] VM Resumed (Lifecycle Event)
Aug 14 16:37:08 user nova-compute[73056]: DEBUG nova.compute.manager [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:37:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:37:08 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Instance spawned successfully.
Aug 14 16:37:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:37:08 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:37:08 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:37:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:37:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:37:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:37:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:37:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:37:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:37:08 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:37:08 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031028.7433321, a329b987-231e-47a8-9f2d-71c15573f9f0 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:37:08 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] VM Started (Lifecycle Event)
Aug 14 16:37:08 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:37:08 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:37:08 user nova-compute[73056]: INFO nova.compute.manager [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Took 6.05 seconds to spawn the instance on the hypervisor.
Aug 14 16:37:08 user nova-compute[73056]: DEBUG nova.compute.manager [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:37:08 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:37:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Acquiring lock "d15f23ae-f5a4-47cf-b136-7072c7838790" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:37:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:37:08 user nova-compute[73056]: DEBUG nova.compute.manager [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:37:09 user nova-compute[73056]: INFO nova.compute.manager [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Took 26.23 seconds to build instance.
Aug 14 16:37:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:37:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:37:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7239d0c8-1503-4dfa-8c9c-96566996114c tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lock "a329b987-231e-47a8-9f2d-71c15573f9f0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.389s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:09 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:37:09 user nova-compute[73056]: INFO nova.compute.claims [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Claim successful on node user
Aug 14 16:37:09 user nova-compute[73056]: DEBUG nova.compute.manager [req-9c06d83e-424f-4d99-a870-1c3b2c5c945d req-6846c48f-accc-4e29-ae81-ada76b178314 service nova] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Received event network-vif-plugged-17d6adb4-b6f5-4c34-936d-35d1a4920106 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:37:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9c06d83e-424f-4d99-a870-1c3b2c5c945d req-6846c48f-accc-4e29-ae81-ada76b178314 service nova] Acquiring lock "a329b987-231e-47a8-9f2d-71c15573f9f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:37:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9c06d83e-424f-4d99-a870-1c3b2c5c945d req-6846c48f-accc-4e29-ae81-ada76b178314 service nova] Lock "a329b987-231e-47a8-9f2d-71c15573f9f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:37:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9c06d83e-424f-4d99-a870-1c3b2c5c945d req-6846c48f-accc-4e29-ae81-ada76b178314 service nova] Lock "a329b987-231e-47a8-9f2d-71c15573f9f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:09 user nova-compute[73056]: DEBUG nova.compute.manager [req-9c06d83e-424f-4d99-a870-1c3b2c5c945d req-6846c48f-accc-4e29-ae81-ada76b178314 service nova] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] No waiting events found dispatching network-vif-plugged-17d6adb4-b6f5-4c34-936d-35d1a4920106 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:37:09 user nova-compute[73056]: WARNING nova.compute.manager [req-9c06d83e-424f-4d99-a870-1c3b2c5c945d req-6846c48f-accc-4e29-ae81-ada76b178314 service nova] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Received unexpected event network-vif-plugged-17d6adb4-b6f5-4c34-936d-35d1a4920106 for instance with vm_state active and task_state None.
Aug 14 16:37:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:09 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:37:09 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:37:09 user nova-compute[73056]: DEBUG nova.network.neutron [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Successfully created port: 087bb06e-10ff-4b89-81e2-59c05c7f658c {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:37:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.521s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:09 user nova-compute[73056]: DEBUG nova.compute.manager [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:37:09 user nova-compute[73056]: DEBUG nova.compute.manager [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:37:09 user nova-compute[73056]: DEBUG nova.network.neutron [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:37:09 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:37:09 user nova-compute[73056]: DEBUG nova.compute.manager [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:37:09 user nova-compute[73056]: INFO nova.virt.block_device [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Booting with volume 957e6707-8ee8-47f6-8191-969f2f44496f at /dev/vda
Aug 14 16:37:10 user nova-compute[73056]: DEBUG os_brick.utils [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:37:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:10 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a70684a-37bf-46bf-804f-9889728d6a21]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:10 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4bc5b7-ffbd-4f0d-9026-f834d051a6b3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:10 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b883c7a-2387-4729-af52-431473d2e0ca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:10 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2fa1e9-2bbc-4927-b01c-784ff237241b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:37:10 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:37:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:10 user nova-compute[73056]: DEBUG nova.policy [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a104c41b03dc4828a4dd3313763e77dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b973979ba4d4dfbb0a5088e9017ffa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:37:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:37:10 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:37:10 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[29db1dfc-65c8-475f-97cb-38b54d2c9ed3]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:10 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:37:10 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:37:10 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:37:10 user nova-compute[73056]: DEBUG os_brick.utils [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:37:10 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Updating existing volume attachment record: 0773c41e-77e2-4eeb-a60a-39ff55318d56 {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 16:37:10 user nova-compute[73056]: DEBUG nova.network.neutron [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Successfully created port: 16d756dd-e41f-42df-bdba-77a1aa465582 {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:37:11 user nova-compute[73056]: DEBUG nova.network.neutron [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Successfully created port: c81e86e3-8261-441f-b7b1-145aa7740e08 {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:37:11 user nova-compute[73056]: DEBUG nova.network.neutron [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Successfully created port: 50d5fcc4-f01a-4f51-81a3-47410ef0bbdc {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:37:11 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:11 user nova-compute[73056]: DEBUG nova.network.neutron [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Successfully created port: ea9bf8ed-60e0-4563-893c-33135ea49823 {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:37:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:12 user nova-compute[73056]: DEBUG nova.network.neutron [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Successfully created port: 9a54a741-25de-4758-921c-0b7e5c5730dd {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:37:12 user nova-compute[73056]: DEBUG nova.network.neutron [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Successfully updated port: 5240a3a2-cb9a-4df3-a1c1-0c4531c248ac {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:37:12 user nova-compute[73056]: DEBUG nova.compute.manager [req-16c3c8d5-ab91-4fab-8b01-eadb0d326bc1 req-95764e8c-49e7-4ce4-b773-df4a22ab0750 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-changed-5240a3a2-cb9a-4df3-a1c1-0c4531c248ac {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:37:12 user nova-compute[73056]: DEBUG nova.compute.manager [req-16c3c8d5-ab91-4fab-8b01-eadb0d326bc1 req-95764e8c-49e7-4ce4-b773-df4a22ab0750 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Refreshing instance network info cache due to event network-changed-5240a3a2-cb9a-4df3-a1c1-0c4531c248ac. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:37:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-16c3c8d5-ab91-4fab-8b01-eadb0d326bc1 req-95764e8c-49e7-4ce4-b773-df4a22ab0750 service nova] Acquiring lock "refresh_cache-10d46e97-4721-49a0-beed-c022e9045b18" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:37:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-16c3c8d5-ab91-4fab-8b01-eadb0d326bc1 req-95764e8c-49e7-4ce4-b773-df4a22ab0750 service nova] Acquired lock "refresh_cache-10d46e97-4721-49a0-beed-c022e9045b18" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:37:12 user nova-compute[73056]: DEBUG nova.network.neutron [req-16c3c8d5-ab91-4fab-8b01-eadb0d326bc1 req-95764e8c-49e7-4ce4-b773-df4a22ab0750 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Refreshing network info cache for port 5240a3a2-cb9a-4df3-a1c1-0c4531c248ac {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:37:12 user nova-compute[73056]: DEBUG nova.network.neutron [req-16c3c8d5-ab91-4fab-8b01-eadb0d326bc1 req-95764e8c-49e7-4ce4-b773-df4a22ab0750 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:37:13 user nova-compute[73056]: DEBUG nova.network.neutron [req-16c3c8d5-ab91-4fab-8b01-eadb0d326bc1 req-95764e8c-49e7-4ce4-b773-df4a22ab0750 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:37:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-16c3c8d5-ab91-4fab-8b01-eadb0d326bc1 req-95764e8c-49e7-4ce4-b773-df4a22ab0750 service nova] Releasing lock "refresh_cache-10d46e97-4721-49a0-beed-c022e9045b18" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:37:14 user nova-compute[73056]: DEBUG nova.network.neutron [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Successfully created port: 4e2daf22-7953-47ca-b2c6-98a1f0b00b72 {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:37:14 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:14 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:14 user nova-compute[73056]: DEBUG nova.network.neutron [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Successfully updated port: 7fd29069-06c5-41f5-b52c-64fd01fcff42 {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:37:14 user nova-compute[73056]: DEBUG nova.network.neutron [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Successfully created port: ee13669b-f42c-4ca6-84e9-c95e35048ffc {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:37:14 user nova-compute[73056]: DEBUG nova.compute.manager [req-23a498c9-178a-4004-a367-dd5ef94a6588 req-a8d24a08-56d8-40c2-85f1-b4d71a3098b3 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-changed-7fd29069-06c5-41f5-b52c-64fd01fcff42 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:37:14 user nova-compute[73056]: DEBUG nova.compute.manager [req-23a498c9-178a-4004-a367-dd5ef94a6588 req-a8d24a08-56d8-40c2-85f1-b4d71a3098b3 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Refreshing instance network info cache due to event network-changed-7fd29069-06c5-41f5-b52c-64fd01fcff42. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:37:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-23a498c9-178a-4004-a367-dd5ef94a6588 req-a8d24a08-56d8-40c2-85f1-b4d71a3098b3 service nova] Acquiring lock "refresh_cache-10d46e97-4721-49a0-beed-c022e9045b18" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:37:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-23a498c9-178a-4004-a367-dd5ef94a6588 req-a8d24a08-56d8-40c2-85f1-b4d71a3098b3 service nova] Acquired lock "refresh_cache-10d46e97-4721-49a0-beed-c022e9045b18" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:37:14 user nova-compute[73056]: DEBUG nova.network.neutron [req-23a498c9-178a-4004-a367-dd5ef94a6588 req-a8d24a08-56d8-40c2-85f1-b4d71a3098b3 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Refreshing network info cache for port 7fd29069-06c5-41f5-b52c-64fd01fcff42 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:37:15 user nova-compute[73056]: DEBUG nova.network.neutron [req-23a498c9-178a-4004-a367-dd5ef94a6588 req-a8d24a08-56d8-40c2-85f1-b4d71a3098b3 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:37:15 user nova-compute[73056]: DEBUG nova.network.neutron [req-23a498c9-178a-4004-a367-dd5ef94a6588 req-a8d24a08-56d8-40c2-85f1-b4d71a3098b3 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:37:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-23a498c9-178a-4004-a367-dd5ef94a6588 req-a8d24a08-56d8-40c2-85f1-b4d71a3098b3 service nova] Releasing lock "refresh_cache-10d46e97-4721-49a0-beed-c022e9045b18" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:37:15 user nova-compute[73056]: DEBUG nova.network.neutron [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Successfully updated port: b33c5c5b-fdb0-448c-a023-67de9d7f78fc {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:37:16 user nova-compute[73056]: DEBUG nova.network.neutron [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Successfully updated port: c81e86e3-8261-441f-b7b1-145aa7740e08 {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:37:16 user nova-compute[73056]: DEBUG nova.compute.manager [req-1ac7e4e6-d865-4b09-a999-90a7c5f0078a req-89532ab1-3f26-486a-9809-c47eb6e56e41 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-changed-c81e86e3-8261-441f-b7b1-145aa7740e08 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:37:16 user nova-compute[73056]: DEBUG nova.compute.manager [req-1ac7e4e6-d865-4b09-a999-90a7c5f0078a req-89532ab1-3f26-486a-9809-c47eb6e56e41 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Refreshing instance network info cache due to event network-changed-c81e86e3-8261-441f-b7b1-145aa7740e08. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:37:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1ac7e4e6-d865-4b09-a999-90a7c5f0078a req-89532ab1-3f26-486a-9809-c47eb6e56e41 service nova] Acquiring lock "refresh_cache-d15f23ae-f5a4-47cf-b136-7072c7838790" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:37:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1ac7e4e6-d865-4b09-a999-90a7c5f0078a req-89532ab1-3f26-486a-9809-c47eb6e56e41 service nova] Acquired lock "refresh_cache-d15f23ae-f5a4-47cf-b136-7072c7838790" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:37:16 user nova-compute[73056]: DEBUG nova.network.neutron [req-1ac7e4e6-d865-4b09-a999-90a7c5f0078a req-89532ab1-3f26-486a-9809-c47eb6e56e41 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Refreshing network info cache for port c81e86e3-8261-441f-b7b1-145aa7740e08 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:37:16 user nova-compute[73056]: DEBUG nova.network.neutron [req-1ac7e4e6-d865-4b09-a999-90a7c5f0078a req-89532ab1-3f26-486a-9809-c47eb6e56e41 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:37:16 user nova-compute[73056]: DEBUG nova.network.neutron [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Successfully updated port: 2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586 {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:37:16 user nova-compute[73056]: DEBUG nova.network.neutron [req-1ac7e4e6-d865-4b09-a999-90a7c5f0078a req-89532ab1-3f26-486a-9809-c47eb6e56e41 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:37:16 user nova-compute[73056]: DEBUG nova.compute.manager [req-312d484e-6c2a-4e09-98c5-444afb79a903 req-652e404e-02fa-45f1-aa15-648f64ea45d9 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-changed-b33c5c5b-fdb0-448c-a023-67de9d7f78fc {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:37:16 user nova-compute[73056]: DEBUG nova.compute.manager [req-312d484e-6c2a-4e09-98c5-444afb79a903 req-652e404e-02fa-45f1-aa15-648f64ea45d9 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Refreshing instance network info cache due to event network-changed-b33c5c5b-fdb0-448c-a023-67de9d7f78fc. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:37:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-312d484e-6c2a-4e09-98c5-444afb79a903 req-652e404e-02fa-45f1-aa15-648f64ea45d9 service nova] Acquiring lock "refresh_cache-10d46e97-4721-49a0-beed-c022e9045b18" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:37:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-312d484e-6c2a-4e09-98c5-444afb79a903 req-652e404e-02fa-45f1-aa15-648f64ea45d9 service nova] Acquired lock "refresh_cache-10d46e97-4721-49a0-beed-c022e9045b18" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:37:16 user nova-compute[73056]: DEBUG nova.network.neutron [req-312d484e-6c2a-4e09-98c5-444afb79a903 req-652e404e-02fa-45f1-aa15-648f64ea45d9 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Refreshing network info cache for port b33c5c5b-fdb0-448c-a023-67de9d7f78fc {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:37:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1ac7e4e6-d865-4b09-a999-90a7c5f0078a req-89532ab1-3f26-486a-9809-c47eb6e56e41 service nova] Releasing lock "refresh_cache-d15f23ae-f5a4-47cf-b136-7072c7838790" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:37:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Acquiring lock "03f3d2be-ec24-413c-b44e-873b82268212" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:37:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Lock "03f3d2be-ec24-413c-b44e-873b82268212" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:37:17 user nova-compute[73056]: DEBUG nova.compute.manager [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:37:17 user nova-compute[73056]: DEBUG nova.network.neutron [req-312d484e-6c2a-4e09-98c5-444afb79a903 req-652e404e-02fa-45f1-aa15-648f64ea45d9 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:37:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:37:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:37:17 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:37:17 user nova-compute[73056]: INFO nova.compute.claims [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Claim successful on node user
Aug 14 16:37:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:17 user nova-compute[73056]: DEBUG nova.network.neutron [req-312d484e-6c2a-4e09-98c5-444afb79a903 req-652e404e-02fa-45f1-aa15-648f64ea45d9 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:37:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-312d484e-6c2a-4e09-98c5-444afb79a903 req-652e404e-02fa-45f1-aa15-648f64ea45d9 service nova] Releasing lock "refresh_cache-10d46e97-4721-49a0-beed-c022e9045b18" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:37:17 user nova-compute[73056]: DEBUG nova.compute.manager [req-312d484e-6c2a-4e09-98c5-444afb79a903 req-652e404e-02fa-45f1-aa15-648f64ea45d9 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-changed-2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:37:17 user nova-compute[73056]: DEBUG nova.compute.manager [req-312d484e-6c2a-4e09-98c5-444afb79a903 req-652e404e-02fa-45f1-aa15-648f64ea45d9 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Refreshing instance network info cache due to event network-changed-2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:37:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-312d484e-6c2a-4e09-98c5-444afb79a903 req-652e404e-02fa-45f1-aa15-648f64ea45d9 service nova] Acquiring lock "refresh_cache-10d46e97-4721-49a0-beed-c022e9045b18" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:37:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-312d484e-6c2a-4e09-98c5-444afb79a903 req-652e404e-02fa-45f1-aa15-648f64ea45d9 service nova] Acquired lock "refresh_cache-10d46e97-4721-49a0-beed-c022e9045b18" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:37:17 user nova-compute[73056]: DEBUG nova.network.neutron [req-312d484e-6c2a-4e09-98c5-444afb79a903 req-652e404e-02fa-45f1-aa15-648f64ea45d9 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Refreshing network info cache for port 2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:37:17 user nova-compute[73056]: DEBUG nova.network.neutron [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Successfully updated port: 087bb06e-10ff-4b89-81e2-59c05c7f658c {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:37:17 user nova-compute[73056]: DEBUG nova.network.neutron [req-312d484e-6c2a-4e09-98c5-444afb79a903 req-652e404e-02fa-45f1-aa15-648f64ea45d9 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:37:17 user nova-compute[73056]: DEBUG nova.network.neutron [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Successfully updated port: 69edfecc-9201-4747-89e2-bd552f2616ed {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:37:17 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:37:17 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:37:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.582s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:17 user nova-compute[73056]: DEBUG nova.compute.manager [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:37:17 user nova-compute[73056]: DEBUG nova.network.neutron [req-312d484e-6c2a-4e09-98c5-444afb79a903 req-652e404e-02fa-45f1-aa15-648f64ea45d9 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:37:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-312d484e-6c2a-4e09-98c5-444afb79a903 req-652e404e-02fa-45f1-aa15-648f64ea45d9 service nova] Releasing lock "refresh_cache-10d46e97-4721-49a0-beed-c022e9045b18" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:37:17 user nova-compute[73056]: DEBUG nova.compute.manager [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:37:17 user nova-compute[73056]: DEBUG nova.network.neutron [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:37:17 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:37:17 user nova-compute[73056]: DEBUG nova.compute.manager [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:37:18 user nova-compute[73056]: DEBUG nova.policy [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '636c066370684bc6ba775713606d9df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7613ed7cdbf24a8285c1ede9b24ea476', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:37:18 user nova-compute[73056]: DEBUG nova.compute.manager [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:37:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:37:18 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Creating image(s)
Aug 14 16:37:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Acquiring lock "/opt/stack/data/nova/instances/03f3d2be-ec24-413c-b44e-873b82268212/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:37:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Lock "/opt/stack/data/nova/instances/03f3d2be-ec24-413c-b44e-873b82268212/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:37:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Lock "/opt/stack/data/nova/instances/03f3d2be-ec24-413c-b44e-873b82268212/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:18 user nova-compute[73056]: DEBUG nova.network.neutron [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Successfully updated port: 16d756dd-e41f-42df-bdba-77a1aa465582 {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:37:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.199s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Acquiring lock "c889592ab94cd0b0ce896f27a2af0323771db234" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:37:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:37:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:18 user nova-compute[73056]: DEBUG nova.compute.manager [req-5acfcfdd-3845-40ea-a8ef-789be53d2c21 req-a91164cc-a964-4922-856e-d5c5fa7967c1 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-changed-69edfecc-9201-4747-89e2-bd552f2616ed {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:37:18 user nova-compute[73056]: DEBUG nova.compute.manager [req-5acfcfdd-3845-40ea-a8ef-789be53d2c21 req-a91164cc-a964-4922-856e-d5c5fa7967c1 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Refreshing instance network info cache due to event network-changed-69edfecc-9201-4747-89e2-bd552f2616ed. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:37:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-5acfcfdd-3845-40ea-a8ef-789be53d2c21 req-a91164cc-a964-4922-856e-d5c5fa7967c1 service nova] Acquiring lock "refresh_cache-d15f23ae-f5a4-47cf-b136-7072c7838790" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:37:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-5acfcfdd-3845-40ea-a8ef-789be53d2c21 req-a91164cc-a964-4922-856e-d5c5fa7967c1 service nova] Acquired lock "refresh_cache-d15f23ae-f5a4-47cf-b136-7072c7838790" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:37:18 user nova-compute[73056]: DEBUG nova.network.neutron [req-5acfcfdd-3845-40ea-a8ef-789be53d2c21 req-a91164cc-a964-4922-856e-d5c5fa7967c1 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Refreshing network info cache for port 69edfecc-9201-4747-89e2-bd552f2616ed {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:37:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.198s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/03f3d2be-ec24-413c-b44e-873b82268212/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/03f3d2be-ec24-413c-b44e-873b82268212/disk 1073741824" returned: 0 in 0.058s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.186s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:18 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Checking if we can resize image /opt/stack/data/nova/instances/03f3d2be-ec24-413c-b44e-873b82268212/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 16:37:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f3d2be-ec24-413c-b44e-873b82268212/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:18 user nova-compute[73056]: DEBUG nova.network.neutron [req-5acfcfdd-3845-40ea-a8ef-789be53d2c21 req-a91164cc-a964-4922-856e-d5c5fa7967c1 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:37:19 user nova-compute[73056]: DEBUG nova.compute.manager [req-73a40eba-f099-4a97-b614-dd38aa1f966d req-d4788578-15d9-4e24-94f3-4118ae076bab service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-changed-087bb06e-10ff-4b89-81e2-59c05c7f658c {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:37:19 user nova-compute[73056]: DEBUG nova.compute.manager [req-73a40eba-f099-4a97-b614-dd38aa1f966d req-d4788578-15d9-4e24-94f3-4118ae076bab service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Refreshing instance network info cache due to event network-changed-087bb06e-10ff-4b89-81e2-59c05c7f658c. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:37:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-73a40eba-f099-4a97-b614-dd38aa1f966d req-d4788578-15d9-4e24-94f3-4118ae076bab service nova] Acquiring lock "refresh_cache-10d46e97-4721-49a0-beed-c022e9045b18" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:37:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-73a40eba-f099-4a97-b614-dd38aa1f966d req-d4788578-15d9-4e24-94f3-4118ae076bab service nova] Acquired lock "refresh_cache-10d46e97-4721-49a0-beed-c022e9045b18" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:37:19 user nova-compute[73056]: DEBUG nova.network.neutron [req-73a40eba-f099-4a97-b614-dd38aa1f966d req-d4788578-15d9-4e24-94f3-4118ae076bab service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Refreshing network info cache for port 087bb06e-10ff-4b89-81e2-59c05c7f658c {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:37:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f3d2be-ec24-413c-b44e-873b82268212/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:19 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Cannot resize image /opt/stack/data/nova/instances/03f3d2be-ec24-413c-b44e-873b82268212/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 16:37:19 user nova-compute[73056]: DEBUG nova.objects.instance [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Lazy-loading 'migration_context' on Instance uuid 03f3d2be-ec24-413c-b44e-873b82268212 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:37:19 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 16:37:19 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Ensure instance console log exists: /opt/stack/data/nova/instances/03f3d2be-ec24-413c-b44e-873b82268212/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:37:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:37:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:37:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:19 user nova-compute[73056]: DEBUG nova.network.neutron [req-73a40eba-f099-4a97-b614-dd38aa1f966d req-d4788578-15d9-4e24-94f3-4118ae076bab service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:37:19 user nova-compute[73056]: DEBUG nova.network.neutron [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Successfully created port: d4cb3320-fcd8-47a3-b3c5-f14754282ce9 {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:37:19 user nova-compute[73056]: DEBUG nova.network.neutron [req-5acfcfdd-3845-40ea-a8ef-789be53d2c21 req-a91164cc-a964-4922-856e-d5c5fa7967c1 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:37:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-5acfcfdd-3845-40ea-a8ef-789be53d2c21 req-a91164cc-a964-4922-856e-d5c5fa7967c1 service nova] Releasing lock "refresh_cache-d15f23ae-f5a4-47cf-b136-7072c7838790" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:37:19 user nova-compute[73056]: DEBUG nova.network.neutron [req-73a40eba-f099-4a97-b614-dd38aa1f966d req-d4788578-15d9-4e24-94f3-4118ae076bab service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:37:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-73a40eba-f099-4a97-b614-dd38aa1f966d req-d4788578-15d9-4e24-94f3-4118ae076bab service nova] Releasing lock "refresh_cache-10d46e97-4721-49a0-beed-c022e9045b18" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:37:19 user nova-compute[73056]: DEBUG nova.compute.manager [req-73a40eba-f099-4a97-b614-dd38aa1f966d req-d4788578-15d9-4e24-94f3-4118ae076bab service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-changed-16d756dd-e41f-42df-bdba-77a1aa465582 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:37:19 user nova-compute[73056]: DEBUG nova.compute.manager [req-73a40eba-f099-4a97-b614-dd38aa1f966d req-d4788578-15d9-4e24-94f3-4118ae076bab service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Refreshing instance network info cache due to event network-changed-16d756dd-e41f-42df-bdba-77a1aa465582. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:37:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-73a40eba-f099-4a97-b614-dd38aa1f966d req-d4788578-15d9-4e24-94f3-4118ae076bab service nova] Acquiring lock "refresh_cache-10d46e97-4721-49a0-beed-c022e9045b18" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:37:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-73a40eba-f099-4a97-b614-dd38aa1f966d req-d4788578-15d9-4e24-94f3-4118ae076bab service nova] Acquired lock "refresh_cache-10d46e97-4721-49a0-beed-c022e9045b18" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:37:19 user nova-compute[73056]: DEBUG nova.network.neutron [req-73a40eba-f099-4a97-b614-dd38aa1f966d req-d4788578-15d9-4e24-94f3-4118ae076bab service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Refreshing network info cache for port 16d756dd-e41f-42df-bdba-77a1aa465582 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:37:19 user nova-compute[73056]: DEBUG nova.network.neutron [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Successfully updated port: b70d8306-e1df-4d66-9949-8f156c902305 {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:37:19 user nova-compute[73056]: DEBUG nova.network.neutron [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Successfully updated port: 50d5fcc4-f01a-4f51-81a3-47410ef0bbdc {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:37:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Acquiring lock "refresh_cache-10d46e97-4721-49a0-beed-c022e9045b18" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:37:19 user nova-compute[73056]: DEBUG nova.network.neutron [req-73a40eba-f099-4a97-b614-dd38aa1f966d req-d4788578-15d9-4e24-94f3-4118ae076bab service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:37:19 user nova-compute[73056]: DEBUG nova.network.neutron [req-73a40eba-f099-4a97-b614-dd38aa1f966d req-d4788578-15d9-4e24-94f3-4118ae076bab service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:37:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-73a40eba-f099-4a97-b614-dd38aa1f966d req-d4788578-15d9-4e24-94f3-4118ae076bab service nova] Releasing lock "refresh_cache-10d46e97-4721-49a0-beed-c022e9045b18" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:37:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Acquired lock "refresh_cache-10d46e97-4721-49a0-beed-c022e9045b18" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:37:19 user nova-compute[73056]: DEBUG nova.network.neutron [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:37:20 user nova-compute[73056]: DEBUG nova.network.neutron [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:37:20 user nova-compute[73056]: DEBUG nova.network.neutron [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Successfully updated port: d4cb3320-fcd8-47a3-b3c5-f14754282ce9 {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:37:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Acquiring lock "refresh_cache-03f3d2be-ec24-413c-b44e-873b82268212" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:37:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Acquired lock "refresh_cache-03f3d2be-ec24-413c-b44e-873b82268212" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:37:20 user nova-compute[73056]: DEBUG nova.network.neutron [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:37:20 user nova-compute[73056]: DEBUG nova.network.neutron [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:37:20 user nova-compute[73056]: DEBUG nova.compute.manager [req-8620ec28-ae2d-43b3-ab61-99d1356532d5 req-12a49672-17e8-415b-8298-698acf560097 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-changed-b70d8306-e1df-4d66-9949-8f156c902305 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:37:20 user nova-compute[73056]: DEBUG nova.compute.manager [req-8620ec28-ae2d-43b3-ab61-99d1356532d5 req-12a49672-17e8-415b-8298-698acf560097 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Refreshing instance network info cache due to event network-changed-b70d8306-e1df-4d66-9949-8f156c902305. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:37:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8620ec28-ae2d-43b3-ab61-99d1356532d5 req-12a49672-17e8-415b-8298-698acf560097 service nova] Acquiring lock "refresh_cache-d15f23ae-f5a4-47cf-b136-7072c7838790" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:37:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8620ec28-ae2d-43b3-ab61-99d1356532d5 req-12a49672-17e8-415b-8298-698acf560097 service nova] Acquired lock "refresh_cache-d15f23ae-f5a4-47cf-b136-7072c7838790" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:37:20 user nova-compute[73056]: DEBUG nova.network.neutron [req-8620ec28-ae2d-43b3-ab61-99d1356532d5 req-12a49672-17e8-415b-8298-698acf560097 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Refreshing network info cache for port b70d8306-e1df-4d66-9949-8f156c902305 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:37:20 user nova-compute[73056]: DEBUG nova.network.neutron [req-8620ec28-ae2d-43b3-ab61-99d1356532d5 req-12a49672-17e8-415b-8298-698acf560097 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:37:20 user nova-compute[73056]: DEBUG nova.network.neutron [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Successfully updated port: ea9bf8ed-60e0-4563-893c-33135ea49823 {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:37:20 user nova-compute[73056]: DEBUG nova.network.neutron [req-8620ec28-ae2d-43b3-ab61-99d1356532d5 req-12a49672-17e8-415b-8298-698acf560097 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:37:20 user nova-compute[73056]: DEBUG nova.network.neutron [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Updating instance_info_cache with network_info: [{"id": "d4cb3320-fcd8-47a3-b3c5-f14754282ce9", "address": "fa:16:3e:94:6a:16", "network": {"id": "1f2ac013-0ba6-4f28-add5-919268c1b275", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1342198244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7613ed7cdbf24a8285c1ede9b24ea476", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4cb3320-fc", "ovs_interfaceid": "d4cb3320-fcd8-47a3-b3c5-f14754282ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:37:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Releasing lock "refresh_cache-03f3d2be-ec24-413c-b44e-873b82268212" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:37:20 user nova-compute[73056]: DEBUG nova.compute.manager [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Instance network_info: |[{"id": "d4cb3320-fcd8-47a3-b3c5-f14754282ce9", "address": "fa:16:3e:94:6a:16", "network": {"id": "1f2ac013-0ba6-4f28-add5-919268c1b275", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1342198244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7613ed7cdbf24a8285c1ede9b24ea476", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4cb3320-fc", "ovs_interfaceid": "d4cb3320-fcd8-47a3-b3c5-f14754282ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:37:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8620ec28-ae2d-43b3-ab61-99d1356532d5 req-12a49672-17e8-415b-8298-698acf560097 service nova] Releasing lock "refresh_cache-d15f23ae-f5a4-47cf-b136-7072c7838790" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:37:20 user nova-compute[73056]: DEBUG nova.compute.manager [req-8620ec28-ae2d-43b3-ab61-99d1356532d5 req-12a49672-17e8-415b-8298-698acf560097 service nova] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Received event network-changed-d4cb3320-fcd8-47a3-b3c5-f14754282ce9 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:37:20 user nova-compute[73056]: DEBUG nova.compute.manager [req-8620ec28-ae2d-43b3-ab61-99d1356532d5 req-12a49672-17e8-415b-8298-698acf560097 service nova] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Refreshing instance network info cache due to event network-changed-d4cb3320-fcd8-47a3-b3c5-f14754282ce9. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:37:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8620ec28-ae2d-43b3-ab61-99d1356532d5 req-12a49672-17e8-415b-8298-698acf560097 service nova] Acquiring lock "refresh_cache-03f3d2be-ec24-413c-b44e-873b82268212" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:37:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8620ec28-ae2d-43b3-ab61-99d1356532d5 req-12a49672-17e8-415b-8298-698acf560097 service nova] Acquired lock "refresh_cache-03f3d2be-ec24-413c-b44e-873b82268212" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG nova.network.neutron [req-8620ec28-ae2d-43b3-ab61-99d1356532d5 req-12a49672-17e8-415b-8298-698acf560097 service nova] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Refreshing network info cache for port d4cb3320-fcd8-47a3-b3c5-f14754282ce9 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Start _get_guest_xml network_info=[{"id": "d4cb3320-fcd8-47a3-b3c5-f14754282ce9", "address": "fa:16:3e:94:6a:16", "network": {"id": "1f2ac013-0ba6-4f28-add5-919268c1b275", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1342198244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7613ed7cdbf24a8285c1ede9b24ea476", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4cb3320-fc", "ovs_interfaceid": "d4cb3320-fcd8-47a3-b3c5-f14754282ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:37:21 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:37:21 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:37:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:37:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1391910034',display_name='tempest-VolumesActionsTest-instance-1391910034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1391910034',id=11,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7613ed7cdbf24a8285c1ede9b24ea476',ramdisk_id='',reservation_id='r-xacrqef4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2061382771',owner_user_name='tempest-VolumesActionsTest-2061382771-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:37:18Z,user_data=None,user_id='636c066370684bc6ba775713606d9df7',uuid=03f3d2be-ec24-413c-b44e-873b82268212,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4cb3320-fcd8-47a3-b3c5-f14754282ce9", "address": "fa:16:3e:94:6a:16", "network": {"id": "1f2ac013-0ba6-4f28-add5-919268c1b275", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1342198244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7613ed7cdbf24a8285c1ede9b24ea476", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4cb3320-fc", "ovs_interfaceid": "d4cb3320-fcd8-47a3-b3c5-f14754282ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Converting VIF {"id": "d4cb3320-fcd8-47a3-b3c5-f14754282ce9", "address": "fa:16:3e:94:6a:16", "network": {"id": "1f2ac013-0ba6-4f28-add5-919268c1b275", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1342198244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7613ed7cdbf24a8285c1ede9b24ea476", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4cb3320-fc", "ovs_interfaceid": "d4cb3320-fcd8-47a3-b3c5-f14754282ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:6a:16,bridge_name='br-int',has_traffic_filtering=True,id=d4cb3320-fcd8-47a3-b3c5-f14754282ce9,network=Network(1f2ac013-0ba6-4f28-add5-919268c1b275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4cb3320-fc') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG nova.objects.instance [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Lazy-loading 'pci_devices' on Instance uuid 03f3d2be-ec24-413c-b44e-873b82268212 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:37:21 user nova-compute[73056]:   <uuid>03f3d2be-ec24-413c-b44e-873b82268212</uuid>
Aug 14 16:37:21 user nova-compute[73056]:   <name>instance-0000000b</name>
Aug 14 16:37:21 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:37:21 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:37:21 user nova-compute[73056]:   <metadata>
Aug 14 16:37:21 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:37:21 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:37:21 user nova-compute[73056]:       <nova:name>tempest-VolumesActionsTest-instance-1391910034</nova:name>
Aug 14 16:37:21 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:37:21</nova:creationTime>
Aug 14 16:37:21 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:37:21 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:37:21 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:37:21 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:37:21 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:37:21 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:37:21 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:37:21 user nova-compute[73056]:       <nova:owner>
Aug 14 16:37:21 user nova-compute[73056]:         <nova:user uuid="636c066370684bc6ba775713606d9df7">tempest-VolumesActionsTest-2061382771-project-member</nova:user>
Aug 14 16:37:21 user nova-compute[73056]:         <nova:project uuid="7613ed7cdbf24a8285c1ede9b24ea476">tempest-VolumesActionsTest-2061382771</nova:project>
Aug 14 16:37:21 user nova-compute[73056]:       </nova:owner>
Aug 14 16:37:21 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:37:21 user nova-compute[73056]:       <nova:ports>
Aug 14 16:37:21 user nova-compute[73056]:         <nova:port uuid="d4cb3320-fcd8-47a3-b3c5-f14754282ce9">
Aug 14 16:37:21 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 14 16:37:21 user nova-compute[73056]:         </nova:port>
Aug 14 16:37:21 user nova-compute[73056]:       </nova:ports>
Aug 14 16:37:21 user nova-compute[73056]:     </nova:instance>
Aug 14 16:37:21 user nova-compute[73056]:   </metadata>
Aug 14 16:37:21 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:37:21 user nova-compute[73056]:     <system>
Aug 14 16:37:21 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:37:21 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:37:21 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:37:21 user nova-compute[73056]:       <entry name="serial">03f3d2be-ec24-413c-b44e-873b82268212</entry>
Aug 14 16:37:21 user nova-compute[73056]:       <entry name="uuid">03f3d2be-ec24-413c-b44e-873b82268212</entry>
Aug 14 16:37:21 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:37:21 user nova-compute[73056]:     </system>
Aug 14 16:37:21 user nova-compute[73056]:   </sysinfo>
Aug 14 16:37:21 user nova-compute[73056]:   <os>
Aug 14 16:37:21 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:37:21 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:37:21 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:37:21 user nova-compute[73056]:   </os>
Aug 14 16:37:21 user nova-compute[73056]:   <features>
Aug 14 16:37:21 user nova-compute[73056]:     <acpi/>
Aug 14 16:37:21 user nova-compute[73056]:     <apic/>
Aug 14 16:37:21 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:37:21 user nova-compute[73056]:   </features>
Aug 14 16:37:21 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:37:21 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:37:21 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:37:21 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:37:21 user nova-compute[73056]:   </clock>
Aug 14 16:37:21 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:37:21 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:37:21 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:37:21 user nova-compute[73056]:   </cpu>
Aug 14 16:37:21 user nova-compute[73056]:   <devices>
Aug 14 16:37:21 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:37:21 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:37:21 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/03f3d2be-ec24-413c-b44e-873b82268212/disk"/>
Aug 14 16:37:21 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:37:21 user nova-compute[73056]:     </disk>
Aug 14 16:37:21 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:37:21 user nova-compute[73056]:       <mac address="fa:16:3e:94:6a:16"/>
Aug 14 16:37:21 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:37:21 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:37:21 user nova-compute[73056]:       <target dev="tapd4cb3320-fc"/>
Aug 14 16:37:21 user nova-compute[73056]:     </interface>
Aug 14 16:37:21 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:37:21 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/03f3d2be-ec24-413c-b44e-873b82268212/console.log" append="off"/>
Aug 14 16:37:21 user nova-compute[73056]:     </serial>
Aug 14 16:37:21 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:37:21 user nova-compute[73056]:     <video>
Aug 14 16:37:21 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:37:21 user nova-compute[73056]:     </video>
Aug 14 16:37:21 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:37:21 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:37:21 user nova-compute[73056]:     </rng>
Aug 14 16:37:21 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:37:21 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:37:21 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:37:21 user nova-compute[73056]:     </memballoon>
Aug 14 16:37:21 user nova-compute[73056]:   </devices>
Aug 14 16:37:21 user nova-compute[73056]: </domain>
Aug 14 16:37:21 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:37:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1391910034',display_name='tempest-VolumesActionsTest-instance-1391910034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1391910034',id=11,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7613ed7cdbf24a8285c1ede9b24ea476',ramdisk_id='',reservation_id='r-xacrqef4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2061382771',owner_user_name='tempest-VolumesActionsTest-2061382771-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:37:18Z,user_data=None,user_id='636c066370684bc6ba775713606d9df7',uuid=03f3d2be-ec24-413c-b44e-873b82268212,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4cb3320-fcd8-47a3-b3c5-f14754282ce9", "address": "fa:16:3e:94:6a:16", "network": {"id": "1f2ac013-0ba6-4f28-add5-919268c1b275", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1342198244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7613ed7cdbf24a8285c1ede9b24ea476", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4cb3320-fc", "ovs_interfaceid": "d4cb3320-fcd8-47a3-b3c5-f14754282ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Converting VIF {"id": "d4cb3320-fcd8-47a3-b3c5-f14754282ce9", "address": "fa:16:3e:94:6a:16", "network": {"id": "1f2ac013-0ba6-4f28-add5-919268c1b275", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1342198244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7613ed7cdbf24a8285c1ede9b24ea476", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4cb3320-fc", "ovs_interfaceid": "d4cb3320-fcd8-47a3-b3c5-f14754282ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:6a:16,bridge_name='br-int',has_traffic_filtering=True,id=d4cb3320-fcd8-47a3-b3c5-f14754282ce9,network=Network(1f2ac013-0ba6-4f28-add5-919268c1b275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4cb3320-fc') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG os_vif [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:6a:16,bridge_name='br-int',has_traffic_filtering=True,id=d4cb3320-fcd8-47a3-b3c5-f14754282ce9,network=Network(1f2ac013-0ba6-4f28-add5-919268c1b275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4cb3320-fc') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG nova.compute.manager [req-f742f4a2-d208-4dc0-bdf6-5d6156fc7b45 req-fbd7c425-21ea-4618-8cd0-adb8eaae84d2 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-changed-50d5fcc4-f01a-4f51-81a3-47410ef0bbdc {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG nova.compute.manager [req-f742f4a2-d208-4dc0-bdf6-5d6156fc7b45 req-fbd7c425-21ea-4618-8cd0-adb8eaae84d2 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Refreshing instance network info cache due to event network-changed-50d5fcc4-f01a-4f51-81a3-47410ef0bbdc. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f742f4a2-d208-4dc0-bdf6-5d6156fc7b45 req-fbd7c425-21ea-4618-8cd0-adb8eaae84d2 service nova] Acquiring lock "refresh_cache-10d46e97-4721-49a0-beed-c022e9045b18" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4cb3320-fc, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd4cb3320-fc, col_values=(('external_ids', {'iface-id': 'd4cb3320-fcd8-47a3-b3c5-f14754282ce9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:6a:16', 'vm-uuid': '03f3d2be-ec24-413c-b44e-873b82268212'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:21 user nova-compute[73056]: INFO os_vif [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:6a:16,bridge_name='br-int',has_traffic_filtering=True,id=d4cb3320-fcd8-47a3-b3c5-f14754282ce9,network=Network(1f2ac013-0ba6-4f28-add5-919268c1b275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4cb3320-fc')
Aug 14 16:37:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] No VIF found with MAC fa:16:3e:94:6a:16, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:37:21 user nova-compute[73056]: INFO nova.virt.block_device [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Booting with volume 040300fa-4882-4b0e-93f0-5ebeb1d9c48a at /dev/vdb
Aug 14 16:37:21 user nova-compute[73056]: DEBUG os_brick.utils [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04ba772-ace6-4dd6-ac34-51e3d00f0819]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e116e1f7-68ae-4242-a758-2cd92fef955a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[876ab259-1b2d-4b7a-907b-e13642492a1c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[924d2b8c-b591-4791-b623-93e487a9c331]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG nova.network.neutron [req-8620ec28-ae2d-43b3-ab61-99d1356532d5 req-12a49672-17e8-415b-8298-698acf560097 service nova] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Updated VIF entry in instance network info cache for port d4cb3320-fcd8-47a3-b3c5-f14754282ce9. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG nova.network.neutron [req-8620ec28-ae2d-43b3-ab61-99d1356532d5 req-12a49672-17e8-415b-8298-698acf560097 service nova] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Updating instance_info_cache with network_info: [{"id": "d4cb3320-fcd8-47a3-b3c5-f14754282ce9", "address": "fa:16:3e:94:6a:16", "network": {"id": "1f2ac013-0ba6-4f28-add5-919268c1b275", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1342198244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7613ed7cdbf24a8285c1ede9b24ea476", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4cb3320-fc", "ovs_interfaceid": "d4cb3320-fcd8-47a3-b3c5-f14754282ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:37:21 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:37:21 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7ebf18-53fd-41db-ab78-94864b07b6f8]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG os_brick.utils [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] <== get_connector_properties: return (181ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Updating existing volume attachment record: fd1b3626-8708-4c82-a086-10ba8847bba2 {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8620ec28-ae2d-43b3-ab61-99d1356532d5 req-12a49672-17e8-415b-8298-698acf560097 service nova] Releasing lock "refresh_cache-03f3d2be-ec24-413c-b44e-873b82268212" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:37:21 user nova-compute[73056]: DEBUG nova.network.neutron [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Successfully updated port: 9a54a741-25de-4758-921c-0b7e5c5730dd {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:37:22 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:22 user nova-compute[73056]: DEBUG nova.network.neutron [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Successfully updated port: 4e2daf22-7953-47ca-b2c6-98a1f0b00b72 {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:37:22 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:22 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:22 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:22 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:22 user nova-compute[73056]: DEBUG nova.network.neutron [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Updating instance_info_cache with network_info: [{"id": "5240a3a2-cb9a-4df3-a1c1-0c4531c248ac", "address": "fa:16:3e:54:5a:4e", "network": {"id": "3a8c7fe6-c1b1-487d-ab15-2b884c3ab575", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1448848437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5240a3a2-cb", "ovs_interfaceid": "5240a3a2-cb9a-4df3-a1c1-0c4531c248ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7fd29069-06c5-41f5-b52c-64fd01fcff42", "address": "fa:16:3e:ec:52:7a", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fd29069-06", "ovs_interfaceid": "7fd29069-06c5-41f5-b52c-64fd01fcff42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b33c5c5b-fdb0-448c-a023-67de9d7f78fc", "address": "fa:16:3e:20:6a:96", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33c5c5b-fd", "ovs_interfaceid": "b33c5c5b-fdb0-448c-a023-67de9d7f78fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586", "address": "fa:16:3e:b3:f7:fb", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c1d6956-ad", "ovs_interfaceid": "2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "087bb06e-10ff-4b89-81e2-59c05c7f658c", "address": "fa:16:3e:dd:8d:1e", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087bb06e-10", "ovs_interfaceid": "087bb06e-10ff-4b89-81e2-59c05c7f658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "16d756dd-e41f-42df-bdba-77a1aa465582", "address": "fa:16:3e:75:1b:3f", "network": {"id": "57310f85-bed6-4991-a4ce-9d6a4ff8d6c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-767952195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d756dd-e4", "ovs_interfaceid": "16d756dd-e41f-42df-bdba-77a1aa465582", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "50d5fcc4-f01a-4f51-81a3-47410ef0bbdc", "address": "fa:16:3e:26:4f:f4", "network": {"id": "57310f85-bed6-4991-a4ce-9d6a4ff8d6c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-767952195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d5fcc4-f0", "ovs_interfaceid": "50d5fcc4-f01a-4f51-81a3-47410ef0bbdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:37:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Releasing lock "refresh_cache-10d46e97-4721-49a0-beed-c022e9045b18" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:37:22 user nova-compute[73056]: DEBUG nova.compute.manager [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Instance network_info: |[{"id": "5240a3a2-cb9a-4df3-a1c1-0c4531c248ac", "address": "fa:16:3e:54:5a:4e", "network": {"id": "3a8c7fe6-c1b1-487d-ab15-2b884c3ab575", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1448848437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5240a3a2-cb", "ovs_interfaceid": "5240a3a2-cb9a-4df3-a1c1-0c4531c248ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7fd29069-06c5-41f5-b52c-64fd01fcff42", "address": "fa:16:3e:ec:52:7a", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fd29069-06", "ovs_interfaceid": "7fd29069-06c5-41f5-b52c-64fd01fcff42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b33c5c5b-fdb0-448c-a023-67de9d7f78fc", "address": "fa:16:3e:20:6a:96", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33c5c5b-fd", "ovs_interfaceid": "b33c5c5b-fdb0-448c-a023-67de9d7f78fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586", "address": "fa:16:3e:b3:f7:fb", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c1d6956-ad", "ovs_interfaceid": "2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "087bb06e-10ff-4b89-81e2-59c05c7f658c", "address": "fa:16:3e:dd:8d:1e", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087bb06e-10", "ovs_interfaceid": "087bb06e-10ff-4b89-81e2-59c05c7f658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "16d756dd-e41f-42df-bdba-77a1aa465582", "address": "fa:16:3e:75:1b:3f", "network": {"id": "57310f85-bed6-4991-a4ce-9d6a4ff8d6c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-767952195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d756dd-e4", "ovs_interfaceid": "16d756dd-e41f-42df-bdba-77a1aa465582", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "50d5fcc4-f01a-4f51-81a3-47410ef0bbdc", "address": "fa:16:3e:26:4f:f4", "network": {"id": "57310f85-bed6-4991-a4ce-9d6a4ff8d6c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-767952195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d5fcc4-f0", "ovs_interfaceid": "50d5fcc4-f01a-4f51-81a3-47410ef0bbdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:37:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f742f4a2-d208-4dc0-bdf6-5d6156fc7b45 req-fbd7c425-21ea-4618-8cd0-adb8eaae84d2 service nova] Acquired lock "refresh_cache-10d46e97-4721-49a0-beed-c022e9045b18" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:37:22 user nova-compute[73056]: DEBUG nova.network.neutron [req-f742f4a2-d208-4dc0-bdf6-5d6156fc7b45 req-fbd7c425-21ea-4618-8cd0-adb8eaae84d2 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Refreshing network info cache for port 50d5fcc4-f01a-4f51-81a3-47410ef0bbdc {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG nova.compute.manager [req-42d50a47-b936-489e-bb36-15fa1b699bdd req-62716a1f-8baf-4836-aedc-08ab8093faf9 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-changed-9a54a741-25de-4758-921c-0b7e5c5730dd {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG nova.compute.manager [req-42d50a47-b936-489e-bb36-15fa1b699bdd req-62716a1f-8baf-4836-aedc-08ab8093faf9 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Refreshing instance network info cache due to event network-changed-9a54a741-25de-4758-921c-0b7e5c5730dd. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-42d50a47-b936-489e-bb36-15fa1b699bdd req-62716a1f-8baf-4836-aedc-08ab8093faf9 service nova] Acquiring lock "refresh_cache-d15f23ae-f5a4-47cf-b136-7072c7838790" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-42d50a47-b936-489e-bb36-15fa1b699bdd req-62716a1f-8baf-4836-aedc-08ab8093faf9 service nova] Acquired lock "refresh_cache-d15f23ae-f5a4-47cf-b136-7072c7838790" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG nova.network.neutron [req-42d50a47-b936-489e-bb36-15fa1b699bdd req-62716a1f-8baf-4836-aedc-08ab8093faf9 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Refreshing network info cache for port 9a54a741-25de-4758-921c-0b7e5c5730dd {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG nova.network.neutron [req-42d50a47-b936-489e-bb36-15fa1b699bdd req-62716a1f-8baf-4836-aedc-08ab8093faf9 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG nova.network.neutron [req-42d50a47-b936-489e-bb36-15fa1b699bdd req-62716a1f-8baf-4836-aedc-08ab8093faf9 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-42d50a47-b936-489e-bb36-15fa1b699bdd req-62716a1f-8baf-4836-aedc-08ab8093faf9 service nova] Releasing lock "refresh_cache-d15f23ae-f5a4-47cf-b136-7072c7838790" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG nova.compute.manager [req-42d50a47-b936-489e-bb36-15fa1b699bdd req-62716a1f-8baf-4836-aedc-08ab8093faf9 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-changed-4e2daf22-7953-47ca-b2c6-98a1f0b00b72 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG nova.compute.manager [req-42d50a47-b936-489e-bb36-15fa1b699bdd req-62716a1f-8baf-4836-aedc-08ab8093faf9 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Refreshing instance network info cache due to event network-changed-4e2daf22-7953-47ca-b2c6-98a1f0b00b72. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-42d50a47-b936-489e-bb36-15fa1b699bdd req-62716a1f-8baf-4836-aedc-08ab8093faf9 service nova] Acquiring lock "refresh_cache-d15f23ae-f5a4-47cf-b136-7072c7838790" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-42d50a47-b936-489e-bb36-15fa1b699bdd req-62716a1f-8baf-4836-aedc-08ab8093faf9 service nova] Acquired lock "refresh_cache-d15f23ae-f5a4-47cf-b136-7072c7838790" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG nova.network.neutron [req-42d50a47-b936-489e-bb36-15fa1b699bdd req-62716a1f-8baf-4836-aedc-08ab8093faf9 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Refreshing network info cache for port 4e2daf22-7953-47ca-b2c6-98a1f0b00b72 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG nova.network.neutron [req-f742f4a2-d208-4dc0-bdf6-5d6156fc7b45 req-fbd7c425-21ea-4618-8cd0-adb8eaae84d2 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Updated VIF entry in instance network info cache for port 50d5fcc4-f01a-4f51-81a3-47410ef0bbdc. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG nova.network.neutron [req-f742f4a2-d208-4dc0-bdf6-5d6156fc7b45 req-fbd7c425-21ea-4618-8cd0-adb8eaae84d2 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Updating instance_info_cache with network_info: [{"id": "5240a3a2-cb9a-4df3-a1c1-0c4531c248ac", "address": "fa:16:3e:54:5a:4e", "network": {"id": "3a8c7fe6-c1b1-487d-ab15-2b884c3ab575", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1448848437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5240a3a2-cb", "ovs_interfaceid": "5240a3a2-cb9a-4df3-a1c1-0c4531c248ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7fd29069-06c5-41f5-b52c-64fd01fcff42", "address": "fa:16:3e:ec:52:7a", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fd29069-06", "ovs_interfaceid": "7fd29069-06c5-41f5-b52c-64fd01fcff42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b33c5c5b-fdb0-448c-a023-67de9d7f78fc", "address": "fa:16:3e:20:6a:96", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33c5c5b-fd", "ovs_interfaceid": "b33c5c5b-fdb0-448c-a023-67de9d7f78fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586", "address": "fa:16:3e:b3:f7:fb", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c1d6956-ad", "ovs_interfaceid": "2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "087bb06e-10ff-4b89-81e2-59c05c7f658c", "address": "fa:16:3e:dd:8d:1e", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087bb06e-10", "ovs_interfaceid": "087bb06e-10ff-4b89-81e2-59c05c7f658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "16d756dd-e41f-42df-bdba-77a1aa465582", "address": "fa:16:3e:75:1b:3f", "network": {"id": "57310f85-bed6-4991-a4ce-9d6a4ff8d6c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-767952195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d756dd-e4", "ovs_interfaceid": "16d756dd-e41f-42df-bdba-77a1aa465582", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "50d5fcc4-f01a-4f51-81a3-47410ef0bbdc", "address": "fa:16:3e:26:4f:f4", "network": {"id": "57310f85-bed6-4991-a4ce-9d6a4ff8d6c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-767952195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d5fcc4-f0", "ovs_interfaceid": "50d5fcc4-f01a-4f51-81a3-47410ef0bbdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG nova.network.neutron [req-42d50a47-b936-489e-bb36-15fa1b699bdd req-62716a1f-8baf-4836-aedc-08ab8093faf9 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f742f4a2-d208-4dc0-bdf6-5d6156fc7b45 req-fbd7c425-21ea-4618-8cd0-adb8eaae84d2 service nova] Releasing lock "refresh_cache-10d46e97-4721-49a0-beed-c022e9045b18" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG nova.compute.manager [req-f742f4a2-d208-4dc0-bdf6-5d6156fc7b45 req-fbd7c425-21ea-4618-8cd0-adb8eaae84d2 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-changed-ea9bf8ed-60e0-4563-893c-33135ea49823 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG nova.compute.manager [req-f742f4a2-d208-4dc0-bdf6-5d6156fc7b45 req-fbd7c425-21ea-4618-8cd0-adb8eaae84d2 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Refreshing instance network info cache due to event network-changed-ea9bf8ed-60e0-4563-893c-33135ea49823. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f742f4a2-d208-4dc0-bdf6-5d6156fc7b45 req-fbd7c425-21ea-4618-8cd0-adb8eaae84d2 service nova] Acquiring lock "refresh_cache-d15f23ae-f5a4-47cf-b136-7072c7838790" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:37:23 user nova-compute[73056]: INFO nova.virt.block_device [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Booting with volume 99a4de72-a5b0-4242-b22b-3f5ac30e8b02 at /dev/vdb
Aug 14 16:37:23 user nova-compute[73056]: DEBUG os_brick.utils [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ec949c-2600-4f92-a4f6-f5537e1855e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42a706b-29ac-441d-a95b-24136fecb026]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc7b517-75c4-42f6-b8c6-cad788845c0c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f7a2b8-9dcd-4abf-8bed-6e5f64916e2b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:37:23 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:37:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[24823ccf-55b7-4e15-b446-fb3c14231723]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG os_brick.utils [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:37:23 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Updating existing volume attachment record: 2362f726-8be8-429c-bf5d-a9ce27b66028 {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 16:37:24 user nova-compute[73056]: DEBUG nova.network.neutron [req-42d50a47-b936-489e-bb36-15fa1b699bdd req-62716a1f-8baf-4836-aedc-08ab8093faf9 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:37:24 user nova-compute[73056]: DEBUG nova.network.neutron [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Successfully updated port: ee13669b-f42c-4ca6-84e9-c95e35048ffc {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:37:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-42d50a47-b936-489e-bb36-15fa1b699bdd req-62716a1f-8baf-4836-aedc-08ab8093faf9 service nova] Releasing lock "refresh_cache-d15f23ae-f5a4-47cf-b136-7072c7838790" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:37:24 user nova-compute[73056]: DEBUG nova.compute.manager [req-42d50a47-b936-489e-bb36-15fa1b699bdd req-62716a1f-8baf-4836-aedc-08ab8093faf9 service nova] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Received event network-vif-plugged-d4cb3320-fcd8-47a3-b3c5-f14754282ce9 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:37:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-42d50a47-b936-489e-bb36-15fa1b699bdd req-62716a1f-8baf-4836-aedc-08ab8093faf9 service nova] Acquiring lock "03f3d2be-ec24-413c-b44e-873b82268212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:37:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-42d50a47-b936-489e-bb36-15fa1b699bdd req-62716a1f-8baf-4836-aedc-08ab8093faf9 service nova] Lock "03f3d2be-ec24-413c-b44e-873b82268212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:37:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-42d50a47-b936-489e-bb36-15fa1b699bdd req-62716a1f-8baf-4836-aedc-08ab8093faf9 service nova] Lock "03f3d2be-ec24-413c-b44e-873b82268212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:24 user nova-compute[73056]: DEBUG nova.compute.manager [req-42d50a47-b936-489e-bb36-15fa1b699bdd req-62716a1f-8baf-4836-aedc-08ab8093faf9 service nova] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] No waiting events found dispatching network-vif-plugged-d4cb3320-fcd8-47a3-b3c5-f14754282ce9 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:37:24 user nova-compute[73056]: WARNING nova.compute.manager [req-42d50a47-b936-489e-bb36-15fa1b699bdd req-62716a1f-8baf-4836-aedc-08ab8093faf9 service nova] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Received unexpected event network-vif-plugged-d4cb3320-fcd8-47a3-b3c5-f14754282ce9 for instance with vm_state building and task_state spawning.
Aug 14 16:37:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f742f4a2-d208-4dc0-bdf6-5d6156fc7b45 req-fbd7c425-21ea-4618-8cd0-adb8eaae84d2 service nova] Acquired lock "refresh_cache-d15f23ae-f5a4-47cf-b136-7072c7838790" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:37:24 user nova-compute[73056]: DEBUG nova.network.neutron [req-f742f4a2-d208-4dc0-bdf6-5d6156fc7b45 req-fbd7c425-21ea-4618-8cd0-adb8eaae84d2 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Refreshing network info cache for port ea9bf8ed-60e0-4563-893c-33135ea49823 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:37:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Acquiring lock "refresh_cache-d15f23ae-f5a4-47cf-b136-7072c7838790" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:37:24 user nova-compute[73056]: DEBUG nova.network.neutron [req-f742f4a2-d208-4dc0-bdf6-5d6156fc7b45 req-fbd7c425-21ea-4618-8cd0-adb8eaae84d2 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:37:24 user nova-compute[73056]: DEBUG nova.network.neutron [req-f742f4a2-d208-4dc0-bdf6-5d6156fc7b45 req-fbd7c425-21ea-4618-8cd0-adb8eaae84d2 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:37:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f742f4a2-d208-4dc0-bdf6-5d6156fc7b45 req-fbd7c425-21ea-4618-8cd0-adb8eaae84d2 service nova] Releasing lock "refresh_cache-d15f23ae-f5a4-47cf-b136-7072c7838790" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:37:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Acquired lock "refresh_cache-d15f23ae-f5a4-47cf-b136-7072c7838790" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:37:24 user nova-compute[73056]: DEBUG nova.network.neutron [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:37:24 user nova-compute[73056]: DEBUG nova.network.neutron [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:37:24 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031044.9319608, 03f3d2be-ec24-413c-b44e-873b82268212 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:37:24 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] VM Resumed (Lifecycle Event)
Aug 14 16:37:24 user nova-compute[73056]: DEBUG nova.compute.manager [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:37:24 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:37:24 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:37:24 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Instance spawned successfully.
Aug 14 16:37:24 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:37:24 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:37:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:37:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:37:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:37:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:37:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:37:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:37:25 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:37:25 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031044.932507, 03f3d2be-ec24-413c-b44e-873b82268212 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:37:25 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] VM Started (Lifecycle Event)
Aug 14 16:37:25 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:37:25 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:37:25 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:37:25 user nova-compute[73056]: INFO nova.compute.manager [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Took 6.92 seconds to spawn the instance on the hypervisor.
Aug 14 16:37:25 user nova-compute[73056]: DEBUG nova.compute.manager [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:37:25 user nova-compute[73056]: INFO nova.compute.manager [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Took 8.00 seconds to build instance.
Aug 14 16:37:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bbfba417-2df5-4211-a503-b0e3a37281fa tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Lock "03f3d2be-ec24-413c-b44e-873b82268212" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.132s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:25 user nova-compute[73056]: DEBUG nova.compute.manager [req-0bb36524-15a1-4676-a73c-f9c2a352a828 req-782f0bd6-619f-4c6a-8cff-7931228372f1 service nova] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Received event network-vif-plugged-d4cb3320-fcd8-47a3-b3c5-f14754282ce9 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:37:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0bb36524-15a1-4676-a73c-f9c2a352a828 req-782f0bd6-619f-4c6a-8cff-7931228372f1 service nova] Acquiring lock "03f3d2be-ec24-413c-b44e-873b82268212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:37:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0bb36524-15a1-4676-a73c-f9c2a352a828 req-782f0bd6-619f-4c6a-8cff-7931228372f1 service nova] Lock "03f3d2be-ec24-413c-b44e-873b82268212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:37:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0bb36524-15a1-4676-a73c-f9c2a352a828 req-782f0bd6-619f-4c6a-8cff-7931228372f1 service nova] Lock "03f3d2be-ec24-413c-b44e-873b82268212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:25 user nova-compute[73056]: DEBUG nova.compute.manager [req-0bb36524-15a1-4676-a73c-f9c2a352a828 req-782f0bd6-619f-4c6a-8cff-7931228372f1 service nova] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] No waiting events found dispatching network-vif-plugged-d4cb3320-fcd8-47a3-b3c5-f14754282ce9 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:37:25 user nova-compute[73056]: WARNING nova.compute.manager [req-0bb36524-15a1-4676-a73c-f9c2a352a828 req-782f0bd6-619f-4c6a-8cff-7931228372f1 service nova] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Received unexpected event network-vif-plugged-d4cb3320-fcd8-47a3-b3c5-f14754282ce9 for instance with vm_state active and task_state None.
Aug 14 16:37:25 user nova-compute[73056]: DEBUG nova.compute.manager [req-0bb36524-15a1-4676-a73c-f9c2a352a828 req-782f0bd6-619f-4c6a-8cff-7931228372f1 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-changed-ee13669b-f42c-4ca6-84e9-c95e35048ffc {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:37:25 user nova-compute[73056]: DEBUG nova.compute.manager [req-0bb36524-15a1-4676-a73c-f9c2a352a828 req-782f0bd6-619f-4c6a-8cff-7931228372f1 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Refreshing instance network info cache due to event network-changed-ee13669b-f42c-4ca6-84e9-c95e35048ffc. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:37:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0bb36524-15a1-4676-a73c-f9c2a352a828 req-782f0bd6-619f-4c6a-8cff-7931228372f1 service nova] Acquiring lock "refresh_cache-d15f23ae-f5a4-47cf-b136-7072c7838790" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:37:26 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:26 user nova-compute[73056]: DEBUG nova.network.neutron [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Updating instance_info_cache with network_info: [{"id": "c81e86e3-8261-441f-b7b1-145aa7740e08", "address": "fa:16:3e:80:07:c2", "network": {"id": "cffc94d2-2f90-4180-b640-81eac93db07e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-5276327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81e86e3-82", "ovs_interfaceid": "c81e86e3-8261-441f-b7b1-145aa7740e08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69edfecc-9201-4747-89e2-bd552f2616ed", "address": "fa:16:3e:b2:f1:d1", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69edfecc-92", "ovs_interfaceid": "69edfecc-9201-4747-89e2-bd552f2616ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b70d8306-e1df-4d66-9949-8f156c902305", "address": "fa:16:3e:68:92:b2", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70d8306-e1", "ovs_interfaceid": "b70d8306-e1df-4d66-9949-8f156c902305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea9bf8ed-60e0-4563-893c-33135ea49823", "address": "fa:16:3e:63:bd:25", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9bf8ed-60", "ovs_interfaceid": "ea9bf8ed-60e0-4563-893c-33135ea49823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9a54a741-25de-4758-921c-0b7e5c5730dd", "address": "fa:16:3e:bc:d6:2a", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a54a741-25", "ovs_interfaceid": "9a54a741-25de-4758-921c-0b7e5c5730dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e2daf22-7953-47ca-b2c6-98a1f0b00b72", "address": "fa:16:3e:b2:04:50", "network": {"id": "0cdd5be6-368d-4088-ad0c-d696845f9579", "bridge": "br-int", "label": "tempest-device-tagging-net2-999697901", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e2daf22-79", "ovs_interfaceid": "4e2daf22-7953-47ca-b2c6-98a1f0b00b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee13669b-f42c-4ca6-84e9-c95e35048ffc", "address": "fa:16:3e:28:49:8c", "network": {"id": "0cdd5be6-368d-4088-ad0c-d696845f9579", "bridge": "br-int", "label": "tempest-device-tagging-net2-999697901", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee13669b-f4", "ovs_interfaceid": "ee13669b-f42c-4ca6-84e9-c95e35048ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:37:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Releasing lock "refresh_cache-d15f23ae-f5a4-47cf-b136-7072c7838790" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:37:26 user nova-compute[73056]: DEBUG nova.compute.manager [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Instance network_info: |[{"id": "c81e86e3-8261-441f-b7b1-145aa7740e08", "address": "fa:16:3e:80:07:c2", "network": {"id": "cffc94d2-2f90-4180-b640-81eac93db07e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-5276327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81e86e3-82", "ovs_interfaceid": "c81e86e3-8261-441f-b7b1-145aa7740e08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69edfecc-9201-4747-89e2-bd552f2616ed", "address": "fa:16:3e:b2:f1:d1", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69edfecc-92", "ovs_interfaceid": "69edfecc-9201-4747-89e2-bd552f2616ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b70d8306-e1df-4d66-9949-8f156c902305", "address": "fa:16:3e:68:92:b2", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70d8306-e1", "ovs_interfaceid": "b70d8306-e1df-4d66-9949-8f156c902305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea9bf8ed-60e0-4563-893c-33135ea49823", "address": "fa:16:3e:63:bd:25", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9bf8ed-60", "ovs_interfaceid": "ea9bf8ed-60e0-4563-893c-33135ea49823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9a54a741-25de-4758-921c-0b7e5c5730dd", "address": "fa:16:3e:bc:d6:2a", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a54a741-25", "ovs_interfaceid": "9a54a741-25de-4758-921c-0b7e5c5730dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e2daf22-7953-47ca-b2c6-98a1f0b00b72", "address": "fa:16:3e:b2:04:50", "network": {"id": "0cdd5be6-368d-4088-ad0c-d696845f9579", "bridge": "br-int", "label": "tempest-device-tagging-net2-999697901", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e2daf22-79", "ovs_interfaceid": "4e2daf22-7953-47ca-b2c6-98a1f0b00b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee13669b-f42c-4ca6-84e9-c95e35048ffc", "address": "fa:16:3e:28:49:8c", "network": {"id": "0cdd5be6-368d-4088-ad0c-d696845f9579", "bridge": "br-int", "label": "tempest-device-tagging-net2-999697901", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee13669b-f4", "ovs_interfaceid": "ee13669b-f42c-4ca6-84e9-c95e35048ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:37:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0bb36524-15a1-4676-a73c-f9c2a352a828 req-782f0bd6-619f-4c6a-8cff-7931228372f1 service nova] Acquired lock "refresh_cache-d15f23ae-f5a4-47cf-b136-7072c7838790" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:37:26 user nova-compute[73056]: DEBUG nova.network.neutron [req-0bb36524-15a1-4676-a73c-f9c2a352a828 req-782f0bd6-619f-4c6a-8cff-7931228372f1 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Refreshing network info cache for port ee13669b-f42c-4ca6-84e9-c95e35048ffc {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:37:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:27 user nova-compute[73056]: DEBUG nova.network.neutron [req-0bb36524-15a1-4676-a73c-f9c2a352a828 req-782f0bd6-619f-4c6a-8cff-7931228372f1 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Updated VIF entry in instance network info cache for port ee13669b-f42c-4ca6-84e9-c95e35048ffc. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:37:27 user nova-compute[73056]: DEBUG nova.network.neutron [req-0bb36524-15a1-4676-a73c-f9c2a352a828 req-782f0bd6-619f-4c6a-8cff-7931228372f1 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Updating instance_info_cache with network_info: [{"id": "c81e86e3-8261-441f-b7b1-145aa7740e08", "address": "fa:16:3e:80:07:c2", "network": {"id": "cffc94d2-2f90-4180-b640-81eac93db07e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-5276327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81e86e3-82", "ovs_interfaceid": "c81e86e3-8261-441f-b7b1-145aa7740e08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69edfecc-9201-4747-89e2-bd552f2616ed", "address": "fa:16:3e:b2:f1:d1", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69edfecc-92", "ovs_interfaceid": "69edfecc-9201-4747-89e2-bd552f2616ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b70d8306-e1df-4d66-9949-8f156c902305", "address": "fa:16:3e:68:92:b2", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70d8306-e1", "ovs_interfaceid": "b70d8306-e1df-4d66-9949-8f156c902305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea9bf8ed-60e0-4563-893c-33135ea49823", "address": "fa:16:3e:63:bd:25", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9bf8ed-60", "ovs_interfaceid": "ea9bf8ed-60e0-4563-893c-33135ea49823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9a54a741-25de-4758-921c-0b7e5c5730dd", "address": "fa:16:3e:bc:d6:2a", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a54a741-25", "ovs_interfaceid": "9a54a741-25de-4758-921c-0b7e5c5730dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e2daf22-7953-47ca-b2c6-98a1f0b00b72", "address": "fa:16:3e:b2:04:50", "network": {"id": "0cdd5be6-368d-4088-ad0c-d696845f9579", "bridge": "br-int", "label": "tempest-device-tagging-net2-999697901", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e2daf22-79", "ovs_interfaceid": "4e2daf22-7953-47ca-b2c6-98a1f0b00b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee13669b-f42c-4ca6-84e9-c95e35048ffc", "address": "fa:16:3e:28:49:8c", "network": {"id": "0cdd5be6-368d-4088-ad0c-d696845f9579", "bridge": "br-int", "label": "tempest-device-tagging-net2-999697901", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee13669b-f4", "ovs_interfaceid": "ee13669b-f42c-4ca6-84e9-c95e35048ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:37:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0bb36524-15a1-4676-a73c-f9c2a352a828 req-782f0bd6-619f-4c6a-8cff-7931228372f1 service nova] Releasing lock "refresh_cache-d15f23ae-f5a4-47cf-b136-7072c7838790" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:37:31 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:32 user nova-compute[73056]: INFO nova.virt.block_device [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Booting with volume f709d3df-9c5d-478b-b3c5-ecc33e581346 at /dev/vdc
Aug 14 16:37:32 user nova-compute[73056]: DEBUG os_brick.utils [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:37:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6a72b2-e3a2-41a9-9729-6bb0cbc4588a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f6eff3-f655-4ff5-bbf2-004149124aed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9298d1c-414c-4569-9547-732a67044527]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebdf1b7a-4e6d-4a71-a30e-4e86294deb6f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:37:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:37:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:37:32 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:37:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd81b7d9-49b1-43ca-9e56-19582326b8bd]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:37:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:37:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:37:32 user nova-compute[73056]: DEBUG os_brick.utils [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:37:32 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Updating existing volume attachment record: 6a5a656e-ff28-4c9d-8b8b-23047cb5fdb3 {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 16:37:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:37 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:41 user nova-compute[73056]: DEBUG nova.compute.manager [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:37:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:37:41 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Creating image(s)
Aug 14 16:37:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Did not create local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 16:37:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Ensure instance console log exists: /opt/stack/data/nova/instances/d15f23ae-f5a4-47cf-b136-7072c7838790/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:37:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:37:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:37:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Start _get_guest_xml network_info=[{"id": "c81e86e3-8261-441f-b7b1-145aa7740e08", "address": "fa:16:3e:80:07:c2", "network": {"id": "cffc94d2-2f90-4180-b640-81eac93db07e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-5276327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81e86e3-82", "ovs_interfaceid": "c81e86e3-8261-441f-b7b1-145aa7740e08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69edfecc-9201-4747-89e2-bd552f2616ed", "address": "fa:16:3e:b2:f1:d1", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69edfecc-92", "ovs_interfaceid": "69edfecc-9201-4747-89e2-bd552f2616ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b70d8306-e1df-4d66-9949-8f156c902305", "address": "fa:16:3e:68:92:b2", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70d8306-e1", "ovs_interfaceid": "b70d8306-e1df-4d66-9949-8f156c902305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea9bf8ed-60e0-4563-893c-33135ea49823", "address": "fa:16:3e:63:bd:25", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9bf8ed-60", "ovs_interfaceid": "ea9bf8ed-60e0-4563-893c-33135ea49823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9a54a741-25de-4758-921c-0b7e5c5730dd", "address": "fa:16:3e:bc:d6:2a", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a54a741-25", "ovs_interfaceid": "9a54a741-25de-4758-921c-0b7e5c5730dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e2daf22-7953-47ca-b2c6-98a1f0b00b72", "address": "fa:16:3e:b2:04:50", "network": {"id": "0cdd5be6-368d-4088-ad0c-d696845f9579", "bridge": "br-int", "label": "tempest-device-tagging-net2-999697901", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e2daf22-79", "ovs_interfaceid": "4e2daf22-7953-47ca-b2c6-98a1f0b00b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee13669b-f42c-4ca6-84e9-c95e35048ffc", "address": "fa:16:3e:28:49:8c", "network": {"id": "0cdd5be6-368d-4088-ad0c-d696845f9579", "bridge": "br-int", "label": "tempest-device-tagging-net2-999697901", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee13669b-f4", "ovs_interfaceid": "ee13669b-f42c-4ca6-84e9-c95e35048ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EmrNuQjh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd15f23ae-f5a4-47cf-b136-7072c7838790', 'attached_at': '', 'detached_at': '', 'volume_id': '957e6707-8ee8-47f6-8191-969f2f44496f', 'serial': '957e6707-8ee8-47f6-8191-969f2f44496f'}, 'attachment_id': '0773c41e-77e2-4eeb-a60a-39ff55318d56', 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None}, {'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QZTwFLJN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd15f23ae-f5a4-47cf-b136-7072c7838790', 'attached_at': '', 'detached_at': '', 'volume_id': '040300fa-4882-4b0e-93f0-5ebeb1d9c48a', 'serial': '040300fa-4882-4b0e-93f0-5ebeb1d9c48a'}, 'attachment_id': 'fd1b3626-8708-4c82-a086-10ba8847bba2', 'delete_on_termination': False, 'boot_index': 1, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None}, {'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oNXLTfHE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd15f23ae-f5a4-47cf-b136-7072c7838790', 'attached_at': '', 'detached_at': '', 'volume_id': 'f709d3df-9c5d-478b-b3c5-ecc33e581346', 'serial': 'f709d3df-9c5d-478b-b3c5-ecc33e581346'}, 'attachment_id': '6a5a656e-ff28-4c9d-8b8b-23047cb5fdb3', 'delete_on_termination': False, 'boot_index': 2, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:37:41 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:37:41 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:37:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:37:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:37:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:37:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:37:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:37:41 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:37:41 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:37:41 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:37:41 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:37:41 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:37:41 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:37:41 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:37:41 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:37:41 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:37:41 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:37:41 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:37:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:37:41 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EmrNuQjh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:37:41 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:37:41 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:37:41 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:37:41 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:37:41 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:37:41 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:37:41 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:37:41 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:41 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:41 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[9392ca9c-21a0-447b-8508-d12a8c6d7620]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:41 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:37:41 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:37:41 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:41 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:41 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f38b243-2805-404d-bf20-93318587e3b4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:41 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f] added
Aug 14 16:37:41 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:37:41 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[99108a91-3be5-43a8-8f91-e3bc8f9c8dbd]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdfc308-b3de-4f22-933c-602f6a02e648]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EmrNuQjh {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EmrNuQjh" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e0c5bb-6fc1-4211-845b-ef106efa392c]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EmrNuQjh'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c5784e-8009-4aaa-b21e-67d9a3d71276]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f427dd-057e-431d-a3a6-5aea3230c7bf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:37:42 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:37:42 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[834b060d-f756-4ac8-84a4-f81c04bfbdf5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f, portal: 172.16.0.220,3260]
Aug 14 16:37:42 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f, portal: 172.16.0.220,3260] successful.
Aug 14 16:37:42 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[10934e7c-ce23-4297-9a72-c493b0d32176]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[61def9f7-661a-41ca-bd24-cf88f0715831]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:37:42 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:37:42 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:37:42 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:37:42 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[1584acdf-5d81-4202-80ee-cee53b3c1292]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EmrNuQjh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:42 user nova-compute[73056]: INFO nova.virt.block_device [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Booting with volume 7ab4afa3-aa80-4d48-aced-b74ce8af207f at /dev/vdc
Aug 14 16:37:42 user nova-compute[73056]: DEBUG os_brick.utils [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5166ae-f1e3-41ef-bcbd-5d4d1dded92d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8064aa1-ef2e-43dd-9141-1a09235737ba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae9f8e5-d39d-4df5-b451-2b6121bae086]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[460138f3-7315-4bf9-bc94-e5315fc5121e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:37:42 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:37:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e164555-a9e7-4e1b-a442-b23aa81c2407]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG os_brick.utils [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:37:42 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Updating existing volume attachment record: 6cd68a71-be56-4a61-959f-8e5ef21e231f {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23837323565656635', 'path': '/dev/sdc'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837323565656635', 'path': '/dev/sdc'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QZTwFLJN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:37:43 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:37:43 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:37:43 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:37:43 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:37:43 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:37:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aca12e2-3973-43a6-bb1b-44679a0e5cf4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:37:43 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[67520658-a0d3-48d5-b537-4d277405410e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a] added
Aug 14 16:37:43 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6d82da-f714-4007-a690-e6f052e98159]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cdcf282-d88d-42af-b899-ad227c6991df]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QZTwFLJN {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QZTwFLJN" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[023e576d-aa50-453e-8a98-0345d7d0c4bf]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QZTwFLJN'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8515c9-8b39-4d08-8ec4-b9d0da188778]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a888c2-580d-49e7-9092-d12d87b0d03f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:37:43 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:37:43 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:37:43 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:37:43 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9215a49-9e4b-4562-a2c9-aeb0e1ad00b6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a, portal: 172.16.0.220,3260]
Aug 14 16:37:43 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a, portal: 172.16.0.220,3260] successful.
Aug 14 16:37:43 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f990b9-566b-4d37-bf3e-ddbdef25702e]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[228bea44-afec-4b2a-9668-7a6f86c4a198]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:37:43 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:37:43 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:37:43 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:37:43 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:37:43 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:37:43 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e217c70a-9629-4e4e-bd7b-993fe9ebe004]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:37:43 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QZTwFLJN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Acquiring lock "6c9c38ee-426d-4dcf-8720-7ad5fad8492d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Lock "6c9c38ee-426d-4dcf-8720-7ad5fad8492d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG nova.objects.instance [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Lazy-loading 'flavor' on Instance uuid 6c9c38ee-426d-4dcf-8720-7ad5fad8492d {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Lock "6c9c38ee-426d-4dcf-8720-7ad5fad8492d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.095s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23262356634646430', 'path': '/dev/sdd'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262356634646430', 'path': '/dev/sdd'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oNXLTfHE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:37:44 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:37:44 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:37:44 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:37:44 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.009s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:37:44 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4737fd-85ca-4088-aeed-3e35eba19d8a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:37:44 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Acquiring lock "6c9c38ee-426d-4dcf-8720-7ad5fad8492d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Lock "6c9c38ee-426d-4dcf-8720-7ad5fad8492d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:37:44 user nova-compute[73056]: INFO nova.compute.manager [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Attaching volume a33db5f4-8a1c-4fe0-91b4-30933f6bc016 to /dev/vdb
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9b0792-901a-437e-a68b-6cb84567e053]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346] added
Aug 14 16:37:44 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a40d0a-ff44-434f-85a8-2aa4e89cf7b7]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9c75f4-e48e-4f7e-8528-4dbe3439d126]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oNXLTfHE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG os_brick.utils [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oNXLTfHE" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[80102e81-e92a-4015-af37-6f3066f352a0]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oNXLTfHE'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee16ba62-7285-4eb6-8392-8db9c33b1c72]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c0797f-20ec-4ec6-83c7-8fe2eb9d23c3]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[890dc2da-e55f-4bff-88a1-1c927059d470]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[da76b0ee-1281-4fc5-8b7f-0a6e165ff845]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d641c0-ee9d-4c29-b183-339dc2e017a3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bcc268-a8c9-494c-b6d0-c07de2ecb6e4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:37:44 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:37:44 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:37:44 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:37:44 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:37:44 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:37:44 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:37:44 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1a433e-3560-4184-8b5a-35bf8438a8ea]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG os_brick.utils [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Updating existing volume attachment record: 72edd809-666d-4908-931d-b122eee24c61 {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cbb393-8a60-4b51-bcc7-45091c5650a1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346, portal: 172.16.0.220,3260]
Aug 14 16:37:44 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346, portal: 172.16.0.220,3260] successful.
Aug 14 16:37:44 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:37:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbd2195-501d-445c-af63-3bc3b4dff5e6]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:37:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eac8d89-3212-4969-b5f1-a1df906271d8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:37:45 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:37:45 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:37:45 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:37:45 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:37:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:37:45 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:37:45 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:37:45 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:37:45 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:37:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:37:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:37:45 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:37:45 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:37:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[8396b15c-1f42-4c31-a7cb-b5e2772c0de4]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:45 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:37:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oNXLTfHE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.422s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] <== connect_volume: return (1425ms) {'type': 'block', 'scsi_wwn': '26565303937386661', 'path': '/dev/sde'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565303937386661', 'path': '/dev/sde'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802533514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802533514',id=10,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbzTmfeZnkoTSmAI1r4E5kRdG5UwIoqyTDg413/OaV/+wRxXAc78iY7UpXYkMde2FmweqTVIQK1dSFwRjfSSDHLM1SWrj5/OU4A9+2sa7L/cEwqd5FK9hrf2mwDlgRx3g==',key_name='tempest-keypair-1403492348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b973979ba4d4dfbb0a5088e9017ffa4',ramdisk_id='',reservation_id='r-f2tummsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1118695598',owner_user_name='tempest-TaggedBootDevicesTest-1118695598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a104c41b03dc4828a4dd3313763e77dd',uuid=d15f23ae-f5a4-47cf-b136-7072c7838790,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c81e86e3-8261-441f-b7b1-145aa7740e08", "address": "fa:16:3e:80:07:c2", "network": {"id": "cffc94d2-2f90-4180-b640-81eac93db07e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-5276327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81e86e3-82", "ovs_interfaceid": "c81e86e3-8261-441f-b7b1-145aa7740e08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converting VIF {"id": "c81e86e3-8261-441f-b7b1-145aa7740e08", "address": "fa:16:3e:80:07:c2", "network": {"id": "cffc94d2-2f90-4180-b640-81eac93db07e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-5276327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81e86e3-82", "ovs_interfaceid": "c81e86e3-8261-441f-b7b1-145aa7740e08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:07:c2,bridge_name='br-int',has_traffic_filtering=True,id=c81e86e3-8261-441f-b7b1-145aa7740e08,network=Network(cffc94d2-2f90-4180-b640-81eac93db07e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc81e86e3-82') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802533514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802533514',id=10,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbzTmfeZnkoTSmAI1r4E5kRdG5UwIoqyTDg413/OaV/+wRxXAc78iY7UpXYkMde2FmweqTVIQK1dSFwRjfSSDHLM1SWrj5/OU4A9+2sa7L/cEwqd5FK9hrf2mwDlgRx3g==',key_name='tempest-keypair-1403492348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b973979ba4d4dfbb0a5088e9017ffa4',ramdisk_id='',reservation_id='r-f2tummsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1118695598',owner_user_name='tempest-TaggedBootDevicesTest-1118695598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a104c41b03dc4828a4dd3313763e77dd',uuid=d15f23ae-f5a4-47cf-b136-7072c7838790,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69edfecc-9201-4747-89e2-bd552f2616ed", "address": "fa:16:3e:b2:f1:d1", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69edfecc-92", "ovs_interfaceid": "69edfecc-9201-4747-89e2-bd552f2616ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converting VIF {"id": "69edfecc-9201-4747-89e2-bd552f2616ed", "address": "fa:16:3e:b2:f1:d1", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69edfecc-92", "ovs_interfaceid": "69edfecc-9201-4747-89e2-bd552f2616ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:f1:d1,bridge_name='br-int',has_traffic_filtering=True,id=69edfecc-9201-4747-89e2-bd552f2616ed,network=Network(49b33d8e-84cc-4c69-800d-395f46025327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap69edfecc-92') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802533514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802533514',id=10,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbzTmfeZnkoTSmAI1r4E5kRdG5UwIoqyTDg413/OaV/+wRxXAc78iY7UpXYkMde2FmweqTVIQK1dSFwRjfSSDHLM1SWrj5/OU4A9+2sa7L/cEwqd5FK9hrf2mwDlgRx3g==',key_name='tempest-keypair-1403492348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b973979ba4d4dfbb0a5088e9017ffa4',ramdisk_id='',reservation_id='r-f2tummsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1118695598',owner_user_name='tempest-TaggedBootDevicesTest-1118695598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a104c41b03dc4828a4dd3313763e77dd',uuid=d15f23ae-f5a4-47cf-b136-7072c7838790,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b70d8306-e1df-4d66-9949-8f156c902305", "address": "fa:16:3e:68:92:b2", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70d8306-e1", "ovs_interfaceid": "b70d8306-e1df-4d66-9949-8f156c902305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converting VIF {"id": "b70d8306-e1df-4d66-9949-8f156c902305", "address": "fa:16:3e:68:92:b2", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70d8306-e1", "ovs_interfaceid": "b70d8306-e1df-4d66-9949-8f156c902305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:92:b2,bridge_name='br-int',has_traffic_filtering=True,id=b70d8306-e1df-4d66-9949-8f156c902305,network=Network(49b33d8e-84cc-4c69-800d-395f46025327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb70d8306-e1') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802533514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802533514',id=10,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbzTmfeZnkoTSmAI1r4E5kRdG5UwIoqyTDg413/OaV/+wRxXAc78iY7UpXYkMde2FmweqTVIQK1dSFwRjfSSDHLM1SWrj5/OU4A9+2sa7L/cEwqd5FK9hrf2mwDlgRx3g==',key_name='tempest-keypair-1403492348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b973979ba4d4dfbb0a5088e9017ffa4',ramdisk_id='',reservation_id='r-f2tummsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1118695598',owner_user_name='tempest-TaggedBootDevicesTest-1118695598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a104c41b03dc4828a4dd3313763e77dd',uuid=d15f23ae-f5a4-47cf-b136-7072c7838790,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea9bf8ed-60e0-4563-893c-33135ea49823", "address": "fa:16:3e:63:bd:25", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9bf8ed-60", "ovs_interfaceid": "ea9bf8ed-60e0-4563-893c-33135ea49823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converting VIF {"id": "ea9bf8ed-60e0-4563-893c-33135ea49823", "address": "fa:16:3e:63:bd:25", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9bf8ed-60", "ovs_interfaceid": "ea9bf8ed-60e0-4563-893c-33135ea49823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:bd:25,bridge_name='br-int',has_traffic_filtering=True,id=ea9bf8ed-60e0-4563-893c-33135ea49823,network=Network(49b33d8e-84cc-4c69-800d-395f46025327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea9bf8ed-60') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802533514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802533514',id=10,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbzTmfeZnkoTSmAI1r4E5kRdG5UwIoqyTDg413/OaV/+wRxXAc78iY7UpXYkMde2FmweqTVIQK1dSFwRjfSSDHLM1SWrj5/OU4A9+2sa7L/cEwqd5FK9hrf2mwDlgRx3g==',key_name='tempest-keypair-1403492348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b973979ba4d4dfbb0a5088e9017ffa4',ramdisk_id='',reservation_id='r-f2tummsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1118695598',owner_user_name='tempest-TaggedBootDevicesTest-1118695598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a104c41b03dc4828a4dd3313763e77dd',uuid=d15f23ae-f5a4-47cf-b136-7072c7838790,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a54a741-25de-4758-921c-0b7e5c5730dd", "address": "fa:16:3e:bc:d6:2a", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a54a741-25", "ovs_interfaceid": "9a54a741-25de-4758-921c-0b7e5c5730dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converting VIF {"id": "9a54a741-25de-4758-921c-0b7e5c5730dd", "address": "fa:16:3e:bc:d6:2a", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a54a741-25", "ovs_interfaceid": "9a54a741-25de-4758-921c-0b7e5c5730dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:d6:2a,bridge_name='br-int',has_traffic_filtering=True,id=9a54a741-25de-4758-921c-0b7e5c5730dd,network=Network(49b33d8e-84cc-4c69-800d-395f46025327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a54a741-25') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802533514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802533514',id=10,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbzTmfeZnkoTSmAI1r4E5kRdG5UwIoqyTDg413/OaV/+wRxXAc78iY7UpXYkMde2FmweqTVIQK1dSFwRjfSSDHLM1SWrj5/OU4A9+2sa7L/cEwqd5FK9hrf2mwDlgRx3g==',key_name='tempest-keypair-1403492348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b973979ba4d4dfbb0a5088e9017ffa4',ramdisk_id='',reservation_id='r-f2tummsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1118695598',owner_user_name='tempest-TaggedBootDevicesTest-1118695598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a104c41b03dc4828a4dd3313763e77dd',uuid=d15f23ae-f5a4-47cf-b136-7072c7838790,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e2daf22-7953-47ca-b2c6-98a1f0b00b72", "address": "fa:16:3e:b2:04:50", "network": {"id": "0cdd5be6-368d-4088-ad0c-d696845f9579", "bridge": "br-int", "label": "tempest-device-tagging-net2-999697901", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e2daf22-79", "ovs_interfaceid": "4e2daf22-7953-47ca-b2c6-98a1f0b00b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converting VIF {"id": "4e2daf22-7953-47ca-b2c6-98a1f0b00b72", "address": "fa:16:3e:b2:04:50", "network": {"id": "0cdd5be6-368d-4088-ad0c-d696845f9579", "bridge": "br-int", "label": "tempest-device-tagging-net2-999697901", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e2daf22-79", "ovs_interfaceid": "4e2daf22-7953-47ca-b2c6-98a1f0b00b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:04:50,bridge_name='br-int',has_traffic_filtering=True,id=4e2daf22-7953-47ca-b2c6-98a1f0b00b72,network=Network(0cdd5be6-368d-4088-ad0c-d696845f9579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e2daf22-79') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802533514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802533514',id=10,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbzTmfeZnkoTSmAI1r4E5kRdG5UwIoqyTDg413/OaV/+wRxXAc78iY7UpXYkMde2FmweqTVIQK1dSFwRjfSSDHLM1SWrj5/OU4A9+2sa7L/cEwqd5FK9hrf2mwDlgRx3g==',key_name='tempest-keypair-1403492348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b973979ba4d4dfbb0a5088e9017ffa4',ramdisk_id='',reservation_id='r-f2tummsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1118695598',owner_user_name='tempest-TaggedBootDevicesTest-1118695598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a104c41b03dc4828a4dd3313763e77dd',uuid=d15f23ae-f5a4-47cf-b136-7072c7838790,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee13669b-f42c-4ca6-84e9-c95e35048ffc", "address": "fa:16:3e:28:49:8c", "network": {"id": "0cdd5be6-368d-4088-ad0c-d696845f9579", "bridge": "br-int", "label": "tempest-device-tagging-net2-999697901", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee13669b-f4", "ovs_interfaceid": "ee13669b-f42c-4ca6-84e9-c95e35048ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converting VIF {"id": "ee13669b-f42c-4ca6-84e9-c95e35048ffc", "address": "fa:16:3e:28:49:8c", "network": {"id": "0cdd5be6-368d-4088-ad0c-d696845f9579", "bridge": "br-int", "label": "tempest-device-tagging-net2-999697901", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee13669b-f4", "ovs_interfaceid": "ee13669b-f42c-4ca6-84e9-c95e35048ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:49:8c,bridge_name='br-int',has_traffic_filtering=True,id=ee13669b-f42c-4ca6-84e9-c95e35048ffc,network=Network(0cdd5be6-368d-4088-ad0c-d696845f9579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee13669b-f4') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.objects.instance [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Lazy-loading 'pci_devices' on Instance uuid d15f23ae-f5a4-47cf-b136-7072c7838790 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:37:46 user nova-compute[73056]:   <uuid>d15f23ae-f5a4-47cf-b136-7072c7838790</uuid>
Aug 14 16:37:46 user nova-compute[73056]:   <name>instance-0000000a</name>
Aug 14 16:37:46 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:37:46 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:37:46 user nova-compute[73056]:   <metadata>
Aug 14 16:37:46 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:37:46 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:37:46 user nova-compute[73056]:       <nova:name>tempest-device-tagging-server-1802533514</nova:name>
Aug 14 16:37:46 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:37:41</nova:creationTime>
Aug 14 16:37:46 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:37:46 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:37:46 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:37:46 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:37:46 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:37:46 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:37:46 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:37:46 user nova-compute[73056]:       <nova:owner>
Aug 14 16:37:46 user nova-compute[73056]:         <nova:user uuid="a104c41b03dc4828a4dd3313763e77dd">tempest-TaggedBootDevicesTest-1118695598-project-member</nova:user>
Aug 14 16:37:46 user nova-compute[73056]:         <nova:project uuid="1b973979ba4d4dfbb0a5088e9017ffa4">tempest-TaggedBootDevicesTest-1118695598</nova:project>
Aug 14 16:37:46 user nova-compute[73056]:       </nova:owner>
Aug 14 16:37:46 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:37:46 user nova-compute[73056]:       <nova:ports>
Aug 14 16:37:46 user nova-compute[73056]:         <nova:port uuid="c81e86e3-8261-441f-b7b1-145aa7740e08">
Aug 14 16:37:46 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 14 16:37:46 user nova-compute[73056]:         </nova:port>
Aug 14 16:37:46 user nova-compute[73056]:         <nova:port uuid="69edfecc-9201-4747-89e2-bd552f2616ed">
Aug 14 16:37:46 user nova-compute[73056]:           <nova:ip type="fixed" address="10.1.1.147" ipVersion="4"/>
Aug 14 16:37:46 user nova-compute[73056]:         </nova:port>
Aug 14 16:37:46 user nova-compute[73056]:         <nova:port uuid="b70d8306-e1df-4d66-9949-8f156c902305">
Aug 14 16:37:46 user nova-compute[73056]:           <nova:ip type="fixed" address="10.1.1.41" ipVersion="4"/>
Aug 14 16:37:46 user nova-compute[73056]:         </nova:port>
Aug 14 16:37:46 user nova-compute[73056]:         <nova:port uuid="ea9bf8ed-60e0-4563-893c-33135ea49823">
Aug 14 16:37:46 user nova-compute[73056]:           <nova:ip type="fixed" address="10.1.1.172" ipVersion="4"/>
Aug 14 16:37:46 user nova-compute[73056]:         </nova:port>
Aug 14 16:37:46 user nova-compute[73056]:         <nova:port uuid="9a54a741-25de-4758-921c-0b7e5c5730dd">
Aug 14 16:37:46 user nova-compute[73056]:           <nova:ip type="fixed" address="10.1.1.153" ipVersion="4"/>
Aug 14 16:37:46 user nova-compute[73056]:         </nova:port>
Aug 14 16:37:46 user nova-compute[73056]:         <nova:port uuid="4e2daf22-7953-47ca-b2c6-98a1f0b00b72">
Aug 14 16:37:46 user nova-compute[73056]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 14 16:37:46 user nova-compute[73056]:         </nova:port>
Aug 14 16:37:46 user nova-compute[73056]:         <nova:port uuid="ee13669b-f42c-4ca6-84e9-c95e35048ffc">
Aug 14 16:37:46 user nova-compute[73056]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 14 16:37:46 user nova-compute[73056]:         </nova:port>
Aug 14 16:37:46 user nova-compute[73056]:       </nova:ports>
Aug 14 16:37:46 user nova-compute[73056]:     </nova:instance>
Aug 14 16:37:46 user nova-compute[73056]:   </metadata>
Aug 14 16:37:46 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:37:46 user nova-compute[73056]:     <system>
Aug 14 16:37:46 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:37:46 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:37:46 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:37:46 user nova-compute[73056]:       <entry name="serial">d15f23ae-f5a4-47cf-b136-7072c7838790</entry>
Aug 14 16:37:46 user nova-compute[73056]:       <entry name="uuid">d15f23ae-f5a4-47cf-b136-7072c7838790</entry>
Aug 14 16:37:46 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:37:46 user nova-compute[73056]:     </system>
Aug 14 16:37:46 user nova-compute[73056]:   </sysinfo>
Aug 14 16:37:46 user nova-compute[73056]:   <os>
Aug 14 16:37:46 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:37:46 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:37:46 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:37:46 user nova-compute[73056]:   </os>
Aug 14 16:37:46 user nova-compute[73056]:   <features>
Aug 14 16:37:46 user nova-compute[73056]:     <acpi/>
Aug 14 16:37:46 user nova-compute[73056]:     <apic/>
Aug 14 16:37:46 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:37:46 user nova-compute[73056]:   </features>
Aug 14 16:37:46 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:37:46 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:37:46 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:37:46 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:37:46 user nova-compute[73056]:   </clock>
Aug 14 16:37:46 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:37:46 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:37:46 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:37:46 user nova-compute[73056]:   </cpu>
Aug 14 16:37:46 user nova-compute[73056]:   <devices>
Aug 14 16:37:46 user nova-compute[73056]:     <disk type="file" device="cdrom">
Aug 14 16:37:46 user nova-compute[73056]:       <driver name="qemu" type="raw" cache="none"/>
Aug 14 16:37:46 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/d15f23ae-f5a4-47cf-b136-7072c7838790/disk.config"/>
Aug 14 16:37:46 user nova-compute[73056]:       <target dev="hda" bus="ide"/>
Aug 14 16:37:46 user nova-compute[73056]:     </disk>
Aug 14 16:37:46 user nova-compute[73056]:     <disk type="block" device="disk">
Aug 14 16:37:46 user nova-compute[73056]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:37:46 user nova-compute[73056]:       <source dev="/dev/sdc"/>
Aug 14 16:37:46 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:37:46 user nova-compute[73056]:       <serial>957e6707-8ee8-47f6-8191-969f2f44496f</serial>
Aug 14 16:37:46 user nova-compute[73056]:     </disk>
Aug 14 16:37:46 user nova-compute[73056]:     <disk type="block" device="disk">
Aug 14 16:37:46 user nova-compute[73056]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:37:46 user nova-compute[73056]:       <source dev="/dev/sdd"/>
Aug 14 16:37:46 user nova-compute[73056]:       <target dev="vdb" bus="virtio"/>
Aug 14 16:37:46 user nova-compute[73056]:       <serial>040300fa-4882-4b0e-93f0-5ebeb1d9c48a</serial>
Aug 14 16:37:46 user nova-compute[73056]:     </disk>
Aug 14 16:37:46 user nova-compute[73056]:     <disk type="block" device="disk">
Aug 14 16:37:46 user nova-compute[73056]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:37:46 user nova-compute[73056]:       <source dev="/dev/sde"/>
Aug 14 16:37:46 user nova-compute[73056]:       <target dev="vdc" bus="virtio"/>
Aug 14 16:37:46 user nova-compute[73056]:       <serial>f709d3df-9c5d-478b-b3c5-ecc33e581346</serial>
Aug 14 16:37:46 user nova-compute[73056]:     </disk>
Aug 14 16:37:46 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:37:46 user nova-compute[73056]:       <mac address="fa:16:3e:80:07:c2"/>
Aug 14 16:37:46 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:37:46 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:37:46 user nova-compute[73056]:       <target dev="tapc81e86e3-82"/>
Aug 14 16:37:46 user nova-compute[73056]:     </interface>
Aug 14 16:37:46 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:37:46 user nova-compute[73056]:       <mac address="fa:16:3e:b2:f1:d1"/>
Aug 14 16:37:46 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:37:46 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:37:46 user nova-compute[73056]:       <target dev="tap69edfecc-92"/>
Aug 14 16:37:46 user nova-compute[73056]:     </interface>
Aug 14 16:37:46 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:37:46 user nova-compute[73056]:       <mac address="fa:16:3e:68:92:b2"/>
Aug 14 16:37:46 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:37:46 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:37:46 user nova-compute[73056]:       <target dev="tapb70d8306-e1"/>
Aug 14 16:37:46 user nova-compute[73056]:     </interface>
Aug 14 16:37:46 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:37:46 user nova-compute[73056]:       <mac address="fa:16:3e:63:bd:25"/>
Aug 14 16:37:46 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:37:46 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:37:46 user nova-compute[73056]:       <target dev="tapea9bf8ed-60"/>
Aug 14 16:37:46 user nova-compute[73056]:     </interface>
Aug 14 16:37:46 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:37:46 user nova-compute[73056]:       <mac address="fa:16:3e:bc:d6:2a"/>
Aug 14 16:37:46 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:37:46 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:37:46 user nova-compute[73056]:       <target dev="tap9a54a741-25"/>
Aug 14 16:37:46 user nova-compute[73056]:     </interface>
Aug 14 16:37:46 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:37:46 user nova-compute[73056]:       <mac address="fa:16:3e:b2:04:50"/>
Aug 14 16:37:46 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:37:46 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:37:46 user nova-compute[73056]:       <target dev="tap4e2daf22-79"/>
Aug 14 16:37:46 user nova-compute[73056]:     </interface>
Aug 14 16:37:46 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:37:46 user nova-compute[73056]:       <mac address="fa:16:3e:28:49:8c"/>
Aug 14 16:37:46 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:37:46 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:37:46 user nova-compute[73056]:       <target dev="tapee13669b-f4"/>
Aug 14 16:37:46 user nova-compute[73056]:     </interface>
Aug 14 16:37:46 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:37:46 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/d15f23ae-f5a4-47cf-b136-7072c7838790/console.log" append="off"/>
Aug 14 16:37:46 user nova-compute[73056]:     </serial>
Aug 14 16:37:46 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:37:46 user nova-compute[73056]:     <video>
Aug 14 16:37:46 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:37:46 user nova-compute[73056]:     </video>
Aug 14 16:37:46 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:37:46 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:37:46 user nova-compute[73056]:     </rng>
Aug 14 16:37:46 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:37:46 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:37:46 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:37:46 user nova-compute[73056]:     </memballoon>
Aug 14 16:37:46 user nova-compute[73056]:   </devices>
Aug 14 16:37:46 user nova-compute[73056]: </domain>
Aug 14 16:37:46 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802533514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802533514',id=10,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbzTmfeZnkoTSmAI1r4E5kRdG5UwIoqyTDg413/OaV/+wRxXAc78iY7UpXYkMde2FmweqTVIQK1dSFwRjfSSDHLM1SWrj5/OU4A9+2sa7L/cEwqd5FK9hrf2mwDlgRx3g==',key_name='tempest-keypair-1403492348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b973979ba4d4dfbb0a5088e9017ffa4',ramdisk_id='',reservation_id='r-f2tummsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1118695598',owner_user_name='tempest-TaggedBootDevicesTest-1118695598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a104c41b03dc4828a4dd3313763e77dd',uuid=d15f23ae-f5a4-47cf-b136-7072c7838790,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c81e86e3-8261-441f-b7b1-145aa7740e08", "address": "fa:16:3e:80:07:c2", "network": {"id": "cffc94d2-2f90-4180-b640-81eac93db07e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-5276327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81e86e3-82", "ovs_interfaceid": "c81e86e3-8261-441f-b7b1-145aa7740e08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converting VIF {"id": "c81e86e3-8261-441f-b7b1-145aa7740e08", "address": "fa:16:3e:80:07:c2", "network": {"id": "cffc94d2-2f90-4180-b640-81eac93db07e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-5276327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81e86e3-82", "ovs_interfaceid": "c81e86e3-8261-441f-b7b1-145aa7740e08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:07:c2,bridge_name='br-int',has_traffic_filtering=True,id=c81e86e3-8261-441f-b7b1-145aa7740e08,network=Network(cffc94d2-2f90-4180-b640-81eac93db07e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc81e86e3-82') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG os_vif [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:07:c2,bridge_name='br-int',has_traffic_filtering=True,id=c81e86e3-8261-441f-b7b1-145aa7740e08,network=Network(cffc94d2-2f90-4180-b640-81eac93db07e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc81e86e3-82') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc81e86e3-82, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc81e86e3-82, col_values=(('external_ids', {'iface-id': 'c81e86e3-8261-441f-b7b1-145aa7740e08', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:07:c2', 'vm-uuid': 'd15f23ae-f5a4-47cf-b136-7072c7838790'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:46 user nova-compute[73056]: INFO os_vif [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:07:c2,bridge_name='br-int',has_traffic_filtering=True,id=c81e86e3-8261-441f-b7b1-145aa7740e08,network=Network(cffc94d2-2f90-4180-b640-81eac93db07e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc81e86e3-82')
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802533514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802533514',id=10,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbzTmfeZnkoTSmAI1r4E5kRdG5UwIoqyTDg413/OaV/+wRxXAc78iY7UpXYkMde2FmweqTVIQK1dSFwRjfSSDHLM1SWrj5/OU4A9+2sa7L/cEwqd5FK9hrf2mwDlgRx3g==',key_name='tempest-keypair-1403492348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b973979ba4d4dfbb0a5088e9017ffa4',ramdisk_id='',reservation_id='r-f2tummsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1118695598',owner_user_name='tempest-TaggedBootDevicesTest-1118695598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a104c41b03dc4828a4dd3313763e77dd',uuid=d15f23ae-f5a4-47cf-b136-7072c7838790,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69edfecc-9201-4747-89e2-bd552f2616ed", "address": "fa:16:3e:b2:f1:d1", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69edfecc-92", "ovs_interfaceid": "69edfecc-9201-4747-89e2-bd552f2616ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converting VIF {"id": "69edfecc-9201-4747-89e2-bd552f2616ed", "address": "fa:16:3e:b2:f1:d1", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69edfecc-92", "ovs_interfaceid": "69edfecc-9201-4747-89e2-bd552f2616ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:f1:d1,bridge_name='br-int',has_traffic_filtering=True,id=69edfecc-9201-4747-89e2-bd552f2616ed,network=Network(49b33d8e-84cc-4c69-800d-395f46025327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap69edfecc-92') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG os_vif [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:f1:d1,bridge_name='br-int',has_traffic_filtering=True,id=69edfecc-9201-4747-89e2-bd552f2616ed,network=Network(49b33d8e-84cc-4c69-800d-395f46025327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap69edfecc-92') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69edfecc-92, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap69edfecc-92, col_values=(('external_ids', {'iface-id': '69edfecc-9201-4747-89e2-bd552f2616ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:f1:d1', 'vm-uuid': 'd15f23ae-f5a4-47cf-b136-7072c7838790'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:46 user nova-compute[73056]: INFO os_vif [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:f1:d1,bridge_name='br-int',has_traffic_filtering=True,id=69edfecc-9201-4747-89e2-bd552f2616ed,network=Network(49b33d8e-84cc-4c69-800d-395f46025327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap69edfecc-92')
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802533514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802533514',id=10,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbzTmfeZnkoTSmAI1r4E5kRdG5UwIoqyTDg413/OaV/+wRxXAc78iY7UpXYkMde2FmweqTVIQK1dSFwRjfSSDHLM1SWrj5/OU4A9+2sa7L/cEwqd5FK9hrf2mwDlgRx3g==',key_name='tempest-keypair-1403492348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b973979ba4d4dfbb0a5088e9017ffa4',ramdisk_id='',reservation_id='r-f2tummsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1118695598',owner_user_name='tempest-TaggedBootDevicesTest-1118695598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a104c41b03dc4828a4dd3313763e77dd',uuid=d15f23ae-f5a4-47cf-b136-7072c7838790,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b70d8306-e1df-4d66-9949-8f156c902305", "address": "fa:16:3e:68:92:b2", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70d8306-e1", "ovs_interfaceid": "b70d8306-e1df-4d66-9949-8f156c902305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converting VIF {"id": "b70d8306-e1df-4d66-9949-8f156c902305", "address": "fa:16:3e:68:92:b2", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70d8306-e1", "ovs_interfaceid": "b70d8306-e1df-4d66-9949-8f156c902305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:92:b2,bridge_name='br-int',has_traffic_filtering=True,id=b70d8306-e1df-4d66-9949-8f156c902305,network=Network(49b33d8e-84cc-4c69-800d-395f46025327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb70d8306-e1') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG os_vif [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:92:b2,bridge_name='br-int',has_traffic_filtering=True,id=b70d8306-e1df-4d66-9949-8f156c902305,network=Network(49b33d8e-84cc-4c69-800d-395f46025327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb70d8306-e1') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb70d8306-e1, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb70d8306-e1, col_values=(('external_ids', {'iface-id': 'b70d8306-e1df-4d66-9949-8f156c902305', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:92:b2', 'vm-uuid': 'd15f23ae-f5a4-47cf-b136-7072c7838790'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:46 user nova-compute[73056]: INFO os_vif [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:92:b2,bridge_name='br-int',has_traffic_filtering=True,id=b70d8306-e1df-4d66-9949-8f156c902305,network=Network(49b33d8e-84cc-4c69-800d-395f46025327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb70d8306-e1')
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802533514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802533514',id=10,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbzTmfeZnkoTSmAI1r4E5kRdG5UwIoqyTDg413/OaV/+wRxXAc78iY7UpXYkMde2FmweqTVIQK1dSFwRjfSSDHLM1SWrj5/OU4A9+2sa7L/cEwqd5FK9hrf2mwDlgRx3g==',key_name='tempest-keypair-1403492348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b973979ba4d4dfbb0a5088e9017ffa4',ramdisk_id='',reservation_id='r-f2tummsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1118695598',owner_user_name='tempest-TaggedBootDevicesTest-1118695598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a104c41b03dc4828a4dd3313763e77dd',uuid=d15f23ae-f5a4-47cf-b136-7072c7838790,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea9bf8ed-60e0-4563-893c-33135ea49823", "address": "fa:16:3e:63:bd:25", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9bf8ed-60", "ovs_interfaceid": "ea9bf8ed-60e0-4563-893c-33135ea49823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converting VIF {"id": "ea9bf8ed-60e0-4563-893c-33135ea49823", "address": "fa:16:3e:63:bd:25", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9bf8ed-60", "ovs_interfaceid": "ea9bf8ed-60e0-4563-893c-33135ea49823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:bd:25,bridge_name='br-int',has_traffic_filtering=True,id=ea9bf8ed-60e0-4563-893c-33135ea49823,network=Network(49b33d8e-84cc-4c69-800d-395f46025327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea9bf8ed-60') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG os_vif [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:bd:25,bridge_name='br-int',has_traffic_filtering=True,id=ea9bf8ed-60e0-4563-893c-33135ea49823,network=Network(49b33d8e-84cc-4c69-800d-395f46025327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea9bf8ed-60') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea9bf8ed-60, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapea9bf8ed-60, col_values=(('external_ids', {'iface-id': 'ea9bf8ed-60e0-4563-893c-33135ea49823', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:bd:25', 'vm-uuid': 'd15f23ae-f5a4-47cf-b136-7072c7838790'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:46 user nova-compute[73056]: INFO os_vif [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:bd:25,bridge_name='br-int',has_traffic_filtering=True,id=ea9bf8ed-60e0-4563-893c-33135ea49823,network=Network(49b33d8e-84cc-4c69-800d-395f46025327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea9bf8ed-60')
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802533514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802533514',id=10,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbzTmfeZnkoTSmAI1r4E5kRdG5UwIoqyTDg413/OaV/+wRxXAc78iY7UpXYkMde2FmweqTVIQK1dSFwRjfSSDHLM1SWrj5/OU4A9+2sa7L/cEwqd5FK9hrf2mwDlgRx3g==',key_name='tempest-keypair-1403492348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b973979ba4d4dfbb0a5088e9017ffa4',ramdisk_id='',reservation_id='r-f2tummsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1118695598',owner_user_name='tempest-TaggedBootDevicesTest-1118695598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a104c41b03dc4828a4dd3313763e77dd',uuid=d15f23ae-f5a4-47cf-b136-7072c7838790,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a54a741-25de-4758-921c-0b7e5c5730dd", "address": "fa:16:3e:bc:d6:2a", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a54a741-25", "ovs_interfaceid": "9a54a741-25de-4758-921c-0b7e5c5730dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converting VIF {"id": "9a54a741-25de-4758-921c-0b7e5c5730dd", "address": "fa:16:3e:bc:d6:2a", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a54a741-25", "ovs_interfaceid": "9a54a741-25de-4758-921c-0b7e5c5730dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:d6:2a,bridge_name='br-int',has_traffic_filtering=True,id=9a54a741-25de-4758-921c-0b7e5c5730dd,network=Network(49b33d8e-84cc-4c69-800d-395f46025327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a54a741-25') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG os_vif [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:d6:2a,bridge_name='br-int',has_traffic_filtering=True,id=9a54a741-25de-4758-921c-0b7e5c5730dd,network=Network(49b33d8e-84cc-4c69-800d-395f46025327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a54a741-25') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a54a741-25, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9a54a741-25, col_values=(('external_ids', {'iface-id': '9a54a741-25de-4758-921c-0b7e5c5730dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:d6:2a', 'vm-uuid': 'd15f23ae-f5a4-47cf-b136-7072c7838790'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:46 user nova-compute[73056]: INFO os_vif [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:d6:2a,bridge_name='br-int',has_traffic_filtering=True,id=9a54a741-25de-4758-921c-0b7e5c5730dd,network=Network(49b33d8e-84cc-4c69-800d-395f46025327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a54a741-25')
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802533514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802533514',id=10,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbzTmfeZnkoTSmAI1r4E5kRdG5UwIoqyTDg413/OaV/+wRxXAc78iY7UpXYkMde2FmweqTVIQK1dSFwRjfSSDHLM1SWrj5/OU4A9+2sa7L/cEwqd5FK9hrf2mwDlgRx3g==',key_name='tempest-keypair-1403492348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b973979ba4d4dfbb0a5088e9017ffa4',ramdisk_id='',reservation_id='r-f2tummsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1118695598',owner_user_name='tempest-TaggedBootDevicesTest-1118695598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a104c41b03dc4828a4dd3313763e77dd',uuid=d15f23ae-f5a4-47cf-b136-7072c7838790,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e2daf22-7953-47ca-b2c6-98a1f0b00b72", "address": "fa:16:3e:b2:04:50", "network": {"id": "0cdd5be6-368d-4088-ad0c-d696845f9579", "bridge": "br-int", "label": "tempest-device-tagging-net2-999697901", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e2daf22-79", "ovs_interfaceid": "4e2daf22-7953-47ca-b2c6-98a1f0b00b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converting VIF {"id": "4e2daf22-7953-47ca-b2c6-98a1f0b00b72", "address": "fa:16:3e:b2:04:50", "network": {"id": "0cdd5be6-368d-4088-ad0c-d696845f9579", "bridge": "br-int", "label": "tempest-device-tagging-net2-999697901", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e2daf22-79", "ovs_interfaceid": "4e2daf22-7953-47ca-b2c6-98a1f0b00b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:04:50,bridge_name='br-int',has_traffic_filtering=True,id=4e2daf22-7953-47ca-b2c6-98a1f0b00b72,network=Network(0cdd5be6-368d-4088-ad0c-d696845f9579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e2daf22-79') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG os_vif [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:04:50,bridge_name='br-int',has_traffic_filtering=True,id=4e2daf22-7953-47ca-b2c6-98a1f0b00b72,network=Network(0cdd5be6-368d-4088-ad0c-d696845f9579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e2daf22-79') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e2daf22-79, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4e2daf22-79, col_values=(('external_ids', {'iface-id': '4e2daf22-7953-47ca-b2c6-98a1f0b00b72', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:04:50', 'vm-uuid': 'd15f23ae-f5a4-47cf-b136-7072c7838790'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:46 user nova-compute[73056]: INFO os_vif [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:04:50,bridge_name='br-int',has_traffic_filtering=True,id=4e2daf22-7953-47ca-b2c6-98a1f0b00b72,network=Network(0cdd5be6-368d-4088-ad0c-d696845f9579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e2daf22-79')
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802533514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802533514',id=10,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbzTmfeZnkoTSmAI1r4E5kRdG5UwIoqyTDg413/OaV/+wRxXAc78iY7UpXYkMde2FmweqTVIQK1dSFwRjfSSDHLM1SWrj5/OU4A9+2sa7L/cEwqd5FK9hrf2mwDlgRx3g==',key_name='tempest-keypair-1403492348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b973979ba4d4dfbb0a5088e9017ffa4',ramdisk_id='',reservation_id='r-f2tummsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1118695598',owner_user_name='tempest-TaggedBootDevicesTest-1118695598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a104c41b03dc4828a4dd3313763e77dd',uuid=d15f23ae-f5a4-47cf-b136-7072c7838790,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee13669b-f42c-4ca6-84e9-c95e35048ffc", "address": "fa:16:3e:28:49:8c", "network": {"id": "0cdd5be6-368d-4088-ad0c-d696845f9579", "bridge": "br-int", "label": "tempest-device-tagging-net2-999697901", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee13669b-f4", "ovs_interfaceid": "ee13669b-f42c-4ca6-84e9-c95e35048ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converting VIF {"id": "ee13669b-f42c-4ca6-84e9-c95e35048ffc", "address": "fa:16:3e:28:49:8c", "network": {"id": "0cdd5be6-368d-4088-ad0c-d696845f9579", "bridge": "br-int", "label": "tempest-device-tagging-net2-999697901", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee13669b-f4", "ovs_interfaceid": "ee13669b-f42c-4ca6-84e9-c95e35048ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:49:8c,bridge_name='br-int',has_traffic_filtering=True,id=ee13669b-f42c-4ca6-84e9-c95e35048ffc,network=Network(0cdd5be6-368d-4088-ad0c-d696845f9579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee13669b-f4') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG os_vif [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:49:8c,bridge_name='br-int',has_traffic_filtering=True,id=ee13669b-f42c-4ca6-84e9-c95e35048ffc,network=Network(0cdd5be6-368d-4088-ad0c-d696845f9579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee13669b-f4') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee13669b-f4, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapee13669b-f4, col_values=(('external_ids', {'iface-id': 'ee13669b-f42c-4ca6-84e9-c95e35048ffc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:49:8c', 'vm-uuid': 'd15f23ae-f5a4-47cf-b136-7072c7838790'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:46 user nova-compute[73056]: INFO os_vif [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:49:8c,bridge_name='br-int',has_traffic_filtering=True,id=ee13669b-f42c-4ca6-84e9-c95e35048ffc,network=Network(0cdd5be6-368d-4088-ad0c-d696845f9579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee13669b-f4')
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] No BDM found with device name hda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] No VIF found with MAC fa:16:3e:80:07:c2, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] No VIF found with MAC fa:16:3e:bc:d6:2a, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:37:46 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Using config drive
Aug 14 16:37:46 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Creating config drive at /opt/stack/data/nova/instances/d15f23ae-f5a4-47cf-b136-7072c7838790/disk.config
Aug 14 16:37:46 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d15f23ae-f5a4-47cf-b136-7072c7838790/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8i96vxvr {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:46 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d15f23ae-f5a4-47cf-b136-7072c7838790/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8i96vxvr" returned: 0 in 0.053s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:47 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:37:47 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:37:47 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 16:37:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:48 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:37:48 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:37:48 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:37:48 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 16:37:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:48 user nova-compute[73056]: DEBUG nova.compute.manager [req-1f65829e-ca49-423f-ad57-e337bb9cbf6e req-68d6fd1b-7320-48b5-91b4-822dcb96747c service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-vif-plugged-c81e86e3-8261-441f-b7b1-145aa7740e08 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:37:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1f65829e-ca49-423f-ad57-e337bb9cbf6e req-68d6fd1b-7320-48b5-91b4-822dcb96747c service nova] Acquiring lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:37:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1f65829e-ca49-423f-ad57-e337bb9cbf6e req-68d6fd1b-7320-48b5-91b4-822dcb96747c service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:37:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1f65829e-ca49-423f-ad57-e337bb9cbf6e req-68d6fd1b-7320-48b5-91b4-822dcb96747c service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:48 user nova-compute[73056]: DEBUG nova.compute.manager [req-1f65829e-ca49-423f-ad57-e337bb9cbf6e req-68d6fd1b-7320-48b5-91b4-822dcb96747c service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] No waiting events found dispatching network-vif-plugged-c81e86e3-8261-441f-b7b1-145aa7740e08 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:37:48 user nova-compute[73056]: WARNING nova.compute.manager [req-1f65829e-ca49-423f-ad57-e337bb9cbf6e req-68d6fd1b-7320-48b5-91b4-822dcb96747c service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received unexpected event network-vif-plugged-c81e86e3-8261-441f-b7b1-145aa7740e08 for instance with vm_state building and task_state spawning.
Aug 14 16:37:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-9f3a7f8a-e3b9-4918-9663-968677fe5c90" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:37:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-9f3a7f8a-e3b9-4918-9663-968677fe5c90" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:37:48 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 16:37:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:49 user nova-compute[73056]: DEBUG nova.compute.manager [req-9ee65552-85bf-4935-b71a-fb5d4186721a req-3c03d078-3b51-4be0-b0a6-1940f5d24f83 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-vif-plugged-b70d8306-e1df-4d66-9949-8f156c902305 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:37:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9ee65552-85bf-4935-b71a-fb5d4186721a req-3c03d078-3b51-4be0-b0a6-1940f5d24f83 service nova] Acquiring lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:37:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9ee65552-85bf-4935-b71a-fb5d4186721a req-3c03d078-3b51-4be0-b0a6-1940f5d24f83 service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:37:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9ee65552-85bf-4935-b71a-fb5d4186721a req-3c03d078-3b51-4be0-b0a6-1940f5d24f83 service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:49 user nova-compute[73056]: DEBUG nova.compute.manager [req-9ee65552-85bf-4935-b71a-fb5d4186721a req-3c03d078-3b51-4be0-b0a6-1940f5d24f83 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] No waiting events found dispatching network-vif-plugged-b70d8306-e1df-4d66-9949-8f156c902305 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:37:49 user nova-compute[73056]: WARNING nova.compute.manager [req-9ee65552-85bf-4935-b71a-fb5d4186721a req-3c03d078-3b51-4be0-b0a6-1940f5d24f83 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received unexpected event network-vif-plugged-b70d8306-e1df-4d66-9949-8f156c902305 for instance with vm_state building and task_state spawning.
Aug 14 16:37:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:49 user nova-compute[73056]: DEBUG nova.compute.manager [req-45bac4a7-6090-46f4-baa7-b8d073ac1dbc req-a0b62f19-f715-43df-9eee-527abfb1f5e2 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-vif-plugged-69edfecc-9201-4747-89e2-bd552f2616ed {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:37:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-45bac4a7-6090-46f4-baa7-b8d073ac1dbc req-a0b62f19-f715-43df-9eee-527abfb1f5e2 service nova] Acquiring lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:37:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-45bac4a7-6090-46f4-baa7-b8d073ac1dbc req-a0b62f19-f715-43df-9eee-527abfb1f5e2 service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:37:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-45bac4a7-6090-46f4-baa7-b8d073ac1dbc req-a0b62f19-f715-43df-9eee-527abfb1f5e2 service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:49 user nova-compute[73056]: DEBUG nova.compute.manager [req-45bac4a7-6090-46f4-baa7-b8d073ac1dbc req-a0b62f19-f715-43df-9eee-527abfb1f5e2 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] No waiting events found dispatching network-vif-plugged-69edfecc-9201-4747-89e2-bd552f2616ed {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:37:49 user nova-compute[73056]: WARNING nova.compute.manager [req-45bac4a7-6090-46f4-baa7-b8d073ac1dbc req-a0b62f19-f715-43df-9eee-527abfb1f5e2 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received unexpected event network-vif-plugged-69edfecc-9201-4747-89e2-bd552f2616ed for instance with vm_state building and task_state spawning.
Aug 14 16:37:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:50 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Updating instance_info_cache with network_info: [{"id": "312bec25-d19f-423b-aca3-a4117119fc1f", "address": "fa:16:3e:03:ce:11", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312bec25-d1", "ovs_interfaceid": "312bec25-d19f-423b-aca3-a4117119fc1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:37:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-9f3a7f8a-e3b9-4918-9663-968677fe5c90" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:37:50 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 16:37:50 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:37:50 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:37:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:37:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:37:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:50 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 16:37:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:50 user nova-compute[73056]: DEBUG nova.compute.manager [req-03bc570c-6e9c-4754-a1e8-5952487f03c4 req-0f4ff550-7e0f-449d-946e-1ca0b1588ed2 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-vif-plugged-c81e86e3-8261-441f-b7b1-145aa7740e08 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:37:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-03bc570c-6e9c-4754-a1e8-5952487f03c4 req-0f4ff550-7e0f-449d-946e-1ca0b1588ed2 service nova] Acquiring lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:37:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-03bc570c-6e9c-4754-a1e8-5952487f03c4 req-0f4ff550-7e0f-449d-946e-1ca0b1588ed2 service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:37:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-03bc570c-6e9c-4754-a1e8-5952487f03c4 req-0f4ff550-7e0f-449d-946e-1ca0b1588ed2 service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:50 user nova-compute[73056]: DEBUG nova.compute.manager [req-03bc570c-6e9c-4754-a1e8-5952487f03c4 req-0f4ff550-7e0f-449d-946e-1ca0b1588ed2 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] No waiting events found dispatching network-vif-plugged-c81e86e3-8261-441f-b7b1-145aa7740e08 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:37:50 user nova-compute[73056]: WARNING nova.compute.manager [req-03bc570c-6e9c-4754-a1e8-5952487f03c4 req-0f4ff550-7e0f-449d-946e-1ca0b1588ed2 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received unexpected event network-vif-plugged-c81e86e3-8261-441f-b7b1-145aa7740e08 for instance with vm_state building and task_state spawning.
Aug 14 16:37:50 user nova-compute[73056]: DEBUG nova.compute.manager [req-03bc570c-6e9c-4754-a1e8-5952487f03c4 req-0f4ff550-7e0f-449d-946e-1ca0b1588ed2 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-vif-plugged-ee13669b-f42c-4ca6-84e9-c95e35048ffc {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:37:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-03bc570c-6e9c-4754-a1e8-5952487f03c4 req-0f4ff550-7e0f-449d-946e-1ca0b1588ed2 service nova] Acquiring lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:37:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-03bc570c-6e9c-4754-a1e8-5952487f03c4 req-0f4ff550-7e0f-449d-946e-1ca0b1588ed2 service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:37:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-03bc570c-6e9c-4754-a1e8-5952487f03c4 req-0f4ff550-7e0f-449d-946e-1ca0b1588ed2 service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:50 user nova-compute[73056]: DEBUG nova.compute.manager [req-03bc570c-6e9c-4754-a1e8-5952487f03c4 req-0f4ff550-7e0f-449d-946e-1ca0b1588ed2 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] No waiting events found dispatching network-vif-plugged-ee13669b-f42c-4ca6-84e9-c95e35048ffc {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:37:50 user nova-compute[73056]: WARNING nova.compute.manager [req-03bc570c-6e9c-4754-a1e8-5952487f03c4 req-0f4ff550-7e0f-449d-946e-1ca0b1588ed2 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received unexpected event network-vif-plugged-ee13669b-f42c-4ca6-84e9-c95e35048ffc for instance with vm_state building and task_state spawning.
Aug 14 16:37:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-266f0a59-01e6-470a-95d8-9515eb84d290 req-6b3c4320-ae28-4ccb-9fe5-084aa116b469 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-vif-plugged-b70d8306-e1df-4d66-9949-8f156c902305 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:37:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-266f0a59-01e6-470a-95d8-9515eb84d290 req-6b3c4320-ae28-4ccb-9fe5-084aa116b469 service nova] Acquiring lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:37:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-266f0a59-01e6-470a-95d8-9515eb84d290 req-6b3c4320-ae28-4ccb-9fe5-084aa116b469 service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:37:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-266f0a59-01e6-470a-95d8-9515eb84d290 req-6b3c4320-ae28-4ccb-9fe5-084aa116b469 service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-266f0a59-01e6-470a-95d8-9515eb84d290 req-6b3c4320-ae28-4ccb-9fe5-084aa116b469 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] No waiting events found dispatching network-vif-plugged-b70d8306-e1df-4d66-9949-8f156c902305 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:37:51 user nova-compute[73056]: WARNING nova.compute.manager [req-266f0a59-01e6-470a-95d8-9515eb84d290 req-6b3c4320-ae28-4ccb-9fe5-084aa116b469 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received unexpected event network-vif-plugged-b70d8306-e1df-4d66-9949-8f156c902305 for instance with vm_state building and task_state spawning.
Aug 14 16:37:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-266f0a59-01e6-470a-95d8-9515eb84d290 req-6b3c4320-ae28-4ccb-9fe5-084aa116b469 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-vif-plugged-4e2daf22-7953-47ca-b2c6-98a1f0b00b72 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:37:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-266f0a59-01e6-470a-95d8-9515eb84d290 req-6b3c4320-ae28-4ccb-9fe5-084aa116b469 service nova] Acquiring lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:37:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-266f0a59-01e6-470a-95d8-9515eb84d290 req-6b3c4320-ae28-4ccb-9fe5-084aa116b469 service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:37:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-266f0a59-01e6-470a-95d8-9515eb84d290 req-6b3c4320-ae28-4ccb-9fe5-084aa116b469 service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-266f0a59-01e6-470a-95d8-9515eb84d290 req-6b3c4320-ae28-4ccb-9fe5-084aa116b469 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] No waiting events found dispatching network-vif-plugged-4e2daf22-7953-47ca-b2c6-98a1f0b00b72 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:37:51 user nova-compute[73056]: WARNING nova.compute.manager [req-266f0a59-01e6-470a-95d8-9515eb84d290 req-6b3c4320-ae28-4ccb-9fe5-084aa116b469 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received unexpected event network-vif-plugged-4e2daf22-7953-47ca-b2c6-98a1f0b00b72 for instance with vm_state building and task_state spawning.
Aug 14 16:37:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-266f0a59-01e6-470a-95d8-9515eb84d290 req-6b3c4320-ae28-4ccb-9fe5-084aa116b469 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-vif-plugged-4e2daf22-7953-47ca-b2c6-98a1f0b00b72 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:37:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-266f0a59-01e6-470a-95d8-9515eb84d290 req-6b3c4320-ae28-4ccb-9fe5-084aa116b469 service nova] Acquiring lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:37:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-266f0a59-01e6-470a-95d8-9515eb84d290 req-6b3c4320-ae28-4ccb-9fe5-084aa116b469 service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:37:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-266f0a59-01e6-470a-95d8-9515eb84d290 req-6b3c4320-ae28-4ccb-9fe5-084aa116b469 service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-266f0a59-01e6-470a-95d8-9515eb84d290 req-6b3c4320-ae28-4ccb-9fe5-084aa116b469 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] No waiting events found dispatching network-vif-plugged-4e2daf22-7953-47ca-b2c6-98a1f0b00b72 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:37:51 user nova-compute[73056]: WARNING nova.compute.manager [req-266f0a59-01e6-470a-95d8-9515eb84d290 req-6b3c4320-ae28-4ccb-9fe5-084aa116b469 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received unexpected event network-vif-plugged-4e2daf22-7953-47ca-b2c6-98a1f0b00b72 for instance with vm_state building and task_state spawning.
Aug 14 16:37:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG nova.compute.manager [req-583c5d57-d252-4cc5-accb-8eb7f4160d43 req-109bbaa6-a240-4242-a158-52a53686d390 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-vif-plugged-69edfecc-9201-4747-89e2-bd552f2616ed {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-583c5d57-d252-4cc5-accb-8eb7f4160d43 req-109bbaa6-a240-4242-a158-52a53686d390 service nova] Acquiring lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-583c5d57-d252-4cc5-accb-8eb7f4160d43 req-109bbaa6-a240-4242-a158-52a53686d390 service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-583c5d57-d252-4cc5-accb-8eb7f4160d43 req-109bbaa6-a240-4242-a158-52a53686d390 service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG nova.compute.manager [req-583c5d57-d252-4cc5-accb-8eb7f4160d43 req-109bbaa6-a240-4242-a158-52a53686d390 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] No waiting events found dispatching network-vif-plugged-69edfecc-9201-4747-89e2-bd552f2616ed {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:37:52 user nova-compute[73056]: WARNING nova.compute.manager [req-583c5d57-d252-4cc5-accb-8eb7f4160d43 req-109bbaa6-a240-4242-a158-52a53686d390 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received unexpected event network-vif-plugged-69edfecc-9201-4747-89e2-bd552f2616ed for instance with vm_state building and task_state spawning.
Aug 14 16:37:52 user nova-compute[73056]: DEBUG nova.compute.manager [req-583c5d57-d252-4cc5-accb-8eb7f4160d43 req-109bbaa6-a240-4242-a158-52a53686d390 service nova] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Received event network-changed-312bec25-d19f-423b-aca3-a4117119fc1f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG nova.compute.manager [req-583c5d57-d252-4cc5-accb-8eb7f4160d43 req-109bbaa6-a240-4242-a158-52a53686d390 service nova] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Refreshing instance network info cache due to event network-changed-312bec25-d19f-423b-aca3-a4117119fc1f. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-583c5d57-d252-4cc5-accb-8eb7f4160d43 req-109bbaa6-a240-4242-a158-52a53686d390 service nova] Acquiring lock "refresh_cache-9f3a7f8a-e3b9-4918-9663-968677fe5c90" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-583c5d57-d252-4cc5-accb-8eb7f4160d43 req-109bbaa6-a240-4242-a158-52a53686d390 service nova] Acquired lock "refresh_cache-9f3a7f8a-e3b9-4918-9663-968677fe5c90" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG nova.network.neutron [req-583c5d57-d252-4cc5-accb-8eb7f4160d43 req-109bbaa6-a240-4242-a158-52a53686d390 service nova] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Refreshing network info cache for port 312bec25-d19f-423b-aca3-a4117119fc1f {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG nova.network.neutron [req-583c5d57-d252-4cc5-accb-8eb7f4160d43 req-109bbaa6-a240-4242-a158-52a53686d390 service nova] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Updated VIF entry in instance network info cache for port 312bec25-d19f-423b-aca3-a4117119fc1f. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG nova.network.neutron [req-583c5d57-d252-4cc5-accb-8eb7f4160d43 req-109bbaa6-a240-4242-a158-52a53686d390 service nova] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Updating instance_info_cache with network_info: [{"id": "312bec25-d19f-423b-aca3-a4117119fc1f", "address": "fa:16:3e:03:ce:11", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312bec25-d1", "ovs_interfaceid": "312bec25-d19f-423b-aca3-a4117119fc1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-583c5d57-d252-4cc5-accb-8eb7f4160d43 req-109bbaa6-a240-4242-a158-52a53686d390 service nova] Releasing lock "refresh_cache-9f3a7f8a-e3b9-4918-9663-968677fe5c90" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG nova.compute.manager [req-583c5d57-d252-4cc5-accb-8eb7f4160d43 req-109bbaa6-a240-4242-a158-52a53686d390 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-vif-plugged-ea9bf8ed-60e0-4563-893c-33135ea49823 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-583c5d57-d252-4cc5-accb-8eb7f4160d43 req-109bbaa6-a240-4242-a158-52a53686d390 service nova] Acquiring lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-583c5d57-d252-4cc5-accb-8eb7f4160d43 req-109bbaa6-a240-4242-a158-52a53686d390 service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-583c5d57-d252-4cc5-accb-8eb7f4160d43 req-109bbaa6-a240-4242-a158-52a53686d390 service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG nova.compute.manager [req-583c5d57-d252-4cc5-accb-8eb7f4160d43 req-109bbaa6-a240-4242-a158-52a53686d390 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] No waiting events found dispatching network-vif-plugged-ea9bf8ed-60e0-4563-893c-33135ea49823 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:37:52 user nova-compute[73056]: WARNING nova.compute.manager [req-583c5d57-d252-4cc5-accb-8eb7f4160d43 req-109bbaa6-a240-4242-a158-52a53686d390 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received unexpected event network-vif-plugged-ea9bf8ed-60e0-4563-893c-33135ea49823 for instance with vm_state building and task_state spawning.
Aug 14 16:37:52 user nova-compute[73056]: DEBUG nova.compute.manager [req-583c5d57-d252-4cc5-accb-8eb7f4160d43 req-109bbaa6-a240-4242-a158-52a53686d390 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-vif-plugged-ea9bf8ed-60e0-4563-893c-33135ea49823 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-583c5d57-d252-4cc5-accb-8eb7f4160d43 req-109bbaa6-a240-4242-a158-52a53686d390 service nova] Acquiring lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-583c5d57-d252-4cc5-accb-8eb7f4160d43 req-109bbaa6-a240-4242-a158-52a53686d390 service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-583c5d57-d252-4cc5-accb-8eb7f4160d43 req-109bbaa6-a240-4242-a158-52a53686d390 service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG nova.compute.manager [req-583c5d57-d252-4cc5-accb-8eb7f4160d43 req-109bbaa6-a240-4242-a158-52a53686d390 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] No waiting events found dispatching network-vif-plugged-ea9bf8ed-60e0-4563-893c-33135ea49823 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:37:52 user nova-compute[73056]: WARNING nova.compute.manager [req-583c5d57-d252-4cc5-accb-8eb7f4160d43 req-109bbaa6-a240-4242-a158-52a53686d390 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received unexpected event network-vif-plugged-ea9bf8ed-60e0-4563-893c-33135ea49823 for instance with vm_state building and task_state spawning.
Aug 14 16:37:52 user nova-compute[73056]: DEBUG nova.compute.manager [req-583c5d57-d252-4cc5-accb-8eb7f4160d43 req-109bbaa6-a240-4242-a158-52a53686d390 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-vif-plugged-9a54a741-25de-4758-921c-0b7e5c5730dd {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-583c5d57-d252-4cc5-accb-8eb7f4160d43 req-109bbaa6-a240-4242-a158-52a53686d390 service nova] Acquiring lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-583c5d57-d252-4cc5-accb-8eb7f4160d43 req-109bbaa6-a240-4242-a158-52a53686d390 service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-583c5d57-d252-4cc5-accb-8eb7f4160d43 req-109bbaa6-a240-4242-a158-52a53686d390 service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG nova.compute.manager [req-583c5d57-d252-4cc5-accb-8eb7f4160d43 req-109bbaa6-a240-4242-a158-52a53686d390 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] No waiting events found dispatching network-vif-plugged-9a54a741-25de-4758-921c-0b7e5c5730dd {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:37:52 user nova-compute[73056]: WARNING nova.compute.manager [req-583c5d57-d252-4cc5-accb-8eb7f4160d43 req-109bbaa6-a240-4242-a158-52a53686d390 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received unexpected event network-vif-plugged-9a54a741-25de-4758-921c-0b7e5c5730dd for instance with vm_state building and task_state spawning.
Aug 14 16:37:52 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031072.678765, d15f23ae-f5a4-47cf-b136-7072c7838790 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:37:52 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] VM Resumed (Lifecycle Event)
Aug 14 16:37:52 user nova-compute[73056]: DEBUG nova.compute.manager [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG nova.compute.manager [req-522c18df-c7e2-4a2d-a0b9-5661a082ad24 req-fdd1f93e-6aea-4e1f-83a6-836eeffa5511 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-vif-plugged-ee13669b-f42c-4ca6-84e9-c95e35048ffc {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-522c18df-c7e2-4a2d-a0b9-5661a082ad24 req-fdd1f93e-6aea-4e1f-83a6-836eeffa5511 service nova] Acquiring lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-522c18df-c7e2-4a2d-a0b9-5661a082ad24 req-fdd1f93e-6aea-4e1f-83a6-836eeffa5511 service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-522c18df-c7e2-4a2d-a0b9-5661a082ad24 req-fdd1f93e-6aea-4e1f-83a6-836eeffa5511 service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG nova.compute.manager [req-522c18df-c7e2-4a2d-a0b9-5661a082ad24 req-fdd1f93e-6aea-4e1f-83a6-836eeffa5511 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] No waiting events found dispatching network-vif-plugged-ee13669b-f42c-4ca6-84e9-c95e35048ffc {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:37:52 user nova-compute[73056]: WARNING nova.compute.manager [req-522c18df-c7e2-4a2d-a0b9-5661a082ad24 req-fdd1f93e-6aea-4e1f-83a6-836eeffa5511 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received unexpected event network-vif-plugged-ee13669b-f42c-4ca6-84e9-c95e35048ffc for instance with vm_state building and task_state spawning.
Aug 14 16:37:52 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Instance spawned successfully.
Aug 14 16:37:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:37:52 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:37:52 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031072.6808383, d15f23ae-f5a4-47cf-b136-7072c7838790 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:37:52 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] VM Started (Lifecycle Event)
Aug 14 16:37:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:37:52 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:37:52 user nova-compute[73056]: INFO nova.compute.manager [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Took 10.97 seconds to spawn the instance on the hypervisor.
Aug 14 16:37:52 user nova-compute[73056]: DEBUG nova.compute.manager [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:37:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9927d1d6-6e26-4408-b509-c96df5f314d6/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:53 user nova-compute[73056]: INFO nova.compute.manager [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Took 43.95 seconds to build instance.
Aug 14 16:37:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d7274506-83d7-452a-b2ed-1b61c8822668 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 44.079s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9927d1d6-6e26-4408-b509-c96df5f314d6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9927d1d6-6e26-4408-b509-c96df5f314d6/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9927d1d6-6e26-4408-b509-c96df5f314d6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a013b1e-7fc9-4ad7-a023-95827e2a4228/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a013b1e-7fc9-4ad7-a023-95827e2a4228/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a013b1e-7fc9-4ad7-a023-95827e2a4228/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a013b1e-7fc9-4ad7-a023-95827e2a4228/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:54 user nova-compute[73056]: DEBUG nova.compute.manager [req-9965c42d-ec03-4d2a-8a11-1a614cca636a req-5c0d5bae-0f95-4f6b-bae8-34bae274d8d2 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-vif-plugged-9a54a741-25de-4758-921c-0b7e5c5730dd {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:37:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9965c42d-ec03-4d2a-8a11-1a614cca636a req-5c0d5bae-0f95-4f6b-bae8-34bae274d8d2 service nova] Acquiring lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:37:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9965c42d-ec03-4d2a-8a11-1a614cca636a req-5c0d5bae-0f95-4f6b-bae8-34bae274d8d2 service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:37:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9965c42d-ec03-4d2a-8a11-1a614cca636a req-5c0d5bae-0f95-4f6b-bae8-34bae274d8d2 service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:54 user nova-compute[73056]: DEBUG nova.compute.manager [req-9965c42d-ec03-4d2a-8a11-1a614cca636a req-5c0d5bae-0f95-4f6b-bae8-34bae274d8d2 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] No waiting events found dispatching network-vif-plugged-9a54a741-25de-4758-921c-0b7e5c5730dd {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:37:54 user nova-compute[73056]: WARNING nova.compute.manager [req-9965c42d-ec03-4d2a-8a11-1a614cca636a req-5c0d5bae-0f95-4f6b-bae8-34bae274d8d2 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received unexpected event network-vif-plugged-9a54a741-25de-4758-921c-0b7e5c5730dd for instance with vm_state active and task_state None.
Aug 14 16:37:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b990e37f-8611-430f-89b1-ae6aeed24b38/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b990e37f-8611-430f-89b1-ae6aeed24b38/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b990e37f-8611-430f-89b1-ae6aeed24b38/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b990e37f-8611-430f-89b1-ae6aeed24b38/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5ba83-0612-4ce2-bd44-3ab55820022f/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5ba83-0612-4ce2-bd44-3ab55820022f/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5ba83-0612-4ce2-bd44-3ab55820022f/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5ba83-0612-4ce2-bd44-3ab55820022f/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9c38ee-426d-4dcf-8720-7ad5fad8492d/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9c38ee-426d-4dcf-8720-7ad5fad8492d/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9c38ee-426d-4dcf-8720-7ad5fad8492d/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZjyDESeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:37:55 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:37:55 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:37:55 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:37:55 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:37:55 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:37:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016 -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[deff9192-864b-4803-a6d3-fbed0cda48f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:37:55 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016 -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b953a5-22ea-44af-85a3-98687ee842fe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016] added
Aug 14 16:37:55 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[30251833-f4df-4277-bc25-f8f76762344e]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdd610e-c410-43da-9144-d88b651d0100]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZjyDESeV {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZjyDESeV" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab97669-4d68-46ae-88ed-aa10bb6fe43d]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZjyDESeV'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9c38ee-426d-4dcf-8720-7ad5fad8492d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f3d2be-ec24-413c-b44e-873b82268212/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e399359-c24d-45bd-ab0a-601886004f8a]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a2d84f-3c31-4c18-bcfa-7c51a735480f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:37:55 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:37:55 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:37:55 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:37:55 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:37:55 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:37:55 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:37:55 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:37:55 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:37:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016 -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:56 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c68d741-a360-48ea-b038-261bb7f46f84]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016, portal: 172.16.0.220,3260]
Aug 14 16:37:56 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016, portal: 172.16.0.220,3260] successful.
Aug 14 16:37:56 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:37:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:56 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f91ce4-678f-4342-bdb3-2d28221cc051]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:37:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f3d2be-ec24-413c-b44e-873b82268212/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f3d2be-ec24-413c-b44e-873b82268212/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:56 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[544ffd63-8223-4d97-a557-53a49f84949b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:37:56 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:37:56 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:37:56 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:37:56 user nova-compute[73056]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016 (non-flash)
Aug 14 16:37:56 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:37:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:37:56 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:37:56 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:37:56 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:37:56 user nova-compute[73056]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016 (non-flash)
Aug 14 16:37:56 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:37:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:37:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:37:56 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:37:56 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:37:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:56 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c079ab-7e9c-4af3-828a-b2ff1c64e412]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:56 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:37:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZjyDESeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:37:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f3d2be-ec24-413c-b44e-873b82268212/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:56 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:37:56 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:37:56 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:37:56 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:56 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:37:56 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:37:56 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=6998MB free_disk=25.598323822021484GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 16:37:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:37:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:37:57 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 6c9c38ee-426d-4dcf-8720-7ad5fad8492d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:37:57 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 9f3a7f8a-e3b9-4918-9663-968677fe5c90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:37:57 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 0fd5ba83-0612-4ce2-bd44-3ab55820022f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:37:57 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance b990e37f-8611-430f-89b1-ae6aeed24b38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:37:57 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 3a013b1e-7fc9-4ad7-a023-95827e2a4228 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:37:57 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 9927d1d6-6e26-4408-b509-c96df5f314d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:37:57 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance a329b987-231e-47a8-9f2d-71c15573f9f0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:37:57 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:37:57 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 10d46e97-4721-49a0-beed-c022e9045b18 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:37:57 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance d15f23ae-f5a4-47cf-b136-7072c7838790 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:37:57 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 03f3d2be-ec24-413c-b44e-873b82268212 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:37:57 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 16:37:57 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 16:37:57 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.414s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:37:57 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] <== connect_volume: return (1416ms) {'type': 'block', 'scsi_wwn': '23931383730626565', 'path': '/dev/sdf'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:37:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931383730626565', 'path': '/dev/sdf'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:37:57 user nova-compute[73056]: DEBUG nova.objects.instance [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Lazy-loading 'flavor' on Instance uuid 6c9c38ee-426d-4dcf-8720-7ad5fad8492d {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:37:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 16:37:57 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:37:57 user nova-compute[73056]:   <source dev="/dev/sdf"/>
Aug 14 16:37:57 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:37:57 user nova-compute[73056]:   <serial>a33db5f4-8a1c-4fe0-91b4-30933f6bc016</serial>
Aug 14 16:37:57 user nova-compute[73056]: </disk>
Aug 14 16:37:57 user nova-compute[73056]:  {{(pid=73056) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 16:37:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:57 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:37:57 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:37:57 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 16:37:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.552s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:57 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:37:57 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:37:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:37:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:37:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] No VIF found with MAC fa:16:3e:5d:3d:75, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:37:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2307a9d8-4d64-46dc-a8ee-41e45b9b48c2 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Lock "6c9c38ee-426d-4dcf-8720-7ad5fad8492d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.123s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Acquiring lock "6c9c38ee-426d-4dcf-8720-7ad5fad8492d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:37:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Lock "6c9c38ee-426d-4dcf-8720-7ad5fad8492d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:37:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Acquiring lock "6c9c38ee-426d-4dcf-8720-7ad5fad8492d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:37:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Lock "6c9c38ee-426d-4dcf-8720-7ad5fad8492d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:37:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Lock "6c9c38ee-426d-4dcf-8720-7ad5fad8492d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:58 user nova-compute[73056]: INFO nova.compute.manager [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Terminating instance
Aug 14 16:37:58 user nova-compute[73056]: DEBUG nova.compute.manager [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG nova.compute.manager [req-4a9fd5f8-7c7c-4be7-ae22-a7366f41dd69 req-482e1ae6-269f-42a2-a66d-4b4de00d60ef service nova] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Received event network-vif-unplugged-6854da1e-a228-4a49-bdcb-19df7a6704ac {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4a9fd5f8-7c7c-4be7-ae22-a7366f41dd69 req-482e1ae6-269f-42a2-a66d-4b4de00d60ef service nova] Acquiring lock "6c9c38ee-426d-4dcf-8720-7ad5fad8492d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4a9fd5f8-7c7c-4be7-ae22-a7366f41dd69 req-482e1ae6-269f-42a2-a66d-4b4de00d60ef service nova] Lock "6c9c38ee-426d-4dcf-8720-7ad5fad8492d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4a9fd5f8-7c7c-4be7-ae22-a7366f41dd69 req-482e1ae6-269f-42a2-a66d-4b4de00d60ef service nova] Lock "6c9c38ee-426d-4dcf-8720-7ad5fad8492d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG nova.compute.manager [req-4a9fd5f8-7c7c-4be7-ae22-a7366f41dd69 req-482e1ae6-269f-42a2-a66d-4b4de00d60ef service nova] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] No waiting events found dispatching network-vif-unplugged-6854da1e-a228-4a49-bdcb-19df7a6704ac {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG nova.compute.manager [req-4a9fd5f8-7c7c-4be7-ae22-a7366f41dd69 req-482e1ae6-269f-42a2-a66d-4b4de00d60ef service nova] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Received event network-vif-unplugged-6854da1e-a228-4a49-bdcb-19df7a6704ac for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:59 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Instance destroyed successfully.
Aug 14 16:37:59 user nova-compute[73056]: DEBUG nova.objects.instance [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Lazy-loading 'resources' on Instance uuid 6c9c38ee-426d-4dcf-8720-7ad5fad8492d {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:35:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-901344255',display_name='tempest-DeleteServersTestJSON-server-901344255',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-901344255',id=1,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:36:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3bfccc8baa174f63976b821e58cc189c',ramdisk_id='',reservation_id='r-mzmc8pfy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-436563330',owner_user_name='tempest-DeleteServersTestJSON-436563330-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:36:09Z,user_data=None,user_id='c27754fec0c34eec8656f8216928766e',uuid=6c9c38ee-426d-4dcf-8720-7ad5fad8492d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6854da1e-a228-4a49-bdcb-19df7a6704ac", "address": "fa:16:3e:5d:3d:75", "network": {"id": "35512310-0629-426a-94a4-1d564653b88e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-997222200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfccc8baa174f63976b821e58cc189c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6854da1e-a2", "ovs_interfaceid": "6854da1e-a228-4a49-bdcb-19df7a6704ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Converting VIF {"id": "6854da1e-a228-4a49-bdcb-19df7a6704ac", "address": "fa:16:3e:5d:3d:75", "network": {"id": "35512310-0629-426a-94a4-1d564653b88e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-997222200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bfccc8baa174f63976b821e58cc189c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6854da1e-a2", "ovs_interfaceid": "6854da1e-a228-4a49-bdcb-19df7a6704ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:3d:75,bridge_name='br-int',has_traffic_filtering=True,id=6854da1e-a228-4a49-bdcb-19df7a6704ac,network=Network(35512310-0629-426a-94a4-1d564653b88e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6854da1e-a2') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG os_vif [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:3d:75,bridge_name='br-int',has_traffic_filtering=True,id=6854da1e-a228-4a49-bdcb-19df7a6704ac,network=Network(35512310-0629-426a-94a4-1d564653b88e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6854da1e-a2') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6854da1e-a2, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:37:59 user nova-compute[73056]: INFO os_vif [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:3d:75,bridge_name='br-int',has_traffic_filtering=True,id=6854da1e-a228-4a49-bdcb-19df7a6704ac,network=Network(35512310-0629-426a-94a4-1d564653b88e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6854da1e-a2')
Aug 14 16:37:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZjyDESeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:37:59 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:37:59 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd6e6d9-cab3-4d76-926f-a2e6f9ae19f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[74986bef-9666-4546-ac71-6cea998f70e7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:37:59 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:37:59 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:37:59 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:37:59 user nova-compute[73056]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016 (non-flash)
Aug 14 16:37:59 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:37:59 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:37:59 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:37:59 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:37:59 user nova-compute[73056]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016 (non-flash)
Aug 14 16:37:59 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff30047e560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016'): ({'sdf'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Removing single pathed devices sdf {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[304ef1c3-10a6-4a66-b4d3-08bab7512c30]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.034s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7ebbc3-75d0-4890-9ea5-5f4e87e03418]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Flushing IO for device /dev/sdf {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:37:59 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c538698e-d0b3-47e0-b7d0-f020b7c67463]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:00 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:38:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:00 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18d0d63-285f-4a65-9c3f-fdd763bb99c0]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:00 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:38:00 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] SCSI volumes sdf have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:38:00 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:38:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.100s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:00 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81e4b6a-ad26-461c-9d50-c5806584ad67]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:00 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016 -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:00 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[56808ad4-2c05-44f5-8b54-448115bbb334]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:00 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016, portal: 172.16.0.220,3260]
Aug 14 16:38:00 user nova-compute[73056]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016, portal: 172.16.0.220,3260] successful.
Aug 14 16:38:00 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016 -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a33db5f4-8a1c-4fe0-91b4-30933f6bc016 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:00 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ddb420-c67a-4cd9-a217-a6740ce0f6d8]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:00 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:00 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.445s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:38:00 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] <== disconnect_volume: return (446ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:38:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:38:00 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Deleting instance files /opt/stack/data/nova/instances/6c9c38ee-426d-4dcf-8720-7ad5fad8492d_del
Aug 14 16:38:00 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Deletion of /opt/stack/data/nova/instances/6c9c38ee-426d-4dcf-8720-7ad5fad8492d_del complete
Aug 14 16:38:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Checking UEFI support for host arch (x86_64) {{(pid=73056) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 14 16:38:00 user nova-compute[73056]: INFO nova.virt.libvirt.host [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] UEFI support detected
Aug 14 16:38:00 user nova-compute[73056]: INFO nova.compute.manager [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Took 1.44 seconds to destroy the instance on the hypervisor.
Aug 14 16:38:00 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 16:38:00 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 16:38:00 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 16:38:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:01 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:38:01 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Took 0.73 seconds to deallocate network for instance.
Aug 14 16:38:01 user nova-compute[73056]: DEBUG nova.compute.manager [req-f85d89be-0968-4632-895a-a3ddc4e80664 req-0e778364-4dac-421d-9aab-6b13ffd3d7dd service nova] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Received event network-vif-deleted-6854da1e-a228-4a49-bdcb-19df7a6704ac {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:38:01 user nova-compute[73056]: INFO nova.compute.manager [req-f85d89be-0968-4632-895a-a3ddc4e80664 req-0e778364-4dac-421d-9aab-6b13ffd3d7dd service nova] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Neutron deleted interface 6854da1e-a228-4a49-bdcb-19df7a6704ac; detaching it from the instance and deleting it from the info cache
Aug 14 16:38:01 user nova-compute[73056]: DEBUG nova.network.neutron [req-f85d89be-0968-4632-895a-a3ddc4e80664 req-0e778364-4dac-421d-9aab-6b13ffd3d7dd service nova] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:38:01 user nova-compute[73056]: DEBUG nova.compute.manager [req-f85d89be-0968-4632-895a-a3ddc4e80664 req-0e778364-4dac-421d-9aab-6b13ffd3d7dd service nova] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Detach interface failed, port_id=6854da1e-a228-4a49-bdcb-19df7a6704ac, reason: Instance 6c9c38ee-426d-4dcf-8720-7ad5fad8492d could not be found. {{(pid=73056) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 16:38:01 user nova-compute[73056]: DEBUG nova.compute.manager [req-eebd3979-65f8-434b-bb4c-26102d7ab042 req-21245b03-6dcd-4543-81e4-e954e88fb1a8 service nova] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Received event network-vif-plugged-6854da1e-a228-4a49-bdcb-19df7a6704ac {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:38:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-eebd3979-65f8-434b-bb4c-26102d7ab042 req-21245b03-6dcd-4543-81e4-e954e88fb1a8 service nova] Acquiring lock "6c9c38ee-426d-4dcf-8720-7ad5fad8492d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-eebd3979-65f8-434b-bb4c-26102d7ab042 req-21245b03-6dcd-4543-81e4-e954e88fb1a8 service nova] Lock "6c9c38ee-426d-4dcf-8720-7ad5fad8492d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-eebd3979-65f8-434b-bb4c-26102d7ab042 req-21245b03-6dcd-4543-81e4-e954e88fb1a8 service nova] Lock "6c9c38ee-426d-4dcf-8720-7ad5fad8492d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:01 user nova-compute[73056]: DEBUG nova.compute.manager [req-eebd3979-65f8-434b-bb4c-26102d7ab042 req-21245b03-6dcd-4543-81e4-e954e88fb1a8 service nova] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] No waiting events found dispatching network-vif-plugged-6854da1e-a228-4a49-bdcb-19df7a6704ac {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:38:01 user nova-compute[73056]: WARNING nova.compute.manager [req-eebd3979-65f8-434b-bb4c-26102d7ab042 req-21245b03-6dcd-4543-81e4-e954e88fb1a8 service nova] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Received unexpected event network-vif-plugged-6854da1e-a228-4a49-bdcb-19df7a6704ac for instance with vm_state active and task_state deleting.
Aug 14 16:38:01 user nova-compute[73056]: DEBUG nova.compute.manager [req-eebd3979-65f8-434b-bb4c-26102d7ab042 req-21245b03-6dcd-4543-81e4-e954e88fb1a8 service nova] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Received event network-vif-plugged-6854da1e-a228-4a49-bdcb-19df7a6704ac {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:38:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-eebd3979-65f8-434b-bb4c-26102d7ab042 req-21245b03-6dcd-4543-81e4-e954e88fb1a8 service nova] Acquiring lock "6c9c38ee-426d-4dcf-8720-7ad5fad8492d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-eebd3979-65f8-434b-bb4c-26102d7ab042 req-21245b03-6dcd-4543-81e4-e954e88fb1a8 service nova] Lock "6c9c38ee-426d-4dcf-8720-7ad5fad8492d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-eebd3979-65f8-434b-bb4c-26102d7ab042 req-21245b03-6dcd-4543-81e4-e954e88fb1a8 service nova] Lock "6c9c38ee-426d-4dcf-8720-7ad5fad8492d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:01 user nova-compute[73056]: DEBUG nova.compute.manager [req-eebd3979-65f8-434b-bb4c-26102d7ab042 req-21245b03-6dcd-4543-81e4-e954e88fb1a8 service nova] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] No waiting events found dispatching network-vif-plugged-6854da1e-a228-4a49-bdcb-19df7a6704ac {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:38:01 user nova-compute[73056]: WARNING nova.compute.manager [req-eebd3979-65f8-434b-bb4c-26102d7ab042 req-21245b03-6dcd-4543-81e4-e954e88fb1a8 service nova] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Received unexpected event network-vif-plugged-6854da1e-a228-4a49-bdcb-19df7a6704ac for instance with vm_state active and task_state deleting.
Aug 14 16:38:01 user nova-compute[73056]: DEBUG nova.compute.manager [req-eebd3979-65f8-434b-bb4c-26102d7ab042 req-21245b03-6dcd-4543-81e4-e954e88fb1a8 service nova] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Received event network-vif-plugged-6854da1e-a228-4a49-bdcb-19df7a6704ac {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:38:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-eebd3979-65f8-434b-bb4c-26102d7ab042 req-21245b03-6dcd-4543-81e4-e954e88fb1a8 service nova] Acquiring lock "6c9c38ee-426d-4dcf-8720-7ad5fad8492d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-eebd3979-65f8-434b-bb4c-26102d7ab042 req-21245b03-6dcd-4543-81e4-e954e88fb1a8 service nova] Lock "6c9c38ee-426d-4dcf-8720-7ad5fad8492d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-eebd3979-65f8-434b-bb4c-26102d7ab042 req-21245b03-6dcd-4543-81e4-e954e88fb1a8 service nova] Lock "6c9c38ee-426d-4dcf-8720-7ad5fad8492d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:01 user nova-compute[73056]: DEBUG nova.compute.manager [req-eebd3979-65f8-434b-bb4c-26102d7ab042 req-21245b03-6dcd-4543-81e4-e954e88fb1a8 service nova] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] No waiting events found dispatching network-vif-plugged-6854da1e-a228-4a49-bdcb-19df7a6704ac {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:38:01 user nova-compute[73056]: WARNING nova.compute.manager [req-eebd3979-65f8-434b-bb4c-26102d7ab042 req-21245b03-6dcd-4543-81e4-e954e88fb1a8 service nova] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Received unexpected event network-vif-plugged-6854da1e-a228-4a49-bdcb-19df7a6704ac for instance with vm_state active and task_state deleting.
Aug 14 16:38:01 user nova-compute[73056]: DEBUG nova.compute.manager [req-eebd3979-65f8-434b-bb4c-26102d7ab042 req-21245b03-6dcd-4543-81e4-e954e88fb1a8 service nova] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Received event network-vif-unplugged-6854da1e-a228-4a49-bdcb-19df7a6704ac {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:38:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-eebd3979-65f8-434b-bb4c-26102d7ab042 req-21245b03-6dcd-4543-81e4-e954e88fb1a8 service nova] Acquiring lock "6c9c38ee-426d-4dcf-8720-7ad5fad8492d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-eebd3979-65f8-434b-bb4c-26102d7ab042 req-21245b03-6dcd-4543-81e4-e954e88fb1a8 service nova] Lock "6c9c38ee-426d-4dcf-8720-7ad5fad8492d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-eebd3979-65f8-434b-bb4c-26102d7ab042 req-21245b03-6dcd-4543-81e4-e954e88fb1a8 service nova] Lock "6c9c38ee-426d-4dcf-8720-7ad5fad8492d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:01 user nova-compute[73056]: DEBUG nova.compute.manager [req-eebd3979-65f8-434b-bb4c-26102d7ab042 req-21245b03-6dcd-4543-81e4-e954e88fb1a8 service nova] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] No waiting events found dispatching network-vif-unplugged-6854da1e-a228-4a49-bdcb-19df7a6704ac {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:38:01 user nova-compute[73056]: DEBUG nova.compute.manager [req-eebd3979-65f8-434b-bb4c-26102d7ab042 req-21245b03-6dcd-4543-81e4-e954e88fb1a8 service nova] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Received event network-vif-unplugged-6854da1e-a228-4a49-bdcb-19df7a6704ac for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:38:01 user nova-compute[73056]: DEBUG nova.compute.manager [req-eebd3979-65f8-434b-bb4c-26102d7ab042 req-21245b03-6dcd-4543-81e4-e954e88fb1a8 service nova] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Received event network-vif-plugged-6854da1e-a228-4a49-bdcb-19df7a6704ac {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:38:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-eebd3979-65f8-434b-bb4c-26102d7ab042 req-21245b03-6dcd-4543-81e4-e954e88fb1a8 service nova] Acquiring lock "6c9c38ee-426d-4dcf-8720-7ad5fad8492d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-eebd3979-65f8-434b-bb4c-26102d7ab042 req-21245b03-6dcd-4543-81e4-e954e88fb1a8 service nova] Lock "6c9c38ee-426d-4dcf-8720-7ad5fad8492d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-eebd3979-65f8-434b-bb4c-26102d7ab042 req-21245b03-6dcd-4543-81e4-e954e88fb1a8 service nova] Lock "6c9c38ee-426d-4dcf-8720-7ad5fad8492d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:01 user nova-compute[73056]: DEBUG nova.compute.manager [req-eebd3979-65f8-434b-bb4c-26102d7ab042 req-21245b03-6dcd-4543-81e4-e954e88fb1a8 service nova] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] No waiting events found dispatching network-vif-plugged-6854da1e-a228-4a49-bdcb-19df7a6704ac {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:38:01 user nova-compute[73056]: WARNING nova.compute.manager [req-eebd3979-65f8-434b-bb4c-26102d7ab042 req-21245b03-6dcd-4543-81e4-e954e88fb1a8 service nova] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Received unexpected event network-vif-plugged-6854da1e-a228-4a49-bdcb-19df7a6704ac for instance with vm_state active and task_state deleting.
Aug 14 16:38:01 user nova-compute[73056]: INFO nova.compute.manager [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Took 0.78 seconds to detach 1 volumes for instance.
Aug 14 16:38:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG nova.compute.manager [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:38:02 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Creating image(s)
Aug 14 16:38:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Did not create local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Ensure instance console log exists: /opt/stack/data/nova/instances/10d46e97-4721-49a0-beed-c022e9045b18/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Start _get_guest_xml network_info=[{"id": "5240a3a2-cb9a-4df3-a1c1-0c4531c248ac", "address": "fa:16:3e:54:5a:4e", "network": {"id": "3a8c7fe6-c1b1-487d-ab15-2b884c3ab575", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1448848437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5240a3a2-cb", "ovs_interfaceid": "5240a3a2-cb9a-4df3-a1c1-0c4531c248ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7fd29069-06c5-41f5-b52c-64fd01fcff42", "address": "fa:16:3e:ec:52:7a", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fd29069-06", "ovs_interfaceid": "7fd29069-06c5-41f5-b52c-64fd01fcff42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b33c5c5b-fdb0-448c-a023-67de9d7f78fc", "address": "fa:16:3e:20:6a:96", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33c5c5b-fd", "ovs_interfaceid": "b33c5c5b-fdb0-448c-a023-67de9d7f78fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586", "address": "fa:16:3e:b3:f7:fb", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c1d6956-ad", "ovs_interfaceid": "2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "087bb06e-10ff-4b89-81e2-59c05c7f658c", "address": "fa:16:3e:dd:8d:1e", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087bb06e-10", "ovs_interfaceid": "087bb06e-10ff-4b89-81e2-59c05c7f658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "16d756dd-e41f-42df-bdba-77a1aa465582", "address": "fa:16:3e:75:1b:3f", "network": {"id": "57310f85-bed6-4991-a4ce-9d6a4ff8d6c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-767952195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d756dd-e4", "ovs_interfaceid": "16d756dd-e41f-42df-bdba-77a1aa465582", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "50d5fcc4-f01a-4f51-81a3-47410ef0bbdc", "address": "fa:16:3e:26:4f:f4", "network": {"id": "57310f85-bed6-4991-a4ce-9d6a4ff8d6c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-767952195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d5fcc4-f0", "ovs_interfaceid": "50d5fcc4-f01a-4f51-81a3-47410ef0bbdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wyvfdVYm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '10d46e97-4721-49a0-beed-c022e9045b18', 'attached_at': '', 'detached_at': '', 'volume_id': '7667d00d-8180-4d28-a276-7ac9edddae18', 'serial': '7667d00d-8180-4d28-a276-7ac9edddae18'}, 'attachment_id': 'f1b39bd0-a4e9-48bd-b165-ee8cd1edbbf0', 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None}, {'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pviDKyPt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '10d46e97-4721-49a0-beed-c022e9045b18', 'attached_at': '', 'detached_at': '', 'volume_id': '99a4de72-a5b0-4242-b22b-3f5ac30e8b02', 'serial': '99a4de72-a5b0-4242-b22b-3f5ac30e8b02'}, 'attachment_id': '2362f726-8be8-429c-bf5d-a9ce27b66028', 'delete_on_termination': False, 'boot_index': 1, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None}, {'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JZnIxSkr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '10d46e97-4721-49a0-beed-c022e9045b18', 'attached_at': '', 'detached_at': '', 'volume_id': '7ab4afa3-aa80-4d48-aced-b74ce8af207f', 'serial': '7ab4afa3-aa80-4d48-aced-b74ce8af207f'}, 'attachment_id': '6cd68a71-be56-4a61-959f-8e5ef21e231f', 'delete_on_termination': False, 'boot_index': 2, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:02 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:38:02 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:38:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wyvfdVYm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:38:02 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:38:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:38:02 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:38:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:38:02 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:38:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:02 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Deleted allocations for instance 6c9c38ee-426d-4dcf-8720-7ad5fad8492d
Aug 14 16:38:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e2e583-7830-4ee8-8295-2805f02d2b54]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:38:02 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f671371f-d632-4eda-87d1-9b88cdb42215]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18] added
Aug 14 16:38:02 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7f9a11-2056-4226-9432-813b945fd517]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28d8cfa-185f-43e8-af4c-7dc659d64c0b]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wyvfdVYm {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wyvfdVYm" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[61232540-d7ac-4a42-acbb-c97e2d6a9206]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wyvfdVYm'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f24547-aeef-437b-9320-c78cbae6b9c0]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-412bba53-ee07-42af-9086-b3ab0f094228 tempest-DeleteServersTestJSON-436563330 tempest-DeleteServersTestJSON-436563330-project-member] Lock "6c9c38ee-426d-4dcf-8720-7ad5fad8492d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.637s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[caecce12-cb5a-414a-afe7-443fe1109841]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:38:02 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:02 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:02 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:02 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:38:02 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:02 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:02 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:02 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[30858019-b1aa-4466-83e5-6960fe96ed84]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18, portal: 172.16.0.220,3260]
Aug 14 16:38:02 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18, portal: 172.16.0.220,3260] successful.
Aug 14 16:38:02 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[432c29e5-6ad9-4ce4-b176-7d6a96bba4e4]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[088529f9-f6f7-455a-838e-c147dd1bfbdb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:38:02 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:02 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:02 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:02 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:02 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:38:02 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:02 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:02 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:02 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:02 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[00953226-0288-4077-abdf-fd855cbd83d6]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:38:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wyvfdVYm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:38:03 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:38:03 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '26362646436643332', 'path': '/dev/sdf'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:38:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362646436643332', 'path': '/dev/sdf'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:38:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:38:03 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pviDKyPt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:38:03 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:38:03 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:38:03 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:38:03 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:38:03 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:38:03 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:38:03 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:38:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:03 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a48e58-dc3b-45e1-9e3d-4f3b28b1ca34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:03 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:38:03 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:03 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[8756ea92-6763-4b8d-b437-2b58d61d5a09]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:03 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02] added
Aug 14 16:38:03 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:03 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f082549e-65a2-4aa6-b856-67c9ca8536a8]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:03 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:03 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[224e6911-9494-4079-92bc-46c6c2da3cb0]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:03 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pviDKyPt {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pviDKyPt" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:03 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[47354d34-b910-45ed-84bd-db5085ebfb87]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:03 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pviDKyPt'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:03 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[cade5e7b-c5b3-449d-8a22-65d2d545cef0]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:03 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:03 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b722fee5-d045-4278-b60e-9c375d947da2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:03 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:38:03 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:03 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:03 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:03 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:03 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:38:03 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:38:03 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:03 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:03 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:03 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:03 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:38:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac605eeb-fa78-4b01-a187-4178d68a215b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02, portal: 172.16.0.220,3260]
Aug 14 16:38:04 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02, portal: 172.16.0.220,3260] successful.
Aug 14 16:38:04 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[710b8cf2-9d29-4f56-9735-a088e6df40e2]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[16601b53-2eb3-49be-a6d5-44a029f2f768]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:38:04 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:04 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:04 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:04 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:04 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:38:04 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:38:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:38:04 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:04 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:04 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:04 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:04 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:38:04 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:38:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:38:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:38:04 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:38:04 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:38:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f3704d-1aa9-46d8-aaac-604e8e1f3e4b]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:04 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:38:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pviDKyPt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:38:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23338666335353066', 'path': '/dev/sdg'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338666335353066', 'path': '/dev/sdg'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JZnIxSkr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:38:05 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:38:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:38:05 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:38:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:38:05 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:38:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a791747-1f1a-4c73-92cf-e657c99b525a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:38:05 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[0140e336-1243-4526-bc8b-7746c00a553a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f] added
Aug 14 16:38:05 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e40f8bc-68ff-4191-bab4-64f2d8aa3ea5]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG nova.compute.manager [req-74ba1855-1c56-427f-9621-85317b44b1e7 req-7ecdeb98-57d6-46b6-b9b3-300770ddbf71 service nova] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Received event network-changed-86a6c609-36e2-43e7-a675-670cdf35db58 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG nova.compute.manager [req-74ba1855-1c56-427f-9621-85317b44b1e7 req-7ecdeb98-57d6-46b6-b9b3-300770ddbf71 service nova] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Refreshing instance network info cache due to event network-changed-86a6c609-36e2-43e7-a675-670cdf35db58. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-74ba1855-1c56-427f-9621-85317b44b1e7 req-7ecdeb98-57d6-46b6-b9b3-300770ddbf71 service nova] Acquiring lock "refresh_cache-0fd5ba83-0612-4ce2-bd44-3ab55820022f" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-74ba1855-1c56-427f-9621-85317b44b1e7 req-7ecdeb98-57d6-46b6-b9b3-300770ddbf71 service nova] Acquired lock "refresh_cache-0fd5ba83-0612-4ce2-bd44-3ab55820022f" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG nova.network.neutron [req-74ba1855-1c56-427f-9621-85317b44b1e7 req-7ecdeb98-57d6-46b6-b9b3-300770ddbf71 service nova] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Refreshing network info cache for port 86a6c609-36e2-43e7-a675-670cdf35db58 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad24f78-5b7b-416c-91bb-f8f8b4946d77]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JZnIxSkr {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JZnIxSkr" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd126399-f1b1-4f16-9fdd-1dcabef8170c]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JZnIxSkr'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee66e76-1e83-445a-8781-d89947edd2aa]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a86a395-7be4-454e-ba33-7859d9e6623f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:38:05 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:05 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:05 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:05 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:05 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:38:05 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:38:05 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:05 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:05 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:05 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:05 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:38:05 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0db0644-1cb2-47ed-9cf0-965f0b506703]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f, portal: 172.16.0.220,3260]
Aug 14 16:38:05 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f, portal: 172.16.0.220,3260] successful.
Aug 14 16:38:05 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d04ff3c-5fbf-444d-99a3-9b992b7f973b]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[980d75cf-c37d-45c1-843a-768ba213cfa4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:38:05 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:05 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:05 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:05 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:05 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:38:05 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:38:05 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:38:05 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:05 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:05 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:05 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:05 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:38:05 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:38:05 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54e3f17-d83d-4738-91c1-52000c7d3003]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:38:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JZnIxSkr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.network.neutron [req-74ba1855-1c56-427f-9621-85317b44b1e7 req-7ecdeb98-57d6-46b6-b9b3-300770ddbf71 service nova] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Updated VIF entry in instance network info cache for port 86a6c609-36e2-43e7-a675-670cdf35db58. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.network.neutron [req-74ba1855-1c56-427f-9621-85317b44b1e7 req-7ecdeb98-57d6-46b6-b9b3-300770ddbf71 service nova] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Updating instance_info_cache with network_info: [{"id": "86a6c609-36e2-43e7-a675-670cdf35db58", "address": "fa:16:3e:eb:73:c7", "network": {"id": "2b53e507-f50b-411d-bce8-8769fc50bc28", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-515017098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4bf992869a24ad2b1d391e2baff2b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a6c609-36", "ovs_interfaceid": "86a6c609-36e2-43e7-a675-670cdf35db58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-74ba1855-1c56-427f-9621-85317b44b1e7 req-7ecdeb98-57d6-46b6-b9b3-300770ddbf71 service nova] Releasing lock "refresh_cache-0fd5ba83-0612-4ce2-bd44-3ab55820022f" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.438s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] <== connect_volume: return (1439ms) {'type': 'block', 'scsi_wwn': '26530383338343965', 'path': '/dev/sdh'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530383338343965', 'path': '/dev/sdh'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2116935830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2116935830',id=9,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeSoDv2TQexH2hIZXYvaRsxuQs6Zc8EWqydJgoNhPuHBGabH3RHqRM+U3UYgbgd6j381DicAH/8RDBw/VJ5DK/ePZK9udxDMfWuym/I2CUyfltUmi+Hx5bU4f3hL4nWaA==',key_name='tempest-keypair-405318954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='735e2905caf34b2fb25a17e674daca9c',ramdisk_id='',reservation_id='r-w8eow957',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746076092',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746076092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:37:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73371a938fc04253bcd7aaf2a86983ea',uuid=10d46e97-4721-49a0-beed-c022e9045b18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5240a3a2-cb9a-4df3-a1c1-0c4531c248ac", "address": "fa:16:3e:54:5a:4e", "network": {"id": "3a8c7fe6-c1b1-487d-ab15-2b884c3ab575", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1448848437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5240a3a2-cb", "ovs_interfaceid": "5240a3a2-cb9a-4df3-a1c1-0c4531c248ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converting VIF {"id": "5240a3a2-cb9a-4df3-a1c1-0c4531c248ac", "address": "fa:16:3e:54:5a:4e", "network": {"id": "3a8c7fe6-c1b1-487d-ab15-2b884c3ab575", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1448848437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5240a3a2-cb", "ovs_interfaceid": "5240a3a2-cb9a-4df3-a1c1-0c4531c248ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:5a:4e,bridge_name='br-int',has_traffic_filtering=True,id=5240a3a2-cb9a-4df3-a1c1-0c4531c248ac,network=Network(3a8c7fe6-c1b1-487d-ab15-2b884c3ab575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5240a3a2-cb') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2116935830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2116935830',id=9,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeSoDv2TQexH2hIZXYvaRsxuQs6Zc8EWqydJgoNhPuHBGabH3RHqRM+U3UYgbgd6j381DicAH/8RDBw/VJ5DK/ePZK9udxDMfWuym/I2CUyfltUmi+Hx5bU4f3hL4nWaA==',key_name='tempest-keypair-405318954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='735e2905caf34b2fb25a17e674daca9c',ramdisk_id='',reservation_id='r-w8eow957',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746076092',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746076092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:37:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73371a938fc04253bcd7aaf2a86983ea',uuid=10d46e97-4721-49a0-beed-c022e9045b18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7fd29069-06c5-41f5-b52c-64fd01fcff42", "address": "fa:16:3e:ec:52:7a", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fd29069-06", "ovs_interfaceid": "7fd29069-06c5-41f5-b52c-64fd01fcff42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converting VIF {"id": "7fd29069-06c5-41f5-b52c-64fd01fcff42", "address": "fa:16:3e:ec:52:7a", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fd29069-06", "ovs_interfaceid": "7fd29069-06c5-41f5-b52c-64fd01fcff42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:52:7a,bridge_name='br-int',has_traffic_filtering=True,id=7fd29069-06c5-41f5-b52c-64fd01fcff42,network=Network(24aecbb2-24c8-4f51-8728-700b1aeb9e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7fd29069-06') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2116935830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2116935830',id=9,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeSoDv2TQexH2hIZXYvaRsxuQs6Zc8EWqydJgoNhPuHBGabH3RHqRM+U3UYgbgd6j381DicAH/8RDBw/VJ5DK/ePZK9udxDMfWuym/I2CUyfltUmi+Hx5bU4f3hL4nWaA==',key_name='tempest-keypair-405318954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='735e2905caf34b2fb25a17e674daca9c',ramdisk_id='',reservation_id='r-w8eow957',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746076092',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746076092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:37:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73371a938fc04253bcd7aaf2a86983ea',uuid=10d46e97-4721-49a0-beed-c022e9045b18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b33c5c5b-fdb0-448c-a023-67de9d7f78fc", "address": "fa:16:3e:20:6a:96", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33c5c5b-fd", "ovs_interfaceid": "b33c5c5b-fdb0-448c-a023-67de9d7f78fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converting VIF {"id": "b33c5c5b-fdb0-448c-a023-67de9d7f78fc", "address": "fa:16:3e:20:6a:96", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33c5c5b-fd", "ovs_interfaceid": "b33c5c5b-fdb0-448c-a023-67de9d7f78fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:6a:96,bridge_name='br-int',has_traffic_filtering=True,id=b33c5c5b-fdb0-448c-a023-67de9d7f78fc,network=Network(24aecbb2-24c8-4f51-8728-700b1aeb9e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb33c5c5b-fd') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2116935830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2116935830',id=9,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeSoDv2TQexH2hIZXYvaRsxuQs6Zc8EWqydJgoNhPuHBGabH3RHqRM+U3UYgbgd6j381DicAH/8RDBw/VJ5DK/ePZK9udxDMfWuym/I2CUyfltUmi+Hx5bU4f3hL4nWaA==',key_name='tempest-keypair-405318954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='735e2905caf34b2fb25a17e674daca9c',ramdisk_id='',reservation_id='r-w8eow957',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746076092',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746076092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:37:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73371a938fc04253bcd7aaf2a86983ea',uuid=10d46e97-4721-49a0-beed-c022e9045b18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586", "address": "fa:16:3e:b3:f7:fb", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c1d6956-ad", "ovs_interfaceid": "2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converting VIF {"id": "2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586", "address": "fa:16:3e:b3:f7:fb", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c1d6956-ad", "ovs_interfaceid": "2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:f7:fb,bridge_name='br-int',has_traffic_filtering=True,id=2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586,network=Network(24aecbb2-24c8-4f51-8728-700b1aeb9e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c1d6956-ad') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2116935830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2116935830',id=9,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeSoDv2TQexH2hIZXYvaRsxuQs6Zc8EWqydJgoNhPuHBGabH3RHqRM+U3UYgbgd6j381DicAH/8RDBw/VJ5DK/ePZK9udxDMfWuym/I2CUyfltUmi+Hx5bU4f3hL4nWaA==',key_name='tempest-keypair-405318954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='735e2905caf34b2fb25a17e674daca9c',ramdisk_id='',reservation_id='r-w8eow957',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746076092',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746076092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:37:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73371a938fc04253bcd7aaf2a86983ea',uuid=10d46e97-4721-49a0-beed-c022e9045b18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "087bb06e-10ff-4b89-81e2-59c05c7f658c", "address": "fa:16:3e:dd:8d:1e", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087bb06e-10", "ovs_interfaceid": "087bb06e-10ff-4b89-81e2-59c05c7f658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converting VIF {"id": "087bb06e-10ff-4b89-81e2-59c05c7f658c", "address": "fa:16:3e:dd:8d:1e", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087bb06e-10", "ovs_interfaceid": "087bb06e-10ff-4b89-81e2-59c05c7f658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:8d:1e,bridge_name='br-int',has_traffic_filtering=True,id=087bb06e-10ff-4b89-81e2-59c05c7f658c,network=Network(24aecbb2-24c8-4f51-8728-700b1aeb9e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap087bb06e-10') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2116935830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2116935830',id=9,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeSoDv2TQexH2hIZXYvaRsxuQs6Zc8EWqydJgoNhPuHBGabH3RHqRM+U3UYgbgd6j381DicAH/8RDBw/VJ5DK/ePZK9udxDMfWuym/I2CUyfltUmi+Hx5bU4f3hL4nWaA==',key_name='tempest-keypair-405318954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='735e2905caf34b2fb25a17e674daca9c',ramdisk_id='',reservation_id='r-w8eow957',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746076092',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746076092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:37:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73371a938fc04253bcd7aaf2a86983ea',uuid=10d46e97-4721-49a0-beed-c022e9045b18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16d756dd-e41f-42df-bdba-77a1aa465582", "address": "fa:16:3e:75:1b:3f", "network": {"id": "57310f85-bed6-4991-a4ce-9d6a4ff8d6c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-767952195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d756dd-e4", "ovs_interfaceid": "16d756dd-e41f-42df-bdba-77a1aa465582", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converting VIF {"id": "16d756dd-e41f-42df-bdba-77a1aa465582", "address": "fa:16:3e:75:1b:3f", "network": {"id": "57310f85-bed6-4991-a4ce-9d6a4ff8d6c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-767952195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d756dd-e4", "ovs_interfaceid": "16d756dd-e41f-42df-bdba-77a1aa465582", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:1b:3f,bridge_name='br-int',has_traffic_filtering=True,id=16d756dd-e41f-42df-bdba-77a1aa465582,network=Network(57310f85-bed6-4991-a4ce-9d6a4ff8d6c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d756dd-e4') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2116935830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2116935830',id=9,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeSoDv2TQexH2hIZXYvaRsxuQs6Zc8EWqydJgoNhPuHBGabH3RHqRM+U3UYgbgd6j381DicAH/8RDBw/VJ5DK/ePZK9udxDMfWuym/I2CUyfltUmi+Hx5bU4f3hL4nWaA==',key_name='tempest-keypair-405318954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='735e2905caf34b2fb25a17e674daca9c',ramdisk_id='',reservation_id='r-w8eow957',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746076092',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746076092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:37:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73371a938fc04253bcd7aaf2a86983ea',uuid=10d46e97-4721-49a0-beed-c022e9045b18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50d5fcc4-f01a-4f51-81a3-47410ef0bbdc", "address": "fa:16:3e:26:4f:f4", "network": {"id": "57310f85-bed6-4991-a4ce-9d6a4ff8d6c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-767952195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d5fcc4-f0", "ovs_interfaceid": "50d5fcc4-f01a-4f51-81a3-47410ef0bbdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converting VIF {"id": "50d5fcc4-f01a-4f51-81a3-47410ef0bbdc", "address": "fa:16:3e:26:4f:f4", "network": {"id": "57310f85-bed6-4991-a4ce-9d6a4ff8d6c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-767952195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d5fcc4-f0", "ovs_interfaceid": "50d5fcc4-f01a-4f51-81a3-47410ef0bbdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:4f:f4,bridge_name='br-int',has_traffic_filtering=True,id=50d5fcc4-f01a-4f51-81a3-47410ef0bbdc,network=Network(57310f85-bed6-4991-a4ce-9d6a4ff8d6c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50d5fcc4-f0') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.objects.instance [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Lazy-loading 'pci_devices' on Instance uuid 10d46e97-4721-49a0-beed-c022e9045b18 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:38:06 user nova-compute[73056]:   <uuid>10d46e97-4721-49a0-beed-c022e9045b18</uuid>
Aug 14 16:38:06 user nova-compute[73056]:   <name>instance-00000009</name>
Aug 14 16:38:06 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:38:06 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:38:06 user nova-compute[73056]:   <metadata>
Aug 14 16:38:06 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:38:06 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:38:06 user nova-compute[73056]:       <nova:name>tempest-device-tagging-server-2116935830</nova:name>
Aug 14 16:38:06 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:38:02</nova:creationTime>
Aug 14 16:38:06 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:38:06 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:38:06 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:38:06 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:38:06 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:38:06 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:38:06 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:38:06 user nova-compute[73056]:       <nova:owner>
Aug 14 16:38:06 user nova-compute[73056]:         <nova:user uuid="73371a938fc04253bcd7aaf2a86983ea">tempest-TaggedBootDevicesTest_v242-1746076092-project-member</nova:user>
Aug 14 16:38:06 user nova-compute[73056]:         <nova:project uuid="735e2905caf34b2fb25a17e674daca9c">tempest-TaggedBootDevicesTest_v242-1746076092</nova:project>
Aug 14 16:38:06 user nova-compute[73056]:       </nova:owner>
Aug 14 16:38:06 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:38:06 user nova-compute[73056]:       <nova:ports>
Aug 14 16:38:06 user nova-compute[73056]:         <nova:port uuid="5240a3a2-cb9a-4df3-a1c1-0c4531c248ac">
Aug 14 16:38:06 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 16:38:06 user nova-compute[73056]:         </nova:port>
Aug 14 16:38:06 user nova-compute[73056]:         <nova:port uuid="7fd29069-06c5-41f5-b52c-64fd01fcff42">
Aug 14 16:38:06 user nova-compute[73056]:           <nova:ip type="fixed" address="10.1.1.83" ipVersion="4"/>
Aug 14 16:38:06 user nova-compute[73056]:         </nova:port>
Aug 14 16:38:06 user nova-compute[73056]:         <nova:port uuid="b33c5c5b-fdb0-448c-a023-67de9d7f78fc">
Aug 14 16:38:06 user nova-compute[73056]:           <nova:ip type="fixed" address="10.1.1.160" ipVersion="4"/>
Aug 14 16:38:06 user nova-compute[73056]:         </nova:port>
Aug 14 16:38:06 user nova-compute[73056]:         <nova:port uuid="2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586">
Aug 14 16:38:06 user nova-compute[73056]:           <nova:ip type="fixed" address="10.1.1.14" ipVersion="4"/>
Aug 14 16:38:06 user nova-compute[73056]:         </nova:port>
Aug 14 16:38:06 user nova-compute[73056]:         <nova:port uuid="087bb06e-10ff-4b89-81e2-59c05c7f658c">
Aug 14 16:38:06 user nova-compute[73056]:           <nova:ip type="fixed" address="10.1.1.108" ipVersion="4"/>
Aug 14 16:38:06 user nova-compute[73056]:         </nova:port>
Aug 14 16:38:06 user nova-compute[73056]:         <nova:port uuid="16d756dd-e41f-42df-bdba-77a1aa465582">
Aug 14 16:38:06 user nova-compute[73056]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 14 16:38:06 user nova-compute[73056]:         </nova:port>
Aug 14 16:38:06 user nova-compute[73056]:         <nova:port uuid="50d5fcc4-f01a-4f51-81a3-47410ef0bbdc">
Aug 14 16:38:06 user nova-compute[73056]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 14 16:38:06 user nova-compute[73056]:         </nova:port>
Aug 14 16:38:06 user nova-compute[73056]:       </nova:ports>
Aug 14 16:38:06 user nova-compute[73056]:     </nova:instance>
Aug 14 16:38:06 user nova-compute[73056]:   </metadata>
Aug 14 16:38:06 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:38:06 user nova-compute[73056]:     <system>
Aug 14 16:38:06 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:38:06 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:38:06 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:38:06 user nova-compute[73056]:       <entry name="serial">10d46e97-4721-49a0-beed-c022e9045b18</entry>
Aug 14 16:38:06 user nova-compute[73056]:       <entry name="uuid">10d46e97-4721-49a0-beed-c022e9045b18</entry>
Aug 14 16:38:06 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:38:06 user nova-compute[73056]:     </system>
Aug 14 16:38:06 user nova-compute[73056]:   </sysinfo>
Aug 14 16:38:06 user nova-compute[73056]:   <os>
Aug 14 16:38:06 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:38:06 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:38:06 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:38:06 user nova-compute[73056]:   </os>
Aug 14 16:38:06 user nova-compute[73056]:   <features>
Aug 14 16:38:06 user nova-compute[73056]:     <acpi/>
Aug 14 16:38:06 user nova-compute[73056]:     <apic/>
Aug 14 16:38:06 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:38:06 user nova-compute[73056]:   </features>
Aug 14 16:38:06 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:38:06 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:38:06 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:38:06 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:38:06 user nova-compute[73056]:   </clock>
Aug 14 16:38:06 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:38:06 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:38:06 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:38:06 user nova-compute[73056]:   </cpu>
Aug 14 16:38:06 user nova-compute[73056]:   <devices>
Aug 14 16:38:06 user nova-compute[73056]:     <disk type="file" device="cdrom">
Aug 14 16:38:06 user nova-compute[73056]:       <driver name="qemu" type="raw" cache="none"/>
Aug 14 16:38:06 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/10d46e97-4721-49a0-beed-c022e9045b18/disk.config"/>
Aug 14 16:38:06 user nova-compute[73056]:       <target dev="hda" bus="ide"/>
Aug 14 16:38:06 user nova-compute[73056]:     </disk>
Aug 14 16:38:06 user nova-compute[73056]:     <disk type="block" device="disk">
Aug 14 16:38:06 user nova-compute[73056]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:38:06 user nova-compute[73056]:       <source dev="/dev/sdf"/>
Aug 14 16:38:06 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:38:06 user nova-compute[73056]:       <serial>7667d00d-8180-4d28-a276-7ac9edddae18</serial>
Aug 14 16:38:06 user nova-compute[73056]:     </disk>
Aug 14 16:38:06 user nova-compute[73056]:     <disk type="block" device="disk">
Aug 14 16:38:06 user nova-compute[73056]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:38:06 user nova-compute[73056]:       <source dev="/dev/sdg"/>
Aug 14 16:38:06 user nova-compute[73056]:       <target dev="vdb" bus="virtio"/>
Aug 14 16:38:06 user nova-compute[73056]:       <serial>99a4de72-a5b0-4242-b22b-3f5ac30e8b02</serial>
Aug 14 16:38:06 user nova-compute[73056]:     </disk>
Aug 14 16:38:06 user nova-compute[73056]:     <disk type="block" device="disk">
Aug 14 16:38:06 user nova-compute[73056]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:38:06 user nova-compute[73056]:       <source dev="/dev/sdh"/>
Aug 14 16:38:06 user nova-compute[73056]:       <target dev="vdc" bus="virtio"/>
Aug 14 16:38:06 user nova-compute[73056]:       <serial>7ab4afa3-aa80-4d48-aced-b74ce8af207f</serial>
Aug 14 16:38:06 user nova-compute[73056]:     </disk>
Aug 14 16:38:06 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:38:06 user nova-compute[73056]:       <mac address="fa:16:3e:54:5a:4e"/>
Aug 14 16:38:06 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:38:06 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:38:06 user nova-compute[73056]:       <target dev="tap5240a3a2-cb"/>
Aug 14 16:38:06 user nova-compute[73056]:     </interface>
Aug 14 16:38:06 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:38:06 user nova-compute[73056]:       <mac address="fa:16:3e:ec:52:7a"/>
Aug 14 16:38:06 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:38:06 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:38:06 user nova-compute[73056]:       <target dev="tap7fd29069-06"/>
Aug 14 16:38:06 user nova-compute[73056]:     </interface>
Aug 14 16:38:06 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:38:06 user nova-compute[73056]:       <mac address="fa:16:3e:20:6a:96"/>
Aug 14 16:38:06 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:38:06 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:38:06 user nova-compute[73056]:       <target dev="tapb33c5c5b-fd"/>
Aug 14 16:38:06 user nova-compute[73056]:     </interface>
Aug 14 16:38:06 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:38:06 user nova-compute[73056]:       <mac address="fa:16:3e:b3:f7:fb"/>
Aug 14 16:38:06 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:38:06 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:38:06 user nova-compute[73056]:       <target dev="tap2c1d6956-ad"/>
Aug 14 16:38:06 user nova-compute[73056]:     </interface>
Aug 14 16:38:06 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:38:06 user nova-compute[73056]:       <mac address="fa:16:3e:dd:8d:1e"/>
Aug 14 16:38:06 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:38:06 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:38:06 user nova-compute[73056]:       <target dev="tap087bb06e-10"/>
Aug 14 16:38:06 user nova-compute[73056]:     </interface>
Aug 14 16:38:06 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:38:06 user nova-compute[73056]:       <mac address="fa:16:3e:75:1b:3f"/>
Aug 14 16:38:06 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:38:06 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:38:06 user nova-compute[73056]:       <target dev="tap16d756dd-e4"/>
Aug 14 16:38:06 user nova-compute[73056]:     </interface>
Aug 14 16:38:06 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:38:06 user nova-compute[73056]:       <mac address="fa:16:3e:26:4f:f4"/>
Aug 14 16:38:06 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:38:06 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:38:06 user nova-compute[73056]:       <target dev="tap50d5fcc4-f0"/>
Aug 14 16:38:06 user nova-compute[73056]:     </interface>
Aug 14 16:38:06 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:38:06 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/10d46e97-4721-49a0-beed-c022e9045b18/console.log" append="off"/>
Aug 14 16:38:06 user nova-compute[73056]:     </serial>
Aug 14 16:38:06 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:38:06 user nova-compute[73056]:     <video>
Aug 14 16:38:06 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:38:06 user nova-compute[73056]:     </video>
Aug 14 16:38:06 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:38:06 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:38:06 user nova-compute[73056]:     </rng>
Aug 14 16:38:06 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:38:06 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:38:06 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:38:06 user nova-compute[73056]:     </memballoon>
Aug 14 16:38:06 user nova-compute[73056]:   </devices>
Aug 14 16:38:06 user nova-compute[73056]: </domain>
Aug 14 16:38:06 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2116935830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2116935830',id=9,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeSoDv2TQexH2hIZXYvaRsxuQs6Zc8EWqydJgoNhPuHBGabH3RHqRM+U3UYgbgd6j381DicAH/8RDBw/VJ5DK/ePZK9udxDMfWuym/I2CUyfltUmi+Hx5bU4f3hL4nWaA==',key_name='tempest-keypair-405318954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='735e2905caf34b2fb25a17e674daca9c',ramdisk_id='',reservation_id='r-w8eow957',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746076092',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746076092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:37:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73371a938fc04253bcd7aaf2a86983ea',uuid=10d46e97-4721-49a0-beed-c022e9045b18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5240a3a2-cb9a-4df3-a1c1-0c4531c248ac", "address": "fa:16:3e:54:5a:4e", "network": {"id": "3a8c7fe6-c1b1-487d-ab15-2b884c3ab575", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1448848437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5240a3a2-cb", "ovs_interfaceid": "5240a3a2-cb9a-4df3-a1c1-0c4531c248ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converting VIF {"id": "5240a3a2-cb9a-4df3-a1c1-0c4531c248ac", "address": "fa:16:3e:54:5a:4e", "network": {"id": "3a8c7fe6-c1b1-487d-ab15-2b884c3ab575", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1448848437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5240a3a2-cb", "ovs_interfaceid": "5240a3a2-cb9a-4df3-a1c1-0c4531c248ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:5a:4e,bridge_name='br-int',has_traffic_filtering=True,id=5240a3a2-cb9a-4df3-a1c1-0c4531c248ac,network=Network(3a8c7fe6-c1b1-487d-ab15-2b884c3ab575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5240a3a2-cb') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG os_vif [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:5a:4e,bridge_name='br-int',has_traffic_filtering=True,id=5240a3a2-cb9a-4df3-a1c1-0c4531c248ac,network=Network(3a8c7fe6-c1b1-487d-ab15-2b884c3ab575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5240a3a2-cb') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5240a3a2-cb, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5240a3a2-cb, col_values=(('external_ids', {'iface-id': '5240a3a2-cb9a-4df3-a1c1-0c4531c248ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:5a:4e', 'vm-uuid': '10d46e97-4721-49a0-beed-c022e9045b18'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:06 user nova-compute[73056]: INFO os_vif [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:5a:4e,bridge_name='br-int',has_traffic_filtering=True,id=5240a3a2-cb9a-4df3-a1c1-0c4531c248ac,network=Network(3a8c7fe6-c1b1-487d-ab15-2b884c3ab575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5240a3a2-cb')
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2116935830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2116935830',id=9,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeSoDv2TQexH2hIZXYvaRsxuQs6Zc8EWqydJgoNhPuHBGabH3RHqRM+U3UYgbgd6j381DicAH/8RDBw/VJ5DK/ePZK9udxDMfWuym/I2CUyfltUmi+Hx5bU4f3hL4nWaA==',key_name='tempest-keypair-405318954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='735e2905caf34b2fb25a17e674daca9c',ramdisk_id='',reservation_id='r-w8eow957',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746076092',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746076092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:37:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73371a938fc04253bcd7aaf2a86983ea',uuid=10d46e97-4721-49a0-beed-c022e9045b18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7fd29069-06c5-41f5-b52c-64fd01fcff42", "address": "fa:16:3e:ec:52:7a", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fd29069-06", "ovs_interfaceid": "7fd29069-06c5-41f5-b52c-64fd01fcff42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converting VIF {"id": "7fd29069-06c5-41f5-b52c-64fd01fcff42", "address": "fa:16:3e:ec:52:7a", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fd29069-06", "ovs_interfaceid": "7fd29069-06c5-41f5-b52c-64fd01fcff42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:52:7a,bridge_name='br-int',has_traffic_filtering=True,id=7fd29069-06c5-41f5-b52c-64fd01fcff42,network=Network(24aecbb2-24c8-4f51-8728-700b1aeb9e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7fd29069-06') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG os_vif [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:52:7a,bridge_name='br-int',has_traffic_filtering=True,id=7fd29069-06c5-41f5-b52c-64fd01fcff42,network=Network(24aecbb2-24c8-4f51-8728-700b1aeb9e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7fd29069-06') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7fd29069-06, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7fd29069-06, col_values=(('external_ids', {'iface-id': '7fd29069-06c5-41f5-b52c-64fd01fcff42', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:52:7a', 'vm-uuid': '10d46e97-4721-49a0-beed-c022e9045b18'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:06 user nova-compute[73056]: INFO os_vif [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:52:7a,bridge_name='br-int',has_traffic_filtering=True,id=7fd29069-06c5-41f5-b52c-64fd01fcff42,network=Network(24aecbb2-24c8-4f51-8728-700b1aeb9e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7fd29069-06')
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2116935830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2116935830',id=9,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeSoDv2TQexH2hIZXYvaRsxuQs6Zc8EWqydJgoNhPuHBGabH3RHqRM+U3UYgbgd6j381DicAH/8RDBw/VJ5DK/ePZK9udxDMfWuym/I2CUyfltUmi+Hx5bU4f3hL4nWaA==',key_name='tempest-keypair-405318954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='735e2905caf34b2fb25a17e674daca9c',ramdisk_id='',reservation_id='r-w8eow957',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746076092',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746076092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:37:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73371a938fc04253bcd7aaf2a86983ea',uuid=10d46e97-4721-49a0-beed-c022e9045b18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b33c5c5b-fdb0-448c-a023-67de9d7f78fc", "address": "fa:16:3e:20:6a:96", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33c5c5b-fd", "ovs_interfaceid": "b33c5c5b-fdb0-448c-a023-67de9d7f78fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converting VIF {"id": "b33c5c5b-fdb0-448c-a023-67de9d7f78fc", "address": "fa:16:3e:20:6a:96", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33c5c5b-fd", "ovs_interfaceid": "b33c5c5b-fdb0-448c-a023-67de9d7f78fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:6a:96,bridge_name='br-int',has_traffic_filtering=True,id=b33c5c5b-fdb0-448c-a023-67de9d7f78fc,network=Network(24aecbb2-24c8-4f51-8728-700b1aeb9e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb33c5c5b-fd') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG os_vif [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:6a:96,bridge_name='br-int',has_traffic_filtering=True,id=b33c5c5b-fdb0-448c-a023-67de9d7f78fc,network=Network(24aecbb2-24c8-4f51-8728-700b1aeb9e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb33c5c5b-fd') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb33c5c5b-fd, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb33c5c5b-fd, col_values=(('external_ids', {'iface-id': 'b33c5c5b-fdb0-448c-a023-67de9d7f78fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:6a:96', 'vm-uuid': '10d46e97-4721-49a0-beed-c022e9045b18'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:06 user nova-compute[73056]: INFO os_vif [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:6a:96,bridge_name='br-int',has_traffic_filtering=True,id=b33c5c5b-fdb0-448c-a023-67de9d7f78fc,network=Network(24aecbb2-24c8-4f51-8728-700b1aeb9e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb33c5c5b-fd')
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2116935830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2116935830',id=9,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeSoDv2TQexH2hIZXYvaRsxuQs6Zc8EWqydJgoNhPuHBGabH3RHqRM+U3UYgbgd6j381DicAH/8RDBw/VJ5DK/ePZK9udxDMfWuym/I2CUyfltUmi+Hx5bU4f3hL4nWaA==',key_name='tempest-keypair-405318954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='735e2905caf34b2fb25a17e674daca9c',ramdisk_id='',reservation_id='r-w8eow957',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746076092',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746076092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:37:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73371a938fc04253bcd7aaf2a86983ea',uuid=10d46e97-4721-49a0-beed-c022e9045b18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586", "address": "fa:16:3e:b3:f7:fb", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c1d6956-ad", "ovs_interfaceid": "2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converting VIF {"id": "2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586", "address": "fa:16:3e:b3:f7:fb", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c1d6956-ad", "ovs_interfaceid": "2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:f7:fb,bridge_name='br-int',has_traffic_filtering=True,id=2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586,network=Network(24aecbb2-24c8-4f51-8728-700b1aeb9e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c1d6956-ad') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG os_vif [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:f7:fb,bridge_name='br-int',has_traffic_filtering=True,id=2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586,network=Network(24aecbb2-24c8-4f51-8728-700b1aeb9e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c1d6956-ad') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c1d6956-ad, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2c1d6956-ad, col_values=(('external_ids', {'iface-id': '2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:f7:fb', 'vm-uuid': '10d46e97-4721-49a0-beed-c022e9045b18'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:06 user nova-compute[73056]: INFO os_vif [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:f7:fb,bridge_name='br-int',has_traffic_filtering=True,id=2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586,network=Network(24aecbb2-24c8-4f51-8728-700b1aeb9e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c1d6956-ad')
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2116935830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2116935830',id=9,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeSoDv2TQexH2hIZXYvaRsxuQs6Zc8EWqydJgoNhPuHBGabH3RHqRM+U3UYgbgd6j381DicAH/8RDBw/VJ5DK/ePZK9udxDMfWuym/I2CUyfltUmi+Hx5bU4f3hL4nWaA==',key_name='tempest-keypair-405318954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='735e2905caf34b2fb25a17e674daca9c',ramdisk_id='',reservation_id='r-w8eow957',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746076092',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746076092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:37:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73371a938fc04253bcd7aaf2a86983ea',uuid=10d46e97-4721-49a0-beed-c022e9045b18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "087bb06e-10ff-4b89-81e2-59c05c7f658c", "address": "fa:16:3e:dd:8d:1e", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087bb06e-10", "ovs_interfaceid": "087bb06e-10ff-4b89-81e2-59c05c7f658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converting VIF {"id": "087bb06e-10ff-4b89-81e2-59c05c7f658c", "address": "fa:16:3e:dd:8d:1e", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087bb06e-10", "ovs_interfaceid": "087bb06e-10ff-4b89-81e2-59c05c7f658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:8d:1e,bridge_name='br-int',has_traffic_filtering=True,id=087bb06e-10ff-4b89-81e2-59c05c7f658c,network=Network(24aecbb2-24c8-4f51-8728-700b1aeb9e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap087bb06e-10') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG os_vif [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:8d:1e,bridge_name='br-int',has_traffic_filtering=True,id=087bb06e-10ff-4b89-81e2-59c05c7f658c,network=Network(24aecbb2-24c8-4f51-8728-700b1aeb9e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap087bb06e-10') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap087bb06e-10, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap087bb06e-10, col_values=(('external_ids', {'iface-id': '087bb06e-10ff-4b89-81e2-59c05c7f658c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:8d:1e', 'vm-uuid': '10d46e97-4721-49a0-beed-c022e9045b18'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:06 user nova-compute[73056]: INFO os_vif [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:8d:1e,bridge_name='br-int',has_traffic_filtering=True,id=087bb06e-10ff-4b89-81e2-59c05c7f658c,network=Network(24aecbb2-24c8-4f51-8728-700b1aeb9e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap087bb06e-10')
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2116935830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2116935830',id=9,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeSoDv2TQexH2hIZXYvaRsxuQs6Zc8EWqydJgoNhPuHBGabH3RHqRM+U3UYgbgd6j381DicAH/8RDBw/VJ5DK/ePZK9udxDMfWuym/I2CUyfltUmi+Hx5bU4f3hL4nWaA==',key_name='tempest-keypair-405318954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='735e2905caf34b2fb25a17e674daca9c',ramdisk_id='',reservation_id='r-w8eow957',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746076092',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746076092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:37:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73371a938fc04253bcd7aaf2a86983ea',uuid=10d46e97-4721-49a0-beed-c022e9045b18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16d756dd-e41f-42df-bdba-77a1aa465582", "address": "fa:16:3e:75:1b:3f", "network": {"id": "57310f85-bed6-4991-a4ce-9d6a4ff8d6c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-767952195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d756dd-e4", "ovs_interfaceid": "16d756dd-e41f-42df-bdba-77a1aa465582", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converting VIF {"id": "16d756dd-e41f-42df-bdba-77a1aa465582", "address": "fa:16:3e:75:1b:3f", "network": {"id": "57310f85-bed6-4991-a4ce-9d6a4ff8d6c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-767952195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d756dd-e4", "ovs_interfaceid": "16d756dd-e41f-42df-bdba-77a1aa465582", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:1b:3f,bridge_name='br-int',has_traffic_filtering=True,id=16d756dd-e41f-42df-bdba-77a1aa465582,network=Network(57310f85-bed6-4991-a4ce-9d6a4ff8d6c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d756dd-e4') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG os_vif [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:1b:3f,bridge_name='br-int',has_traffic_filtering=True,id=16d756dd-e41f-42df-bdba-77a1aa465582,network=Network(57310f85-bed6-4991-a4ce-9d6a4ff8d6c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d756dd-e4') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16d756dd-e4, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap16d756dd-e4, col_values=(('external_ids', {'iface-id': '16d756dd-e41f-42df-bdba-77a1aa465582', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:1b:3f', 'vm-uuid': '10d46e97-4721-49a0-beed-c022e9045b18'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:38:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:38:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:07 user nova-compute[73056]: INFO os_vif [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:1b:3f,bridge_name='br-int',has_traffic_filtering=True,id=16d756dd-e41f-42df-bdba-77a1aa465582,network=Network(57310f85-bed6-4991-a4ce-9d6a4ff8d6c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d756dd-e4')
Aug 14 16:38:07 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2116935830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2116935830',id=9,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeSoDv2TQexH2hIZXYvaRsxuQs6Zc8EWqydJgoNhPuHBGabH3RHqRM+U3UYgbgd6j381DicAH/8RDBw/VJ5DK/ePZK9udxDMfWuym/I2CUyfltUmi+Hx5bU4f3hL4nWaA==',key_name='tempest-keypair-405318954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='735e2905caf34b2fb25a17e674daca9c',ramdisk_id='',reservation_id='r-w8eow957',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746076092',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746076092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:37:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73371a938fc04253bcd7aaf2a86983ea',uuid=10d46e97-4721-49a0-beed-c022e9045b18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50d5fcc4-f01a-4f51-81a3-47410ef0bbdc", "address": "fa:16:3e:26:4f:f4", "network": {"id": "57310f85-bed6-4991-a4ce-9d6a4ff8d6c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-767952195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d5fcc4-f0", "ovs_interfaceid": "50d5fcc4-f01a-4f51-81a3-47410ef0bbdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:38:07 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converting VIF {"id": "50d5fcc4-f01a-4f51-81a3-47410ef0bbdc", "address": "fa:16:3e:26:4f:f4", "network": {"id": "57310f85-bed6-4991-a4ce-9d6a4ff8d6c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-767952195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d5fcc4-f0", "ovs_interfaceid": "50d5fcc4-f01a-4f51-81a3-47410ef0bbdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:38:07 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:4f:f4,bridge_name='br-int',has_traffic_filtering=True,id=50d5fcc4-f01a-4f51-81a3-47410ef0bbdc,network=Network(57310f85-bed6-4991-a4ce-9d6a4ff8d6c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50d5fcc4-f0') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:38:07 user nova-compute[73056]: DEBUG os_vif [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:4f:f4,bridge_name='br-int',has_traffic_filtering=True,id=50d5fcc4-f01a-4f51-81a3-47410ef0bbdc,network=Network(57310f85-bed6-4991-a4ce-9d6a4ff8d6c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50d5fcc4-f0') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:38:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:38:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:38:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50d5fcc4-f0, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:38:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap50d5fcc4-f0, col_values=(('external_ids', {'iface-id': '50d5fcc4-f01a-4f51-81a3-47410ef0bbdc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:4f:f4', 'vm-uuid': '10d46e97-4721-49a0-beed-c022e9045b18'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:38:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:38:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:07 user nova-compute[73056]: INFO os_vif [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:4f:f4,bridge_name='br-int',has_traffic_filtering=True,id=50d5fcc4-f01a-4f51-81a3-47410ef0bbdc,network=Network(57310f85-bed6-4991-a4ce-9d6a4ff8d6c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50d5fcc4-f0')
Aug 14 16:38:07 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] No BDM found with device name hda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:38:07 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:38:07 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] No VIF found with MAC fa:16:3e:54:5a:4e, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:38:07 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] No VIF found with MAC fa:16:3e:dd:8d:1e, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:38:07 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Using config drive
Aug 14 16:38:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:07 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Creating config drive at /opt/stack/data/nova/instances/10d46e97-4721-49a0-beed-c022e9045b18/disk.config
Aug 14 16:38:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/10d46e97-4721-49a0-beed-c022e9045b18/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp28i31eow {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/10d46e97-4721-49a0-beed-c022e9045b18/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp28i31eow" returned: 0 in 0.054s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:08 user nova-compute[73056]: DEBUG nova.compute.manager [req-063d0da4-dd03-4c39-8964-72cd0a52ef95 req-fa8517cf-98f6-4e7c-8140-1d125f13913c service nova] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Received event network-changed-56271c0a-c509-463b-88eb-05e97b76e470 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:38:08 user nova-compute[73056]: DEBUG nova.compute.manager [req-063d0da4-dd03-4c39-8964-72cd0a52ef95 req-fa8517cf-98f6-4e7c-8140-1d125f13913c service nova] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Refreshing instance network info cache due to event network-changed-56271c0a-c509-463b-88eb-05e97b76e470. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:38:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-063d0da4-dd03-4c39-8964-72cd0a52ef95 req-fa8517cf-98f6-4e7c-8140-1d125f13913c service nova] Acquiring lock "refresh_cache-b990e37f-8611-430f-89b1-ae6aeed24b38" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:38:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-063d0da4-dd03-4c39-8964-72cd0a52ef95 req-fa8517cf-98f6-4e7c-8140-1d125f13913c service nova] Acquired lock "refresh_cache-b990e37f-8611-430f-89b1-ae6aeed24b38" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:38:08 user nova-compute[73056]: DEBUG nova.network.neutron [req-063d0da4-dd03-4c39-8964-72cd0a52ef95 req-fa8517cf-98f6-4e7c-8140-1d125f13913c service nova] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Refreshing network info cache for port 56271c0a-c509-463b-88eb-05e97b76e470 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:38:08 user nova-compute[73056]: DEBUG nova.network.neutron [req-063d0da4-dd03-4c39-8964-72cd0a52ef95 req-fa8517cf-98f6-4e7c-8140-1d125f13913c service nova] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Updated VIF entry in instance network info cache for port 56271c0a-c509-463b-88eb-05e97b76e470. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:38:08 user nova-compute[73056]: DEBUG nova.network.neutron [req-063d0da4-dd03-4c39-8964-72cd0a52ef95 req-fa8517cf-98f6-4e7c-8140-1d125f13913c service nova] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Updating instance_info_cache with network_info: [{"id": "56271c0a-c509-463b-88eb-05e97b76e470", "address": "fa:16:3e:52:e6:55", "network": {"id": "0aca6007-75fe-4253-9996-634b8f099215", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1016531183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38887e3747844b33936f9b02b921c3d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56271c0a-c5", "ovs_interfaceid": "56271c0a-c509-463b-88eb-05e97b76e470", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:38:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-063d0da4-dd03-4c39-8964-72cd0a52ef95 req-fa8517cf-98f6-4e7c-8140-1d125f13913c service nova] Releasing lock "refresh_cache-b990e37f-8611-430f-89b1-ae6aeed24b38" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:38:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:09 user nova-compute[73056]: DEBUG nova.compute.manager [req-59184d08-056c-4f35-97c4-1e35989744ab req-bc78cd75-277e-41c7-91a2-3b156f2dcf1c service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-vif-plugged-7fd29069-06c5-41f5-b52c-64fd01fcff42 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:38:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-59184d08-056c-4f35-97c4-1e35989744ab req-bc78cd75-277e-41c7-91a2-3b156f2dcf1c service nova] Acquiring lock "10d46e97-4721-49a0-beed-c022e9045b18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-59184d08-056c-4f35-97c4-1e35989744ab req-bc78cd75-277e-41c7-91a2-3b156f2dcf1c service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-59184d08-056c-4f35-97c4-1e35989744ab req-bc78cd75-277e-41c7-91a2-3b156f2dcf1c service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:09 user nova-compute[73056]: DEBUG nova.compute.manager [req-59184d08-056c-4f35-97c4-1e35989744ab req-bc78cd75-277e-41c7-91a2-3b156f2dcf1c service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] No waiting events found dispatching network-vif-plugged-7fd29069-06c5-41f5-b52c-64fd01fcff42 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:38:09 user nova-compute[73056]: WARNING nova.compute.manager [req-59184d08-056c-4f35-97c4-1e35989744ab req-bc78cd75-277e-41c7-91a2-3b156f2dcf1c service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received unexpected event network-vif-plugged-7fd29069-06c5-41f5-b52c-64fd01fcff42 for instance with vm_state building and task_state spawning.
Aug 14 16:38:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:10 user nova-compute[73056]: DEBUG nova.compute.manager [req-4bbe7318-ea83-42d9-8e6a-5cd6900f8b7a req-e229db7b-ff50-4e31-94a1-1bea0bde1fb7 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-vif-plugged-5240a3a2-cb9a-4df3-a1c1-0c4531c248ac {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:38:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4bbe7318-ea83-42d9-8e6a-5cd6900f8b7a req-e229db7b-ff50-4e31-94a1-1bea0bde1fb7 service nova] Acquiring lock "10d46e97-4721-49a0-beed-c022e9045b18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4bbe7318-ea83-42d9-8e6a-5cd6900f8b7a req-e229db7b-ff50-4e31-94a1-1bea0bde1fb7 service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4bbe7318-ea83-42d9-8e6a-5cd6900f8b7a req-e229db7b-ff50-4e31-94a1-1bea0bde1fb7 service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:10 user nova-compute[73056]: DEBUG nova.compute.manager [req-4bbe7318-ea83-42d9-8e6a-5cd6900f8b7a req-e229db7b-ff50-4e31-94a1-1bea0bde1fb7 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] No waiting events found dispatching network-vif-plugged-5240a3a2-cb9a-4df3-a1c1-0c4531c248ac {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:38:10 user nova-compute[73056]: WARNING nova.compute.manager [req-4bbe7318-ea83-42d9-8e6a-5cd6900f8b7a req-e229db7b-ff50-4e31-94a1-1bea0bde1fb7 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received unexpected event network-vif-plugged-5240a3a2-cb9a-4df3-a1c1-0c4531c248ac for instance with vm_state building and task_state spawning.
Aug 14 16:38:10 user nova-compute[73056]: DEBUG nova.compute.manager [req-4bbe7318-ea83-42d9-8e6a-5cd6900f8b7a req-e229db7b-ff50-4e31-94a1-1bea0bde1fb7 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-vif-plugged-5240a3a2-cb9a-4df3-a1c1-0c4531c248ac {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:38:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4bbe7318-ea83-42d9-8e6a-5cd6900f8b7a req-e229db7b-ff50-4e31-94a1-1bea0bde1fb7 service nova] Acquiring lock "10d46e97-4721-49a0-beed-c022e9045b18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4bbe7318-ea83-42d9-8e6a-5cd6900f8b7a req-e229db7b-ff50-4e31-94a1-1bea0bde1fb7 service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4bbe7318-ea83-42d9-8e6a-5cd6900f8b7a req-e229db7b-ff50-4e31-94a1-1bea0bde1fb7 service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:10 user nova-compute[73056]: DEBUG nova.compute.manager [req-4bbe7318-ea83-42d9-8e6a-5cd6900f8b7a req-e229db7b-ff50-4e31-94a1-1bea0bde1fb7 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] No waiting events found dispatching network-vif-plugged-5240a3a2-cb9a-4df3-a1c1-0c4531c248ac {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:38:10 user nova-compute[73056]: WARNING nova.compute.manager [req-4bbe7318-ea83-42d9-8e6a-5cd6900f8b7a req-e229db7b-ff50-4e31-94a1-1bea0bde1fb7 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received unexpected event network-vif-plugged-5240a3a2-cb9a-4df3-a1c1-0c4531c248ac for instance with vm_state building and task_state spawning.
Aug 14 16:38:10 user nova-compute[73056]: DEBUG nova.compute.manager [req-4bbe7318-ea83-42d9-8e6a-5cd6900f8b7a req-e229db7b-ff50-4e31-94a1-1bea0bde1fb7 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-vif-plugged-2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:38:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4bbe7318-ea83-42d9-8e6a-5cd6900f8b7a req-e229db7b-ff50-4e31-94a1-1bea0bde1fb7 service nova] Acquiring lock "10d46e97-4721-49a0-beed-c022e9045b18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4bbe7318-ea83-42d9-8e6a-5cd6900f8b7a req-e229db7b-ff50-4e31-94a1-1bea0bde1fb7 service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4bbe7318-ea83-42d9-8e6a-5cd6900f8b7a req-e229db7b-ff50-4e31-94a1-1bea0bde1fb7 service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:10 user nova-compute[73056]: DEBUG nova.compute.manager [req-4bbe7318-ea83-42d9-8e6a-5cd6900f8b7a req-e229db7b-ff50-4e31-94a1-1bea0bde1fb7 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] No waiting events found dispatching network-vif-plugged-2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:38:10 user nova-compute[73056]: WARNING nova.compute.manager [req-4bbe7318-ea83-42d9-8e6a-5cd6900f8b7a req-e229db7b-ff50-4e31-94a1-1bea0bde1fb7 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received unexpected event network-vif-plugged-2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586 for instance with vm_state building and task_state spawning.
Aug 14 16:38:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:10 user nova-compute[73056]: DEBUG nova.compute.manager [req-ff59a796-ca5f-4cc0-9e05-b6589ea2a06c req-6bd933eb-b9f9-4bfc-a17e-f5b16d4d54da service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-vif-plugged-b33c5c5b-fdb0-448c-a023-67de9d7f78fc {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:38:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ff59a796-ca5f-4cc0-9e05-b6589ea2a06c req-6bd933eb-b9f9-4bfc-a17e-f5b16d4d54da service nova] Acquiring lock "10d46e97-4721-49a0-beed-c022e9045b18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ff59a796-ca5f-4cc0-9e05-b6589ea2a06c req-6bd933eb-b9f9-4bfc-a17e-f5b16d4d54da service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ff59a796-ca5f-4cc0-9e05-b6589ea2a06c req-6bd933eb-b9f9-4bfc-a17e-f5b16d4d54da service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:10 user nova-compute[73056]: DEBUG nova.compute.manager [req-ff59a796-ca5f-4cc0-9e05-b6589ea2a06c req-6bd933eb-b9f9-4bfc-a17e-f5b16d4d54da service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] No waiting events found dispatching network-vif-plugged-b33c5c5b-fdb0-448c-a023-67de9d7f78fc {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:38:10 user nova-compute[73056]: WARNING nova.compute.manager [req-ff59a796-ca5f-4cc0-9e05-b6589ea2a06c req-6bd933eb-b9f9-4bfc-a17e-f5b16d4d54da service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received unexpected event network-vif-plugged-b33c5c5b-fdb0-448c-a023-67de9d7f78fc for instance with vm_state building and task_state spawning.
Aug 14 16:38:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:11 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:11 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:11 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:11 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:11 user nova-compute[73056]: DEBUG nova.compute.manager [req-e61f3d29-ba29-4124-8def-c3c5495da5a7 req-de7e4a72-f6d6-4f8d-8911-3f6342adbc52 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-vif-plugged-7fd29069-06c5-41f5-b52c-64fd01fcff42 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:38:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e61f3d29-ba29-4124-8def-c3c5495da5a7 req-de7e4a72-f6d6-4f8d-8911-3f6342adbc52 service nova] Acquiring lock "10d46e97-4721-49a0-beed-c022e9045b18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e61f3d29-ba29-4124-8def-c3c5495da5a7 req-de7e4a72-f6d6-4f8d-8911-3f6342adbc52 service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e61f3d29-ba29-4124-8def-c3c5495da5a7 req-de7e4a72-f6d6-4f8d-8911-3f6342adbc52 service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:11 user nova-compute[73056]: DEBUG nova.compute.manager [req-e61f3d29-ba29-4124-8def-c3c5495da5a7 req-de7e4a72-f6d6-4f8d-8911-3f6342adbc52 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] No waiting events found dispatching network-vif-plugged-7fd29069-06c5-41f5-b52c-64fd01fcff42 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:38:11 user nova-compute[73056]: WARNING nova.compute.manager [req-e61f3d29-ba29-4124-8def-c3c5495da5a7 req-de7e4a72-f6d6-4f8d-8911-3f6342adbc52 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received unexpected event network-vif-plugged-7fd29069-06c5-41f5-b52c-64fd01fcff42 for instance with vm_state building and task_state spawning.
Aug 14 16:38:11 user nova-compute[73056]: DEBUG nova.compute.manager [req-e61f3d29-ba29-4124-8def-c3c5495da5a7 req-de7e4a72-f6d6-4f8d-8911-3f6342adbc52 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-vif-plugged-087bb06e-10ff-4b89-81e2-59c05c7f658c {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:38:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e61f3d29-ba29-4124-8def-c3c5495da5a7 req-de7e4a72-f6d6-4f8d-8911-3f6342adbc52 service nova] Acquiring lock "10d46e97-4721-49a0-beed-c022e9045b18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e61f3d29-ba29-4124-8def-c3c5495da5a7 req-de7e4a72-f6d6-4f8d-8911-3f6342adbc52 service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e61f3d29-ba29-4124-8def-c3c5495da5a7 req-de7e4a72-f6d6-4f8d-8911-3f6342adbc52 service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:11 user nova-compute[73056]: DEBUG nova.compute.manager [req-e61f3d29-ba29-4124-8def-c3c5495da5a7 req-de7e4a72-f6d6-4f8d-8911-3f6342adbc52 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] No waiting events found dispatching network-vif-plugged-087bb06e-10ff-4b89-81e2-59c05c7f658c {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:38:11 user nova-compute[73056]: WARNING nova.compute.manager [req-e61f3d29-ba29-4124-8def-c3c5495da5a7 req-de7e4a72-f6d6-4f8d-8911-3f6342adbc52 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received unexpected event network-vif-plugged-087bb06e-10ff-4b89-81e2-59c05c7f658c for instance with vm_state building and task_state spawning.
Aug 14 16:38:11 user nova-compute[73056]: DEBUG nova.compute.manager [req-e61f3d29-ba29-4124-8def-c3c5495da5a7 req-de7e4a72-f6d6-4f8d-8911-3f6342adbc52 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-vif-plugged-087bb06e-10ff-4b89-81e2-59c05c7f658c {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:38:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e61f3d29-ba29-4124-8def-c3c5495da5a7 req-de7e4a72-f6d6-4f8d-8911-3f6342adbc52 service nova] Acquiring lock "10d46e97-4721-49a0-beed-c022e9045b18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e61f3d29-ba29-4124-8def-c3c5495da5a7 req-de7e4a72-f6d6-4f8d-8911-3f6342adbc52 service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e61f3d29-ba29-4124-8def-c3c5495da5a7 req-de7e4a72-f6d6-4f8d-8911-3f6342adbc52 service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:11 user nova-compute[73056]: DEBUG nova.compute.manager [req-e61f3d29-ba29-4124-8def-c3c5495da5a7 req-de7e4a72-f6d6-4f8d-8911-3f6342adbc52 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] No waiting events found dispatching network-vif-plugged-087bb06e-10ff-4b89-81e2-59c05c7f658c {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:38:11 user nova-compute[73056]: WARNING nova.compute.manager [req-e61f3d29-ba29-4124-8def-c3c5495da5a7 req-de7e4a72-f6d6-4f8d-8911-3f6342adbc52 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received unexpected event network-vif-plugged-087bb06e-10ff-4b89-81e2-59c05c7f658c for instance with vm_state building and task_state spawning.
Aug 14 16:38:11 user nova-compute[73056]: DEBUG nova.compute.manager [req-e61f3d29-ba29-4124-8def-c3c5495da5a7 req-de7e4a72-f6d6-4f8d-8911-3f6342adbc52 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-vif-plugged-16d756dd-e41f-42df-bdba-77a1aa465582 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:38:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e61f3d29-ba29-4124-8def-c3c5495da5a7 req-de7e4a72-f6d6-4f8d-8911-3f6342adbc52 service nova] Acquiring lock "10d46e97-4721-49a0-beed-c022e9045b18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e61f3d29-ba29-4124-8def-c3c5495da5a7 req-de7e4a72-f6d6-4f8d-8911-3f6342adbc52 service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e61f3d29-ba29-4124-8def-c3c5495da5a7 req-de7e4a72-f6d6-4f8d-8911-3f6342adbc52 service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:11 user nova-compute[73056]: DEBUG nova.compute.manager [req-e61f3d29-ba29-4124-8def-c3c5495da5a7 req-de7e4a72-f6d6-4f8d-8911-3f6342adbc52 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] No waiting events found dispatching network-vif-plugged-16d756dd-e41f-42df-bdba-77a1aa465582 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:38:11 user nova-compute[73056]: WARNING nova.compute.manager [req-e61f3d29-ba29-4124-8def-c3c5495da5a7 req-de7e4a72-f6d6-4f8d-8911-3f6342adbc52 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received unexpected event network-vif-plugged-16d756dd-e41f-42df-bdba-77a1aa465582 for instance with vm_state building and task_state spawning.
Aug 14 16:38:11 user nova-compute[73056]: DEBUG nova.compute.manager [req-e61f3d29-ba29-4124-8def-c3c5495da5a7 req-de7e4a72-f6d6-4f8d-8911-3f6342adbc52 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-vif-plugged-16d756dd-e41f-42df-bdba-77a1aa465582 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:38:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e61f3d29-ba29-4124-8def-c3c5495da5a7 req-de7e4a72-f6d6-4f8d-8911-3f6342adbc52 service nova] Acquiring lock "10d46e97-4721-49a0-beed-c022e9045b18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e61f3d29-ba29-4124-8def-c3c5495da5a7 req-de7e4a72-f6d6-4f8d-8911-3f6342adbc52 service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e61f3d29-ba29-4124-8def-c3c5495da5a7 req-de7e4a72-f6d6-4f8d-8911-3f6342adbc52 service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:11 user nova-compute[73056]: DEBUG nova.compute.manager [req-e61f3d29-ba29-4124-8def-c3c5495da5a7 req-de7e4a72-f6d6-4f8d-8911-3f6342adbc52 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] No waiting events found dispatching network-vif-plugged-16d756dd-e41f-42df-bdba-77a1aa465582 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:38:11 user nova-compute[73056]: WARNING nova.compute.manager [req-e61f3d29-ba29-4124-8def-c3c5495da5a7 req-de7e4a72-f6d6-4f8d-8911-3f6342adbc52 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received unexpected event network-vif-plugged-16d756dd-e41f-42df-bdba-77a1aa465582 for instance with vm_state building and task_state spawning.
Aug 14 16:38:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Acquiring lock "3a013b1e-7fc9-4ad7-a023-95827e2a4228" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Lock "3a013b1e-7fc9-4ad7-a023-95827e2a4228" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG nova.objects.instance [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Lazy-loading 'flavor' on Instance uuid 3a013b1e-7fc9-4ad7-a023-95827e2a4228 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG nova.compute.manager [req-a0f240fd-542f-498f-b10a-089b6753f5f4 req-2c8384af-c9d4-4e80-825c-15c1a7060c67 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-vif-plugged-2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a0f240fd-542f-498f-b10a-089b6753f5f4 req-2c8384af-c9d4-4e80-825c-15c1a7060c67 service nova] Acquiring lock "10d46e97-4721-49a0-beed-c022e9045b18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a0f240fd-542f-498f-b10a-089b6753f5f4 req-2c8384af-c9d4-4e80-825c-15c1a7060c67 service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a0f240fd-542f-498f-b10a-089b6753f5f4 req-2c8384af-c9d4-4e80-825c-15c1a7060c67 service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG nova.compute.manager [req-a0f240fd-542f-498f-b10a-089b6753f5f4 req-2c8384af-c9d4-4e80-825c-15c1a7060c67 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] No waiting events found dispatching network-vif-plugged-2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:38:12 user nova-compute[73056]: WARNING nova.compute.manager [req-a0f240fd-542f-498f-b10a-089b6753f5f4 req-2c8384af-c9d4-4e80-825c-15c1a7060c67 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received unexpected event network-vif-plugged-2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586 for instance with vm_state building and task_state spawning.
Aug 14 16:38:12 user nova-compute[73056]: DEBUG nova.compute.manager [req-a0f240fd-542f-498f-b10a-089b6753f5f4 req-2c8384af-c9d4-4e80-825c-15c1a7060c67 service nova] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Received event network-changed-fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG nova.compute.manager [req-a0f240fd-542f-498f-b10a-089b6753f5f4 req-2c8384af-c9d4-4e80-825c-15c1a7060c67 service nova] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Refreshing instance network info cache due to event network-changed-fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a0f240fd-542f-498f-b10a-089b6753f5f4 req-2c8384af-c9d4-4e80-825c-15c1a7060c67 service nova] Acquiring lock "refresh_cache-3a013b1e-7fc9-4ad7-a023-95827e2a4228" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a0f240fd-542f-498f-b10a-089b6753f5f4 req-2c8384af-c9d4-4e80-825c-15c1a7060c67 service nova] Acquired lock "refresh_cache-3a013b1e-7fc9-4ad7-a023-95827e2a4228" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG nova.network.neutron [req-a0f240fd-542f-498f-b10a-089b6753f5f4 req-2c8384af-c9d4-4e80-825c-15c1a7060c67 service nova] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Refreshing network info cache for port fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Lock "3a013b1e-7fc9-4ad7-a023-95827e2a4228" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.467s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Acquiring lock "3a013b1e-7fc9-4ad7-a023-95827e2a4228" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Lock "3a013b1e-7fc9-4ad7-a023-95827e2a4228" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:12 user nova-compute[73056]: INFO nova.compute.manager [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Attaching volume 2c24907c-82ec-4d22-944a-b6316b89a9d6 to /dev/vdb
Aug 14 16:38:12 user nova-compute[73056]: DEBUG nova.compute.manager [req-0f0ad5b3-08ff-40a3-8c97-50b0bc329231 req-1aa2507a-4e89-4bc2-8915-3219448a3184 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-vif-plugged-b33c5c5b-fdb0-448c-a023-67de9d7f78fc {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0f0ad5b3-08ff-40a3-8c97-50b0bc329231 req-1aa2507a-4e89-4bc2-8915-3219448a3184 service nova] Acquiring lock "10d46e97-4721-49a0-beed-c022e9045b18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0f0ad5b3-08ff-40a3-8c97-50b0bc329231 req-1aa2507a-4e89-4bc2-8915-3219448a3184 service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0f0ad5b3-08ff-40a3-8c97-50b0bc329231 req-1aa2507a-4e89-4bc2-8915-3219448a3184 service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG nova.compute.manager [req-0f0ad5b3-08ff-40a3-8c97-50b0bc329231 req-1aa2507a-4e89-4bc2-8915-3219448a3184 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] No waiting events found dispatching network-vif-plugged-b33c5c5b-fdb0-448c-a023-67de9d7f78fc {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:38:12 user nova-compute[73056]: WARNING nova.compute.manager [req-0f0ad5b3-08ff-40a3-8c97-50b0bc329231 req-1aa2507a-4e89-4bc2-8915-3219448a3184 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received unexpected event network-vif-plugged-b33c5c5b-fdb0-448c-a023-67de9d7f78fc for instance with vm_state building and task_state spawning.
Aug 14 16:38:12 user nova-compute[73056]: DEBUG nova.compute.manager [req-0f0ad5b3-08ff-40a3-8c97-50b0bc329231 req-1aa2507a-4e89-4bc2-8915-3219448a3184 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-vif-plugged-50d5fcc4-f01a-4f51-81a3-47410ef0bbdc {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0f0ad5b3-08ff-40a3-8c97-50b0bc329231 req-1aa2507a-4e89-4bc2-8915-3219448a3184 service nova] Acquiring lock "10d46e97-4721-49a0-beed-c022e9045b18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0f0ad5b3-08ff-40a3-8c97-50b0bc329231 req-1aa2507a-4e89-4bc2-8915-3219448a3184 service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0f0ad5b3-08ff-40a3-8c97-50b0bc329231 req-1aa2507a-4e89-4bc2-8915-3219448a3184 service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG nova.compute.manager [req-0f0ad5b3-08ff-40a3-8c97-50b0bc329231 req-1aa2507a-4e89-4bc2-8915-3219448a3184 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] No waiting events found dispatching network-vif-plugged-50d5fcc4-f01a-4f51-81a3-47410ef0bbdc {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:38:12 user nova-compute[73056]: WARNING nova.compute.manager [req-0f0ad5b3-08ff-40a3-8c97-50b0bc329231 req-1aa2507a-4e89-4bc2-8915-3219448a3184 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received unexpected event network-vif-plugged-50d5fcc4-f01a-4f51-81a3-47410ef0bbdc for instance with vm_state building and task_state spawning.
Aug 14 16:38:12 user nova-compute[73056]: DEBUG nova.compute.manager [req-0f0ad5b3-08ff-40a3-8c97-50b0bc329231 req-1aa2507a-4e89-4bc2-8915-3219448a3184 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-vif-plugged-50d5fcc4-f01a-4f51-81a3-47410ef0bbdc {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0f0ad5b3-08ff-40a3-8c97-50b0bc329231 req-1aa2507a-4e89-4bc2-8915-3219448a3184 service nova] Acquiring lock "10d46e97-4721-49a0-beed-c022e9045b18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0f0ad5b3-08ff-40a3-8c97-50b0bc329231 req-1aa2507a-4e89-4bc2-8915-3219448a3184 service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0f0ad5b3-08ff-40a3-8c97-50b0bc329231 req-1aa2507a-4e89-4bc2-8915-3219448a3184 service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG nova.compute.manager [req-0f0ad5b3-08ff-40a3-8c97-50b0bc329231 req-1aa2507a-4e89-4bc2-8915-3219448a3184 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] No waiting events found dispatching network-vif-plugged-50d5fcc4-f01a-4f51-81a3-47410ef0bbdc {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:38:12 user nova-compute[73056]: WARNING nova.compute.manager [req-0f0ad5b3-08ff-40a3-8c97-50b0bc329231 req-1aa2507a-4e89-4bc2-8915-3219448a3184 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received unexpected event network-vif-plugged-50d5fcc4-f01a-4f51-81a3-47410ef0bbdc for instance with vm_state building and task_state spawning.
Aug 14 16:38:12 user nova-compute[73056]: DEBUG os_brick.utils [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[39701e4e-bc7c-4d10-8eb4-d70c8d212d13]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4a0b8c-f159-4ee2-885c-67815cfce415]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[376cc4a9-3c70-4f97-a6c8-4745be2c7758]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[785190bc-0432-4a7a-a733-b76a5458afec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:38:12 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:38:12 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf70490-4bc0-4daa-a599-dc2f68dfdea5]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG os_brick.utils [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Updating existing volume attachment record: 98bd19bf-ae83-406d-8911-2df7955de37a {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG nova.network.neutron [req-a0f240fd-542f-498f-b10a-089b6753f5f4 req-2c8384af-c9d4-4e80-825c-15c1a7060c67 service nova] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Updated VIF entry in instance network info cache for port fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG nova.network.neutron [req-a0f240fd-542f-498f-b10a-089b6753f5f4 req-2c8384af-c9d4-4e80-825c-15c1a7060c67 service nova] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Updating instance_info_cache with network_info: [{"id": "fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd", "address": "fa:16:3e:88:c3:7f", "network": {"id": "4d2c0fab-5e0a-40dd-a124-3ceb55f395bf", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1914390784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ea76956556248748abedf58955cf248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe86f39-73", "ovs_interfaceid": "fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:38:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a0f240fd-542f-498f-b10a-089b6753f5f4 req-2c8384af-c9d4-4e80-825c-15c1a7060c67 service nova] Releasing lock "refresh_cache-3a013b1e-7fc9-4ad7-a023-95827e2a4228" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:38:13 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031093.2108226, 10d46e97-4721-49a0-beed-c022e9045b18 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:38:13 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] VM Resumed (Lifecycle Event)
Aug 14 16:38:13 user nova-compute[73056]: DEBUG nova.compute.manager [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:38:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:38:13 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Instance spawned successfully.
Aug 14 16:38:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:38:13 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:38:13 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:38:13 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:38:13 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031093.219045, 10d46e97-4721-49a0-beed-c022e9045b18 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:38:13 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] VM Started (Lifecycle Event)
Aug 14 16:38:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:38:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:38:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:38:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:38:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:38:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:38:13 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:38:13 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:38:13 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:38:13 user nova-compute[73056]: INFO nova.compute.manager [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Took 11.01 seconds to spawn the instance on the hypervisor.
Aug 14 16:38:13 user nova-compute[73056]: DEBUG nova.compute.manager [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:38:13 user nova-compute[73056]: INFO nova.compute.manager [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Took 67.52 seconds to build instance.
Aug 14 16:38:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Acquiring lock "0fd5ba83-0612-4ce2-bd44-3ab55820022f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "0fd5ba83-0612-4ce2-bd44-3ab55820022f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-de3b935e-89ec-475a-b52d-6df5dd3372ef tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Lock "10d46e97-4721-49a0-beed-c022e9045b18" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 67.640s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:13 user nova-compute[73056]: DEBUG nova.objects.instance [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lazy-loading 'flavor' on Instance uuid 0fd5ba83-0612-4ce2-bd44-3ab55820022f {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:38:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "0fd5ba83-0612-4ce2-bd44-3ab55820022f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Acquiring lock "0fd5ba83-0612-4ce2-bd44-3ab55820022f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "0fd5ba83-0612-4ce2-bd44-3ab55820022f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:13 user nova-compute[73056]: INFO nova.compute.manager [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Attaching volume 9e272e19-d850-4281-8313-33eb1bb87b6c to /dev/vdb
Aug 14 16:38:13 user nova-compute[73056]: DEBUG os_brick.utils [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:38:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:13 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e25a539-aea4-4a46-a716-a3a3ff4941a0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:13 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5798a53f-4f22-4a82-859a-f8c3c1737292]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:13 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[598b716a-d504-4717-8d31-e45139c5ea7e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:13 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07326de-c20a-46dd-8ab6-798bebd357aa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:38:13 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:38:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:38:13 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:38:13 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7037c9-2ab3-4ebe-9f58-90866b440191]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:13 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:38:13 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:38:13 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:38:13 user nova-compute[73056]: DEBUG os_brick.utils [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:38:13 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Updating existing volume attachment record: dd8040cf-f89c-4a4a-9795-215152d7074b {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 16:38:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Acquiring lock "b990e37f-8611-430f-89b1-ae6aeed24b38" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Lock "b990e37f-8611-430f-89b1-ae6aeed24b38" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:13 user nova-compute[73056]: DEBUG nova.objects.instance [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Lazy-loading 'flavor' on Instance uuid b990e37f-8611-430f-89b1-ae6aeed24b38 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:38:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Lock "b990e37f-8611-430f-89b1-ae6aeed24b38" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.110s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Acquiring lock "b990e37f-8611-430f-89b1-ae6aeed24b38" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Lock "b990e37f-8611-430f-89b1-ae6aeed24b38" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:14 user nova-compute[73056]: INFO nova.compute.manager [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Attaching volume c343a9db-b962-4b29-b05a-5906a6df5a5b to /dev/sdc
Aug 14 16:38:14 user nova-compute[73056]: DEBUG os_brick.utils [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:38:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:14 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c34fb0-09d1-4d07-b208-ee878ab14044]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:14 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[39397e05-9b01-423c-8c68-04e403569c0a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:14 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3349126-bbf4-44bb-99eb-b51a73874f6d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:14 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb327596-20cc-4e36-b39a-84905ff79070]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:38:14 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:38:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:38:14 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:38:14 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbead0ac-8244-4163-8224-39f672f64837]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:14 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:38:14 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:38:14 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:38:14 user nova-compute[73056]: DEBUG os_brick.utils [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:38:14 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Updating existing volume attachment record: d028ea32-b799-472b-90b0-343d15402bfb {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 16:38:14 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692031079.7631474, 6c9c38ee-426d-4dcf-8720-7ad5fad8492d => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:38:14 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] VM Stopped (Lifecycle Event)
Aug 14 16:38:14 user nova-compute[73056]: DEBUG nova.compute.manager [None req-fcdb8dcb-1a17-4a57-97c8-ae94da3dbaa0 None None] [instance: 6c9c38ee-426d-4dcf-8720-7ad5fad8492d] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:38:16 user nova-compute[73056]: DEBUG nova.compute.manager [req-df73f3bd-52a1-4198-9e9a-4a4b3fba0a35 req-597885d9-39cf-4a56-9ea5-ac4e9b10f9b4 service nova] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Received event network-changed-f706d56a-af89-4224-ad47-4fc43bbebbfb {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:38:16 user nova-compute[73056]: DEBUG nova.compute.manager [req-df73f3bd-52a1-4198-9e9a-4a4b3fba0a35 req-597885d9-39cf-4a56-9ea5-ac4e9b10f9b4 service nova] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Refreshing instance network info cache due to event network-changed-f706d56a-af89-4224-ad47-4fc43bbebbfb. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:38:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-df73f3bd-52a1-4198-9e9a-4a4b3fba0a35 req-597885d9-39cf-4a56-9ea5-ac4e9b10f9b4 service nova] Acquiring lock "refresh_cache-9927d1d6-6e26-4408-b509-c96df5f314d6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:38:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-df73f3bd-52a1-4198-9e9a-4a4b3fba0a35 req-597885d9-39cf-4a56-9ea5-ac4e9b10f9b4 service nova] Acquired lock "refresh_cache-9927d1d6-6e26-4408-b509-c96df5f314d6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:38:16 user nova-compute[73056]: DEBUG nova.network.neutron [req-df73f3bd-52a1-4198-9e9a-4a4b3fba0a35 req-597885d9-39cf-4a56-9ea5-ac4e9b10f9b4 service nova] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Refreshing network info cache for port f706d56a-af89-4224-ad47-4fc43bbebbfb {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:38:17 user nova-compute[73056]: DEBUG nova.network.neutron [req-df73f3bd-52a1-4198-9e9a-4a4b3fba0a35 req-597885d9-39cf-4a56-9ea5-ac4e9b10f9b4 service nova] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Updated VIF entry in instance network info cache for port f706d56a-af89-4224-ad47-4fc43bbebbfb. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:38:17 user nova-compute[73056]: DEBUG nova.network.neutron [req-df73f3bd-52a1-4198-9e9a-4a4b3fba0a35 req-597885d9-39cf-4a56-9ea5-ac4e9b10f9b4 service nova] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Updating instance_info_cache with network_info: [{"id": "f706d56a-af89-4224-ad47-4fc43bbebbfb", "address": "fa:16:3e:b2:34:a0", "network": {"id": "bf1db71c-8d0e-447f-bf4a-90a8bb7751e4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-592839111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b35b1eb775b143e19a9d2fa193d946b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf706d56a-af", "ovs_interfaceid": "f706d56a-af89-4224-ad47-4fc43bbebbfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:38:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-df73f3bd-52a1-4198-9e9a-4a4b3fba0a35 req-597885d9-39cf-4a56-9ea5-ac4e9b10f9b4 service nova] Releasing lock "refresh_cache-9927d1d6-6e26-4408-b509-c96df5f314d6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:38:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:22 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:22 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:22 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:38:22 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ExlcoWGJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:38:22 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:38:22 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:38:22 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:38:22 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:38:22 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:38:22 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:38:22 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:38:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6 -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:22 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ab293a-bfec-42e0-aeec-0bee2388781d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:22 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:38:22 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6 -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:22 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bdc00d-1ace-463b-bc30-7e5c6d23c600]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:22 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6] added
Aug 14 16:38:22 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:22 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26efd31-e988-4fdd-babf-07d8034b36ec]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:22 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d1b020-670c-4e16-b8d2-9f428bd007e2]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ExlcoWGJ {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ExlcoWGJ" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee0f0aa-42e7-4af6-9294-24f30e3ab60c]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ExlcoWGJ'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c37046-b258-45cb-bd7d-dc89681c2586]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b98337-88ec-47e2-a4c0-3c4f57416343]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:38:23 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:23 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:23 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:23 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:23 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:38:23 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:38:23 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:38:23 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:23 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:23 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:23 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:23 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:38:23 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:38:23 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6 -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Acquiring lock "9927d1d6-6e26-4408-b509-c96df5f314d6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Lock "9927d1d6-6e26-4408-b509-c96df5f314d6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG nova.objects.instance [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Lazy-loading 'flavor' on Instance uuid 9927d1d6-6e26-4408-b509-c96df5f314d6 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Lock "9927d1d6-6e26-4408-b509-c96df5f314d6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6 -p 172.16.0.220:3260 --login" returned: 0 in 0.116s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[66edd641-c4f8-4858-9149-cdb8b42cf942]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6, portal: 172.16.0.220,3260]
Aug 14 16:38:23 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6, portal: 172.16.0.220,3260] successful.
Aug 14 16:38:23 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e7be04-d9c5-4286-b0aa-9752393b42f0]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8faaed-4b57-499b-b56a-480d3b24660c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6 (non-flash)
Aug 14 16:38:23 user nova-compute[73056]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:38:23 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:23 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:23 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:23 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:23 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:38:23 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:38:23 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6 (non-flash)
Aug 14 16:38:23 user nova-compute[73056]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:38:23 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:23 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:23 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:23 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:23 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:38:23 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:38:23 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.376s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24586c1-7ee2-4a4a-be33-d588bcaf12e1]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ExlcoWGJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Acquiring lock "9927d1d6-6e26-4408-b509-c96df5f314d6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Lock "9927d1d6-6e26-4408-b509-c96df5f314d6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:23 user nova-compute[73056]: INFO nova.compute.manager [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Attaching volume 54a15b78-0b03-4e36-b1bb-4772f342893b to /dev/vdb
Aug 14 16:38:23 user nova-compute[73056]: DEBUG os_brick.utils [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2af4bef-fba5-49e3-b53a-bb3d167929ac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[4815ba23-9576-4753-a129-12e0a0b7f1eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b8be51-2ba2-4676-a3f1-033332dc4af7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1292b9-9035-482c-8157-1c5956101907]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:38:23 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:38:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[816373ab-f942-44d3-b124-1111ecb36077]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG os_brick.utils [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:38:23 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Updating existing volume attachment record: bdeb8a06-cb43-48a6-bd57-6dd97fba71de {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 16:38:24 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.435s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:38:24 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] <== connect_volume: return (1437ms) {'type': 'block', 'scsi_wwn': '23530333536643961', 'path': '/dev/sdi'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:38:24 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530333536643961', 'path': '/dev/sdi'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:38:24 user nova-compute[73056]: DEBUG nova.objects.instance [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Lazy-loading 'flavor' on Instance uuid 3a013b1e-7fc9-4ad7-a023-95827e2a4228 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:38:24 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] attach device xml: <disk type="block" device="disk">
Aug 14 16:38:24 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:38:24 user nova-compute[73056]:   <source dev="/dev/sdi"/>
Aug 14 16:38:24 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:38:24 user nova-compute[73056]:   <serial>2c24907c-82ec-4d22-944a-b6316b89a9d6</serial>
Aug 14 16:38:24 user nova-compute[73056]: </disk>
Aug 14 16:38:24 user nova-compute[73056]:  {{(pid=73056) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 16:38:24 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:38:24 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:38:24 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] No VIF found with MAC fa:16:3e:88:c3:7f, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:38:26 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:38:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vJCGgkND', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:38:26 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:38:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:38:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:38:26 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:38:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:38:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:38:26 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:38:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:26 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ae4a2f-2451-4bc0-82b2-f071c70222cb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:38:26 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:26 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc8ed9b-a321-4fc5-a112-cdeeba18f5fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c] added
Aug 14 16:38:26 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:26 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[56763e00-3c9c-44e4-b7a6-ef3fd54c286b]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:26 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d172a901-a1ff-41e9-9892-3ad975175e9e]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vJCGgkND {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vJCGgkND" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:26 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1043b1-088b-48a2-a195-2c78e29cfc5d]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vJCGgkND'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:26 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[71367f39-2e9b-49ba-80f1-3be17de77b03]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:26 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9982b03-7a6c-4025-881f-528c731a94d3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6 (non-flash)
Aug 14 16:38:26 user nova-compute[73056]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:38:26 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:26 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:26 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:26 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:26 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:38:26 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:38:26 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:38:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6 (non-flash)
Aug 14 16:38:26 user nova-compute[73056]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:38:26 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:26 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:26 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:26 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:26 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:38:26 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:38:26 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:38:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:27 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:27 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0cd89f-9d08-4aae-b6e6-ffa1eca2d694]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:27 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c, portal: 172.16.0.220,3260]
Aug 14 16:38:27 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c, portal: 172.16.0.220,3260] successful.
Aug 14 16:38:27 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:27 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:27 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:27 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a835f5e9-6c9a-44b3-9e16-812c07136d07]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:27 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:27 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ea5d311a-8702-4242-a9cd-62e6f244b502 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Lock "3a013b1e-7fc9-4ad7-a023-95827e2a4228" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.550s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:27 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:27 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[514c2cd1-6689-45eb-9593-fc6161dbe7ae]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:27 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6 (non-flash)
Aug 14 16:38:27 user nova-compute[73056]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c (non-flash)
Aug 14 16:38:27 user nova-compute[73056]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:38:27 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:27 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:27 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:27 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:27 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:38:27 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:38:27 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:38:27 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6 (non-flash)
Aug 14 16:38:27 user nova-compute[73056]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c (non-flash)
Aug 14 16:38:27 user nova-compute[73056]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:38:27 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:27 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:27 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:27 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:27 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:38:27 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:38:27 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:38:27 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:38:27 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:38:27 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:38:27 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:38:27 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:27 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:27 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f2f634-e2ac-44fe-8a6f-546b288cd1ec]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:27 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: None {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:38:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:27 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-211da0e1-d9e4-4d10-8a39-7c387ed0c909 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] volume_snapshot_create: create_info: {'snapshot_id': '5c47c4cf-7463-4744-8598-be1e642c21e5', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=73056) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 14 16:38:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-211da0e1-d9e4-4d10-8a39-7c387ed0c909 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] snap xml: <domainsnapshot>
Aug 14 16:38:28 user nova-compute[73056]:   <disks>
Aug 14 16:38:28 user nova-compute[73056]:     <disk name="/dev/sdi" snapshot="external" type="file">
Aug 14 16:38:28 user nova-compute[73056]:       <source file="/dev/new_file"/>
Aug 14 16:38:28 user nova-compute[73056]:     </disk>
Aug 14 16:38:28 user nova-compute[73056]:     <disk name="vda" snapshot="no"/>
Aug 14 16:38:28 user nova-compute[73056]:   </disks>
Aug 14 16:38:28 user nova-compute[73056]: </domainsnapshot>
Aug 14 16:38:28 user nova-compute[73056]:  {{(pid=73056) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 14 16:38:28 user nova-compute[73056]: DEBUG nova.objects.instance [None req-211da0e1-d9e4-4d10-8a39-7c387ed0c909 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Lazy-loading 'system_metadata' on Instance uuid 3a013b1e-7fc9-4ad7-a023-95827e2a4228 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:38:28 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:38:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vJCGgkND', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:38:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:38:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '23931313738376636', 'path': '/dev/sdj'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:38:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931313738376636', 'path': '/dev/sdj'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:38:28 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-211da0e1-d9e4-4d10-8a39-7c387ed0c909 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 14 16:38:28 user nova-compute[73056]: DEBUG nova.objects.instance [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lazy-loading 'flavor' on Instance uuid 0fd5ba83-0612-4ce2-bd44-3ab55820022f {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [None req-211da0e1-d9e4-4d10-8a39-7c387ed0c909 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Traceback (most recent call last):
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228]     rv = execute(f, *args, **kwargs)
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228]     six.reraise(c, e, tb)
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228]     raise value
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228]     rv = meth(*args, **kwargs)
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] 
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [None req-211da0e1-d9e4-4d10-8a39-7c387ed0c909 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Traceback (most recent call last):
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228]     self._volume_snapshot_create(context, instance, guest,
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228]     rv = execute(f, *args, **kwargs)
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228]     six.reraise(c, e, tb)
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228]     raise value
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228]     rv = meth(*args, **kwargs)
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] 
Aug 14 16:38:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 16:38:28 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:38:28 user nova-compute[73056]:   <source dev="/dev/sdj"/>
Aug 14 16:38:28 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:38:28 user nova-compute[73056]:   <serial>9e272e19-d850-4281-8313-33eb1bb87b6c</serial>
Aug 14 16:38:28 user nova-compute[73056]: </disk>
Aug 14 16:38:28 user nova-compute[73056]:  {{(pid=73056) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 16:38:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-1f10060c-50bf-406b-8665-b952e09742fe tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] volume_snapshot_delete: delete_info: {'volume_id': '2c24907c-82ec-4d22-944a-b6316b89a9d6'} {{(pid=73056) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [None req-1f10060c-50bf-406b-8665-b952e09742fe tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Traceback (most recent call last):
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228]     if delete_info['type'] != 'qcow2':
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] KeyError: 'type'
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] 
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [None req-211da0e1-d9e4-4d10-8a39-7c387ed0c909 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 5c47c4cf-7463-4744-8598-be1e642c21e5 could not be found.
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     raise value
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver 
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver 
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 5c47c4cf-7463-4744-8598-be1e642c21e5 could not be found. (HTTP 404) (Request-ID: req-064aa3b5-32c6-4d4c-90f2-9bc24976e695)
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver 
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver 
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 5c47c4cf-7463-4744-8598-be1e642c21e5 could not be found.
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver 
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server [None req-211da0e1-d9e4-4d10-8a39-7c387ed0c909 tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     raise value
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server 
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver [None req-1f10060c-50bf-406b-8665-b952e09742fe tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver 
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver 
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-5d36564a-9de1-4a51-b144-7a63fcf7e1a3)
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver 
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver 
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 14 16:38:28 user nova-compute[73056]: ERROR nova.virt.libvirt.driver 
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server [None req-1f10060c-50bf-406b-8665-b952e09742fe tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Exception during message handling: KeyError: 'type'
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 14 16:38:28 user nova-compute[73056]: ERROR oslo_messaging.rpc.server 
Aug 14 16:38:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2de3988a-a284-4c93-80c0-668e55e9165c tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Acquiring lock "3a013b1e-7fc9-4ad7-a023-95827e2a4228" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2de3988a-a284-4c93-80c0-668e55e9165c tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Lock "3a013b1e-7fc9-4ad7-a023-95827e2a4228" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:28 user nova-compute[73056]: INFO nova.compute.manager [None req-2de3988a-a284-4c93-80c0-668e55e9165c tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Detaching volume 2c24907c-82ec-4d22-944a-b6316b89a9d6
Aug 14 16:38:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:38:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:38:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] No VIF found with MAC fa:16:3e:eb:73:c7, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:38:28 user nova-compute[73056]: INFO nova.virt.block_device [None req-2de3988a-a284-4c93-80c0-668e55e9165c tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Attempting to driver detach volume 2c24907c-82ec-4d22-944a-b6316b89a9d6 from mountpoint /dev/vdb
Aug 14 16:38:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2de3988a-a284-4c93-80c0-668e55e9165c tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Attempting to detach device vdb from instance 3a013b1e-7fc9-4ad7-a023-95827e2a4228 from the persistent domain config. {{(pid=73056) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 16:38:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-2de3988a-a284-4c93-80c0-668e55e9165c tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] detach device xml: <disk type="block" device="disk">
Aug 14 16:38:28 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:38:28 user nova-compute[73056]:   <source dev="/dev/sdi"/>
Aug 14 16:38:28 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:38:28 user nova-compute[73056]:   <serial>2c24907c-82ec-4d22-944a-b6316b89a9d6</serial>
Aug 14 16:38:28 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 16:38:28 user nova-compute[73056]: </disk>
Aug 14 16:38:28 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 16:38:28 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-2de3988a-a284-4c93-80c0-668e55e9165c tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Successfully detached device vdb from instance 3a013b1e-7fc9-4ad7-a023-95827e2a4228 from the persistent domain config.
Aug 14 16:38:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2de3988a-a284-4c93-80c0-668e55e9165c tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3a013b1e-7fc9-4ad7-a023-95827e2a4228 from the live domain config. {{(pid=73056) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 16:38:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-2de3988a-a284-4c93-80c0-668e55e9165c tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] detach device xml: <disk type="block" device="disk">
Aug 14 16:38:28 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:38:28 user nova-compute[73056]:   <source dev="/dev/sdi"/>
Aug 14 16:38:28 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:38:28 user nova-compute[73056]:   <serial>2c24907c-82ec-4d22-944a-b6316b89a9d6</serial>
Aug 14 16:38:28 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 16:38:28 user nova-compute[73056]: </disk>
Aug 14 16:38:28 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 16:38:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2e7fe7f3-80be-46ef-a761-093a18b3c91e tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "0fd5ba83-0612-4ce2-bd44-3ab55820022f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.261s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Received event <DeviceRemovedEvent: 1692031109.3435278, 3a013b1e-7fc9-4ad7-a023-95827e2a4228 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73056) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2de3988a-a284-4c93-80c0-668e55e9165c tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3a013b1e-7fc9-4ad7-a023-95827e2a4228 {{(pid=73056) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 16:38:29 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-2de3988a-a284-4c93-80c0-668e55e9165c tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Successfully detached device vdb from instance 3a013b1e-7fc9-4ad7-a023-95827e2a4228 from the live domain config.
Aug 14 16:38:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2de3988a-a284-4c93-80c0-668e55e9165c tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de3988a-a284-4c93-80c0-668e55e9165c tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ExlcoWGJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:38:29 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-2de3988a-a284-4c93-80c0-668e55e9165c tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:38:29 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-2de3988a-a284-4c93-80c0-668e55e9165c tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-2de3988a-a284-4c93-80c0-668e55e9165c tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de3988a-a284-4c93-80c0-668e55e9165c tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[262ec000-f488-411e-80f0-cac1a8942621]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b3acf5-1a3c-4a43-b5ab-b507895f0dd4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de3988a-a284-4c93-80c0-668e55e9165c tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6 (non-flash)
Aug 14 16:38:29 user nova-compute[73056]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c (non-flash)
Aug 14 16:38:29 user nova-compute[73056]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:38:29 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:29 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:29 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:29 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:29 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:38:29 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:38:29 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de3988a-a284-4c93-80c0-668e55e9165c tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6 (non-flash)
Aug 14 16:38:29 user nova-compute[73056]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c (non-flash)
Aug 14 16:38:29 user nova-compute[73056]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:38:29 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:29 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:29 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:29 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:29 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:38:29 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:38:29 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de3988a-a284-4c93-80c0-668e55e9165c tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff2dce464d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6'): ({'sdi'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-2de3988a-a284-4c93-80c0-668e55e9165c tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Removing single pathed devices sdi {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e7329a-f7b5-4dd7-8727-774963bed0d8]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[4def231a-a1cb-41c9-9cdd-93dea9f84830]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-2de3988a-a284-4c93-80c0-668e55e9165c tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Flushing IO for device /dev/sdi {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d859cf-ed5e-4631-8f5e-60f9dfbce31d]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-2de3988a-a284-4c93-80c0-668e55e9165c tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.053s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fc416c-9da3-4b91-bd7e-b55047fbc009]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-2de3988a-a284-4c93-80c0-668e55e9165c tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-2de3988a-a284-4c93-80c0-668e55e9165c tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] SCSI volumes sdi have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de3988a-a284-4c93-80c0-668e55e9165c tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb68f15-3bc0-4e00-8b54-184143cf4bbd]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de3988a-a284-4c93-80c0-668e55e9165c tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6 -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f912910-b49d-4c9c-8368-aaaa04bed322]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de3988a-a284-4c93-80c0-668e55e9165c tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6, portal: 172.16.0.220,3260]
Aug 14 16:38:29 user nova-compute[73056]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6, portal: 172.16.0.220,3260] successful.
Aug 14 16:38:29 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6 -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c24907c-82ec-4d22-944a-b6316b89a9d6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd0a151-0ea7-43bb-a766-49ca086f107d]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de3988a-a284-4c93-80c0-668e55e9165c tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-2de3988a-a284-4c93-80c0-668e55e9165c tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de3988a-a284-4c93-80c0-668e55e9165c tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] <== disconnect_volume: return (372ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:38:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2de3988a-a284-4c93-80c0-668e55e9165c tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:38:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:33 user nova-compute[73056]: DEBUG nova.compute.manager [req-028660ee-d593-4d29-bd80-d24dea29cc58 req-e3c0961a-a4a1-4033-a9eb-f94d85ef9ad1 service nova] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Received event network-changed-17d6adb4-b6f5-4c34-936d-35d1a4920106 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:38:33 user nova-compute[73056]: DEBUG nova.compute.manager [req-028660ee-d593-4d29-bd80-d24dea29cc58 req-e3c0961a-a4a1-4033-a9eb-f94d85ef9ad1 service nova] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Refreshing instance network info cache due to event network-changed-17d6adb4-b6f5-4c34-936d-35d1a4920106. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:38:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-028660ee-d593-4d29-bd80-d24dea29cc58 req-e3c0961a-a4a1-4033-a9eb-f94d85ef9ad1 service nova] Acquiring lock "refresh_cache-a329b987-231e-47a8-9f2d-71c15573f9f0" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:38:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-028660ee-d593-4d29-bd80-d24dea29cc58 req-e3c0961a-a4a1-4033-a9eb-f94d85ef9ad1 service nova] Acquired lock "refresh_cache-a329b987-231e-47a8-9f2d-71c15573f9f0" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:38:33 user nova-compute[73056]: DEBUG nova.network.neutron [req-028660ee-d593-4d29-bd80-d24dea29cc58 req-e3c0961a-a4a1-4033-a9eb-f94d85ef9ad1 service nova] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Refreshing network info cache for port 17d6adb4-b6f5-4c34-936d-35d1a4920106 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:38:34 user nova-compute[73056]: DEBUG nova.network.neutron [req-028660ee-d593-4d29-bd80-d24dea29cc58 req-e3c0961a-a4a1-4033-a9eb-f94d85ef9ad1 service nova] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Updated VIF entry in instance network info cache for port 17d6adb4-b6f5-4c34-936d-35d1a4920106. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:38:34 user nova-compute[73056]: DEBUG nova.network.neutron [req-028660ee-d593-4d29-bd80-d24dea29cc58 req-e3c0961a-a4a1-4033-a9eb-f94d85ef9ad1 service nova] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Updating instance_info_cache with network_info: [{"id": "17d6adb4-b6f5-4c34-936d-35d1a4920106", "address": "fa:16:3e:b5:bf:bb", "network": {"id": "e6b5cbb1-4f9c-4d4e-9a5a-c6b9fb6f2c0a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-787940559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "858651f51ffd49a48f3e98e7de4d87e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d6adb4-b6", "ovs_interfaceid": "17d6adb4-b6f5-4c34-936d-35d1a4920106", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:38:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-028660ee-d593-4d29-bd80-d24dea29cc58 req-e3c0961a-a4a1-4033-a9eb-f94d85ef9ad1 service nova] Releasing lock "refresh_cache-a329b987-231e-47a8-9f2d-71c15573f9f0" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:38:34 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:38:34 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oRfJwBhO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:38:34 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:38:34 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:38:34 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:38:34 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:38:34 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:38:34 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:38:34 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:38:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:34 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6b71ed-d054-4966-ad80-96216afb21ac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:34 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:38:34 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:34 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[9332da20-e57f-444b-b949-0b4084b2ec52]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:34 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b] added
Aug 14 16:38:34 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:34 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb49280-9db0-4ace-a549-2b2d631bea60]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:34 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7906b641-254e-452f-8937-24e17bfe7ae6 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Acquiring lock "0fd5ba83-0612-4ce2-bd44-3ab55820022f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7906b641-254e-452f-8937-24e17bfe7ae6 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "0fd5ba83-0612-4ce2-bd44-3ab55820022f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:34 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c815f3-48b1-4bca-9076-af41b11e616d]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:34 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oRfJwBhO {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:34 user nova-compute[73056]: INFO nova.compute.manager [None req-7906b641-254e-452f-8937-24e17bfe7ae6 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Detaching volume 9e272e19-d850-4281-8313-33eb1bb87b6c
Aug 14 16:38:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oRfJwBhO" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:34 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c245797f-5df0-46e9-b03a-a13799e11368]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:34 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oRfJwBhO'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:34 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b5edc7-8301-49fb-8217-9e5a3f6656a3]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:34 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:35 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:35 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c819b4-f718-45ce-b60f-d3bc1f4f384f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:35 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c (non-flash)
Aug 14 16:38:35 user nova-compute[73056]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:38:35 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:35 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:35 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:35 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:35 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:38:35 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:38:35 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:38:35 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c (non-flash)
Aug 14 16:38:35 user nova-compute[73056]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:38:35 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:35 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:35 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:35 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:35 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:38:35 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:38:35 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:38:35 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:35 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:35 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c33a45-3960-49b7-baa1-c8f2e415103f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:35 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b, portal: 172.16.0.220,3260]
Aug 14 16:38:35 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b, portal: 172.16.0.220,3260] successful.
Aug 14 16:38:35 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:35 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:35 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:35 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4537679-ab43-4878-be08-de43c4284967]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:35 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:35 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:35 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:35 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f82ba1-dd26-4409-a781-90517b138201]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:35 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c (non-flash)
Aug 14 16:38:35 user nova-compute[73056]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b (non-flash)
Aug 14 16:38:35 user nova-compute[73056]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:38:35 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:35 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:35 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:35 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:35 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:38:35 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:38:35 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:38:35 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c (non-flash)
Aug 14 16:38:35 user nova-compute[73056]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b (non-flash)
Aug 14 16:38:35 user nova-compute[73056]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:38:35 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:35 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:35 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:35 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:35 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:38:35 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:38:35 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:38:35 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:38:35 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:38:35 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] HCTL ('40', '-', '-', 0) found on session 12 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:38:35 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:38:35 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:35 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:35 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c07f7f-dc63-4cdc-b682-4393bb05354e]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:35 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Searching for a device in session 12 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:38:35 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oRfJwBhO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:38:35 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:38:35 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DPvsyfGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:38:35 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:38:35 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:38:35 user nova-compute[73056]: INFO nova.virt.block_device [None req-7906b641-254e-452f-8937-24e17bfe7ae6 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Attempting to driver detach volume 9e272e19-d850-4281-8313-33eb1bb87b6c from mountpoint /dev/vdb
Aug 14 16:38:35 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7906b641-254e-452f-8937-24e17bfe7ae6 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Attempting to detach device vdb from instance 0fd5ba83-0612-4ce2-bd44-3ab55820022f from the persistent domain config. {{(pid=73056) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 16:38:35 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-7906b641-254e-452f-8937-24e17bfe7ae6 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 16:38:35 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:38:35 user nova-compute[73056]:   <source dev="/dev/sdj"/>
Aug 14 16:38:35 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:38:35 user nova-compute[73056]:   <serial>9e272e19-d850-4281-8313-33eb1bb87b6c</serial>
Aug 14 16:38:35 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 16:38:35 user nova-compute[73056]: </disk>
Aug 14 16:38:35 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 16:38:35 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-7906b641-254e-452f-8937-24e17bfe7ae6 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Successfully detached device vdb from instance 0fd5ba83-0612-4ce2-bd44-3ab55820022f from the persistent domain config.
Aug 14 16:38:35 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7906b641-254e-452f-8937-24e17bfe7ae6 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0fd5ba83-0612-4ce2-bd44-3ab55820022f from the live domain config. {{(pid=73056) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 16:38:35 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-7906b641-254e-452f-8937-24e17bfe7ae6 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 16:38:35 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:38:35 user nova-compute[73056]:   <source dev="/dev/sdj"/>
Aug 14 16:38:35 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:38:35 user nova-compute[73056]:   <serial>9e272e19-d850-4281-8313-33eb1bb87b6c</serial>
Aug 14 16:38:35 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 16:38:35 user nova-compute[73056]: </disk>
Aug 14 16:38:35 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 16:38:35 user nova-compute[73056]: DEBUG nova.objects.instance [None req-2de3988a-a284-4c93-80c0-668e55e9165c tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Lazy-loading 'flavor' on Instance uuid 3a013b1e-7fc9-4ad7-a023-95827e2a4228 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:38:35 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2de3988a-a284-4c93-80c0-668e55e9165c tempest-VolumesAssistedSnapshotsTest-1777999980 tempest-VolumesAssistedSnapshotsTest-1777999980-project-admin] Lock "3a013b1e-7fc9-4ad7-a023-95827e2a4228" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.784s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:35 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Received event <DeviceRemovedEvent: 1692031115.7607608, 0fd5ba83-0612-4ce2-bd44-3ab55820022f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73056) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 16:38:35 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7906b641-254e-452f-8937-24e17bfe7ae6 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0fd5ba83-0612-4ce2-bd44-3ab55820022f {{(pid=73056) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 16:38:35 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-7906b641-254e-452f-8937-24e17bfe7ae6 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Successfully detached device vdb from instance 0fd5ba83-0612-4ce2-bd44-3ab55820022f from the live domain config.
Aug 14 16:38:35 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7906b641-254e-452f-8937-24e17bfe7ae6 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:38:35 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906b641-254e-452f-8937-24e17bfe7ae6 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vJCGgkND', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:38:35 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-7906b641-254e-452f-8937-24e17bfe7ae6 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:38:35 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-7906b641-254e-452f-8937-24e17bfe7ae6 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:38:36 user nova-compute[73056]: INFO nova.compute.manager [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Rebuilding instance
Aug 14 16:38:36 user nova-compute[73056]: DEBUG nova.objects.instance [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lazy-loading 'trusted_certs' on Instance uuid a329b987-231e-47a8-9f2d-71c15573f9f0 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG nova.compute.manager [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG nova.objects.instance [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lazy-loading 'pci_requests' on Instance uuid a329b987-231e-47a8-9f2d-71c15573f9f0 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG nova.objects.instance [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lazy-loading 'pci_devices' on Instance uuid a329b987-231e-47a8-9f2d-71c15573f9f0 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG nova.objects.instance [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lazy-loading 'resources' on Instance uuid a329b987-231e-47a8-9f2d-71c15573f9f0 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] <== connect_volume: return (1404ms) {'type': 'block', 'scsi_wwn': '26230303162313961', 'path': '/dev/sdi'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230303162313961', 'path': '/dev/sdi'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:38:36 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:38:36 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:38:36 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:38:36 user nova-compute[73056]: DEBUG nova.objects.instance [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lazy-loading 'migration_context' on Instance uuid a329b987-231e-47a8-9f2d-71c15573f9f0 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG nova.objects.instance [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Lazy-loading 'flavor' on Instance uuid 9927d1d6-6e26-4408-b509-c96df5f314d6 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG nova.objects.instance [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73056) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7ec233-4a77-46bc-9b81-ccd7589c914b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:38:36 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 16:38:36 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:38:36 user nova-compute[73056]:   <source dev="/dev/sdi"/>
Aug 14 16:38:36 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:38:36 user nova-compute[73056]:   <serial>54a15b78-0b03-4e36-b1bb-4772f342893b</serial>
Aug 14 16:38:36 user nova-compute[73056]: </disk>
Aug 14 16:38:36 user nova-compute[73056]:  {{(pid=73056) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[99601a33-65dd-40b8-b9f6-776343229087]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b] added
Aug 14 16:38:36 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d4bb28-66b0-4025-a8d7-06980169b5db]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4fae18-eb63-4b09-821c-17bd1e562bcc]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DPvsyfGH {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DPvsyfGH" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[1827e759-2c80-4e87-b5be-b92c748f1296]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DPvsyfGH'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d780f88-1bc6-47cc-a967-6d447e52368b]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee4a34e-8013-442d-a0f5-51e358e5c341]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c (non-flash)
Aug 14 16:38:36 user nova-compute[73056]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b (non-flash)
Aug 14 16:38:36 user nova-compute[73056]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:38:36 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:36 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:36 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:36 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:36 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:38:36 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:38:36 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c (non-flash)
Aug 14 16:38:36 user nova-compute[73056]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b (non-flash)
Aug 14 16:38:36 user nova-compute[73056]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:38:36 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:36 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:36 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:36 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:36 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:38:36 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:38:36 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b -p 172.16.0.220:3260 --login" returned: 0 in 0.115s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[295225a1-b90e-4adc-aa21-9f5cf74b3402]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b, portal: 172.16.0.220,3260]
Aug 14 16:38:36 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b, portal: 172.16.0.220,3260] successful.
Aug 14 16:38:36 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f760b3-c0c3-4d2b-8894-121a282463d7]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG nova.compute.manager [req-1ef88100-4d1a-4f59-b82c-63d6cb07ceb7 req-cdf41a71-8252-45dd-bdaf-e1ca38d1e165 service nova] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Received event network-vif-unplugged-17d6adb4-b6f5-4c34-936d-35d1a4920106 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1ef88100-4d1a-4f59-b82c-63d6cb07ceb7 req-cdf41a71-8252-45dd-bdaf-e1ca38d1e165 service nova] Acquiring lock "a329b987-231e-47a8-9f2d-71c15573f9f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1ef88100-4d1a-4f59-b82c-63d6cb07ceb7 req-cdf41a71-8252-45dd-bdaf-e1ca38d1e165 service nova] Lock "a329b987-231e-47a8-9f2d-71c15573f9f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1ef88100-4d1a-4f59-b82c-63d6cb07ceb7 req-cdf41a71-8252-45dd-bdaf-e1ca38d1e165 service nova] Lock "a329b987-231e-47a8-9f2d-71c15573f9f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG nova.compute.manager [req-1ef88100-4d1a-4f59-b82c-63d6cb07ceb7 req-cdf41a71-8252-45dd-bdaf-e1ca38d1e165 service nova] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] No waiting events found dispatching network-vif-unplugged-17d6adb4-b6f5-4c34-936d-35d1a4920106 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:38:36 user nova-compute[73056]: WARNING nova.compute.manager [req-1ef88100-4d1a-4f59-b82c-63d6cb07ceb7 req-cdf41a71-8252-45dd-bdaf-e1ca38d1e165 service nova] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Received unexpected event network-vif-unplugged-17d6adb4-b6f5-4c34-936d-35d1a4920106 for instance with vm_state active and task_state rebuilding.
Aug 14 16:38:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a558b72b-2ef2-44d3-ad5f-404e9a8b23fd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c (non-flash)
Aug 14 16:38:36 user nova-compute[73056]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b (non-flash)
Aug 14 16:38:36 user nova-compute[73056]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b (non-flash)
Aug 14 16:38:36 user nova-compute[73056]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:38:36 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:36 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:36 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:36 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:36 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:38:36 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:38:36 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c (non-flash)
Aug 14 16:38:36 user nova-compute[73056]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b (non-flash)
Aug 14 16:38:36 user nova-compute[73056]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b (non-flash)
Aug 14 16:38:36 user nova-compute[73056]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:38:36 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:36 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:36 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:36 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:36 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:38:36 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:38:36 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.397s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] HCTL ('42', '-', '-', 0) found on session 13 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7292e6dc-11b6-42c8-9cfa-65dcb5eeadb3]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Searching for a device in session 13 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DPvsyfGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] No VIF found with MAC fa:16:3e:b2:34:a0, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:38:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fc500a25-f6dc-47b8-ab68-7c8a39b9d92a tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Lock "9927d1d6-6e26-4408-b509-c96df5f314d6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.487s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:37 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Instance destroyed successfully.
Aug 14 16:38:37 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Instance destroyed successfully.
Aug 14 16:38:37 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:36:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2031154332',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-816611793',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrF6zQFCvY9I3Tx9Li4l8oLTxmzYxKp1UXPWnmTcCEWQmNrSST0nsa4EPNdzwiM8Sv72y8YAykbLtymkPXgs3ARLo+xvw/dSjjcHO5qsCxzDKWOJT1CHZ5oKqFnSSvojQ==',key_name='tempest-keypair-1364462886',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:37:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='858651f51ffd49a48f3e98e7de4d87e3',ramdisk_id='',reservation_id='r-2hejxwxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-153336784',owner_user_name='tempest-ServerActionsV293TestJSON-153336784-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:38:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da42a829953a49519d1e52647597e48a',uuid=a329b987-231e-47a8-9f2d-71c15573f9f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "17d6adb4-b6f5-4c34-936d-35d1a4920106", "address": "fa:16:3e:b5:bf:bb", "network": {"id": "e6b5cbb1-4f9c-4d4e-9a5a-c6b9fb6f2c0a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-787940559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "858651f51ffd49a48f3e98e7de4d87e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d6adb4-b6", "ovs_interfaceid": "17d6adb4-b6f5-4c34-936d-35d1a4920106", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Converting VIF {"id": "17d6adb4-b6f5-4c34-936d-35d1a4920106", "address": "fa:16:3e:b5:bf:bb", "network": {"id": "e6b5cbb1-4f9c-4d4e-9a5a-c6b9fb6f2c0a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-787940559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "858651f51ffd49a48f3e98e7de4d87e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d6adb4-b6", "ovs_interfaceid": "17d6adb4-b6f5-4c34-936d-35d1a4920106", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:bf:bb,bridge_name='br-int',has_traffic_filtering=True,id=17d6adb4-b6f5-4c34-936d-35d1a4920106,network=Network(e6b5cbb1-4f9c-4d4e-9a5a-c6b9fb6f2c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17d6adb4-b6') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG os_vif [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:bf:bb,bridge_name='br-int',has_traffic_filtering=True,id=17d6adb4-b6f5-4c34-936d-35d1a4920106,network=Network(e6b5cbb1-4f9c-4d4e-9a5a-c6b9fb6f2c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17d6adb4-b6') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap17d6adb4-b6, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:38:37 user nova-compute[73056]: INFO os_vif [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:bf:bb,bridge_name='br-int',has_traffic_filtering=True,id=17d6adb4-b6f5-4c34-936d-35d1a4920106,network=Network(e6b5cbb1-4f9c-4d4e-9a5a-c6b9fb6f2c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17d6adb4-b6')
Aug 14 16:38:37 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mCfQgvrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:38:37 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 16:38:37 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.448s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] <== connect_volume: return (2450ms) {'type': 'block', 'scsi_wwn': '23235303238393132', 'path': '/dev/sdk'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235303238393132', 'path': '/dev/sdk'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-7906b641-254e-452f-8937-24e17bfe7ae6 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.911s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906b641-254e-452f-8937-24e17bfe7ae6 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG nova.objects.instance [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Lazy-loading 'flavor' on Instance uuid b990e37f-8611-430f-89b1-ae6aeed24b38 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3faa77d-16c6-4e7b-b6c5-67d9fdf1eeb7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 16:38:37 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:38:37 user nova-compute[73056]:   <source dev="/dev/sdk"/>
Aug 14 16:38:37 user nova-compute[73056]:   <target dev="sdc" bus="scsi"/>
Aug 14 16:38:37 user nova-compute[73056]:   <serial>c343a9db-b962-4b29-b05a-5906a6df5a5b</serial>
Aug 14 16:38:37 user nova-compute[73056]:   <address type="drive" controller="0" unit="2"/>
Aug 14 16:38:37 user nova-compute[73056]: </disk>
Aug 14 16:38:37 user nova-compute[73056]:  {{(pid=73056) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Acquiring lock "9927d1d6-6e26-4408-b509-c96df5f314d6" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Lock "9927d1d6-6e26-4408-b509-c96df5f314d6" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[1145dc53-9438-4083-b4db-0d3bdddf28b1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906b641-254e-452f-8937-24e17bfe7ae6 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c (non-flash)
Aug 14 16:38:37 user nova-compute[73056]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b (non-flash)
Aug 14 16:38:37 user nova-compute[73056]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b (non-flash)
Aug 14 16:38:37 user nova-compute[73056]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:38:37 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:37 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:37 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:37 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:37 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:38:37 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:38:37 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906b641-254e-452f-8937-24e17bfe7ae6 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c (non-flash)
Aug 14 16:38:37 user nova-compute[73056]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b (non-flash)
Aug 14 16:38:37 user nova-compute[73056]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b (non-flash)
Aug 14 16:38:37 user nova-compute[73056]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:38:37 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:37 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:37 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:37 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:37 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:38:37 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:38:37 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906b641-254e-452f-8937-24e17bfe7ae6 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff30074e170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c'): ({'sdj'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-7906b641-254e-452f-8937-24e17bfe7ae6 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Removing single pathed devices sdj {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG os_brick.utils [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7517ebdb-74e6-45bc-84e7-0f8266442d8e]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc3f747-4d4f-4c5c-a40a-6beba49075af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08274aa-159d-415b-903f-10a201348915]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-7906b641-254e-452f-8937-24e17bfe7ae6 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Flushing IO for device /dev/sdj {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0660076-6104-47df-b148-8b53c3cc6508]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4fa600-313d-4f1a-a95d-bac607d1e12a]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-7906b641-254e-452f-8937-24e17bfe7ae6 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b83be86-b60e-4cb1-90e9-05128af96b96]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12b6bd6-3c66-4ce2-bcb2-6d700c758afa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.054s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06bbd9c-dd21-4a38-833f-8b9d67ca2272]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-7906b641-254e-452f-8937-24e17bfe7ae6 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-7906b641-254e-452f-8937-24e17bfe7ae6 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] SCSI volumes sdj have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906b641-254e-452f-8937-24e17bfe7ae6 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:38:37 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:38:37 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c670d589-770b-4d3c-8f90-20fb78bbc18e]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG os_brick.utils [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c35075-2e4f-499e-ac3f-c5ca9f455fc7]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906b641-254e-452f-8937-24e17bfe7ae6 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb1a00d-ed44-495e-b29c-01c315f3c09e]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906b641-254e-452f-8937-24e17bfe7ae6 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c, portal: 172.16.0.220,3260]
Aug 14 16:38:38 user nova-compute[73056]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c, portal: 172.16.0.220,3260] successful.
Aug 14 16:38:38 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:38 user nova-compute[73056]: INFO nova.compute.manager [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Swapping volume 54a15b78-0b03-4e36-b1bb-4772f342893b for 250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e272e19-d850-4281-8313-33eb1bb87b6c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ec1525-b5de-48be-b19a-cbe5d5e94b51]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906b641-254e-452f-8937-24e17bfe7ae6 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-7906b641-254e-452f-8937-24e17bfe7ae6 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906b641-254e-452f-8937-24e17bfe7ae6 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] <== disconnect_volume: return (2286ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7906b641-254e-452f-8937-24e17bfe7ae6 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.998s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[8972dc40-512d-47ca-a934-15d58073d18f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[6426fc5c-7603-4de4-9ee5-9be799887a32]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b (non-flash)
Aug 14 16:38:38 user nova-compute[73056]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b (non-flash)
Aug 14 16:38:38 user nova-compute[73056]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:38:38 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:38 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:38 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:38 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:38 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:38:38 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:38:38 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b (non-flash)
Aug 14 16:38:38 user nova-compute[73056]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b (non-flash)
Aug 14 16:38:38 user nova-compute[73056]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:38:38 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:38 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:38 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:38 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:38 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:38:38 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:38:38 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff2dce47490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4'): ({'sdb'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Removing single pathed devices sdb {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8700cfb-6eee-4a13-b2c2-933f4935881a]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c546b51-e247-487d-9f92-1f2662f5454b]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Flushing IO for device /dev/sdb {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f469870-75e3-4bc0-858a-a885d133cd32]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] No BDM found with device name sda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] No BDM found with device name sdc, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] No VIF found with MAC fa:16:3e:52:e6:55, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[491dc985-1f91-4129-963d-c2625b33ac14]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] SCSI volumes sdb have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5f3867-ce77-43c7-bea4-aebcb8ce8d22]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d9c0310b-ab38-461c-aed0-14456b4f1aa5 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Lock "b990e37f-8611-430f-89b1-ae6aeed24b38" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.174s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb34e30-eafd-4f39-b5d9-7574f15cc43e]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4, portal: 172.16.0.220,3260]
Aug 14 16:38:38 user nova-compute[73056]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4, portal: 172.16.0.220,3260] successful.
Aug 14 16:38:38 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef17dfc5-aa0e-4789-b55c-129928ba76ff]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] <== disconnect_volume: return (1357ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:38:38 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Deleting instance files /opt/stack/data/nova/instances/a329b987-231e-47a8-9f2d-71c15573f9f0_del
Aug 14 16:38:38 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Deletion of /opt/stack/data/nova/instances/a329b987-231e-47a8-9f2d-71c15573f9f0_del complete
Aug 14 16:38:38 user nova-compute[73056]: DEBUG nova.compute.manager [req-2433f89b-9a50-456f-b16f-d8041aaaf8cf req-d957db38-150a-4548-a887-7d9759d4d548 service nova] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Received event network-vif-plugged-17d6adb4-b6f5-4c34-936d-35d1a4920106 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2433f89b-9a50-456f-b16f-d8041aaaf8cf req-d957db38-150a-4548-a887-7d9759d4d548 service nova] Acquiring lock "a329b987-231e-47a8-9f2d-71c15573f9f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2433f89b-9a50-456f-b16f-d8041aaaf8cf req-d957db38-150a-4548-a887-7d9759d4d548 service nova] Lock "a329b987-231e-47a8-9f2d-71c15573f9f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2433f89b-9a50-456f-b16f-d8041aaaf8cf req-d957db38-150a-4548-a887-7d9759d4d548 service nova] Lock "a329b987-231e-47a8-9f2d-71c15573f9f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG nova.compute.manager [req-2433f89b-9a50-456f-b16f-d8041aaaf8cf req-d957db38-150a-4548-a887-7d9759d4d548 service nova] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] No waiting events found dispatching network-vif-plugged-17d6adb4-b6f5-4c34-936d-35d1a4920106 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:38:38 user nova-compute[73056]: WARNING nova.compute.manager [req-2433f89b-9a50-456f-b16f-d8041aaaf8cf req-d957db38-150a-4548-a887-7d9759d4d548 service nova] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Received unexpected event network-vif-plugged-17d6adb4-b6f5-4c34-936d-35d1a4920106 for instance with vm_state active and task_state rebuilding.
Aug 14 16:38:38 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance a329b987-231e-47a8-9f2d-71c15573f9f0 could not be found.
Aug 14 16:38:38 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mCfQgvrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:38:38 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 16:38:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[877cc28a-3fec-409d-8700-f5e2896800da]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[906ba58b-7120-4fd6-91a4-f879370970a2]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b (non-flash)
Aug 14 16:38:38 user nova-compute[73056]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b (non-flash)
Aug 14 16:38:38 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:38 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:38 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:38 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:38 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:38:38 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:38:38 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b (non-flash)
Aug 14 16:38:38 user nova-compute[73056]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b (non-flash)
Aug 14 16:38:38 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:38 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:38 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:38 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:38 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:38:38 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:38:38 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff2dce4c940>, {}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Disconnecting from: [] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.062s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] <== disconnect_volume: return (62ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:38:38 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:38:39 user nova-compute[73056]: DEBUG nova.objects.instance [None req-7906b641-254e-452f-8937-24e17bfe7ae6 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lazy-loading 'flavor' on Instance uuid 0fd5ba83-0612-4ce2-bd44-3ab55820022f {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:38:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7906b641-254e-452f-8937-24e17bfe7ae6 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "0fd5ba83-0612-4ce2-bd44-3ab55820022f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.388s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-989a59ab-3ac6-46b4-878d-6a1f1dd35f6d tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Acquiring lock "b990e37f-8611-430f-89b1-ae6aeed24b38" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-989a59ab-3ac6-46b4-878d-6a1f1dd35f6d tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Lock "b990e37f-8611-430f-89b1-ae6aeed24b38" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:39 user nova-compute[73056]: INFO nova.compute.manager [None req-989a59ab-3ac6-46b4-878d-6a1f1dd35f6d tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Detaching volume c343a9db-b962-4b29-b05a-5906a6df5a5b
Aug 14 16:38:39 user nova-compute[73056]: DEBUG nova.compute.manager [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Preparing to wait for external event volume-reimaged-663decc6-865c-4b8c-90f2-d6c4918e27d4 {{(pid=73056) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 14 16:38:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Acquiring lock "a329b987-231e-47a8-9f2d-71c15573f9f0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lock "a329b987-231e-47a8-9f2d-71c15573f9f0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lock "a329b987-231e-47a8-9f2d-71c15573f9f0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:39 user nova-compute[73056]: INFO nova.virt.block_device [None req-989a59ab-3ac6-46b4-878d-6a1f1dd35f6d tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Attempting to driver detach volume c343a9db-b962-4b29-b05a-5906a6df5a5b from mountpoint /dev/sdc
Aug 14 16:38:39 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-989a59ab-3ac6-46b4-878d-6a1f1dd35f6d tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Attempting to detach device sdc from instance b990e37f-8611-430f-89b1-ae6aeed24b38 from the persistent domain config. {{(pid=73056) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 16:38:39 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-989a59ab-3ac6-46b4-878d-6a1f1dd35f6d tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 16:38:39 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:38:39 user nova-compute[73056]:   <source dev="/dev/sdk"/>
Aug 14 16:38:39 user nova-compute[73056]:   <target dev="sdc" bus="scsi"/>
Aug 14 16:38:39 user nova-compute[73056]:   <serial>c343a9db-b962-4b29-b05a-5906a6df5a5b</serial>
Aug 14 16:38:39 user nova-compute[73056]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 14 16:38:39 user nova-compute[73056]: </disk>
Aug 14 16:38:39 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 16:38:39 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-989a59ab-3ac6-46b4-878d-6a1f1dd35f6d tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Successfully detached device sdc from instance b990e37f-8611-430f-89b1-ae6aeed24b38 from the persistent domain config.
Aug 14 16:38:39 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-989a59ab-3ac6-46b4-878d-6a1f1dd35f6d tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance b990e37f-8611-430f-89b1-ae6aeed24b38 from the live domain config. {{(pid=73056) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 16:38:39 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-989a59ab-3ac6-46b4-878d-6a1f1dd35f6d tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 16:38:39 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:38:39 user nova-compute[73056]:   <source dev="/dev/sdk"/>
Aug 14 16:38:39 user nova-compute[73056]:   <target dev="sdc" bus="scsi"/>
Aug 14 16:38:39 user nova-compute[73056]:   <serial>c343a9db-b962-4b29-b05a-5906a6df5a5b</serial>
Aug 14 16:38:39 user nova-compute[73056]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 14 16:38:39 user nova-compute[73056]: </disk>
Aug 14 16:38:39 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Received event <DeviceRemovedEvent: 1692031120.2618785, b990e37f-8611-430f-89b1-ae6aeed24b38 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73056) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-989a59ab-3ac6-46b4-878d-6a1f1dd35f6d tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance b990e37f-8611-430f-89b1-ae6aeed24b38 {{(pid=73056) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 16:38:40 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-989a59ab-3ac6-46b4-878d-6a1f1dd35f6d tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Successfully detached device sdc from instance b990e37f-8611-430f-89b1-ae6aeed24b38 from the live domain config.
Aug 14 16:38:40 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-989a59ab-3ac6-46b4-878d-6a1f1dd35f6d tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-989a59ab-3ac6-46b4-878d-6a1f1dd35f6d tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DPvsyfGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:38:40 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-989a59ab-3ac6-46b4-878d-6a1f1dd35f6d tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:38:40 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-989a59ab-3ac6-46b4-878d-6a1f1dd35f6d tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-989a59ab-3ac6-46b4-878d-6a1f1dd35f6d tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-989a59ab-3ac6-46b4-878d-6a1f1dd35f6d tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cec2984-bfd7-483f-8233-07eb45a51251]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f30500-3765-4624-9357-8e85f224d019]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-989a59ab-3ac6-46b4-878d-6a1f1dd35f6d tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b (non-flash)
Aug 14 16:38:40 user nova-compute[73056]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b (non-flash)
Aug 14 16:38:40 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:40 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:40 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:40 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:40 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:38:40 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:38:40 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-989a59ab-3ac6-46b4-878d-6a1f1dd35f6d tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b (non-flash)
Aug 14 16:38:40 user nova-compute[73056]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b (non-flash)
Aug 14 16:38:40 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:40 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:40 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:40 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:40 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:38:40 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:38:40 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-989a59ab-3ac6-46b4-878d-6a1f1dd35f6d tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3007e3250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b'): ({'sdk'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-989a59ab-3ac6-46b4-878d-6a1f1dd35f6d tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Removing single pathed devices sdk {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3401831-3e9f-457f-ad66-4dc1ac2bc509]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b13b165-13fe-4c9b-9b61-bcfbd52e4efe]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-989a59ab-3ac6-46b4-878d-6a1f1dd35f6d tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Flushing IO for device /dev/sdk {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.015s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[185da068-fab3-4487-baf2-61da00e826e2]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-989a59ab-3ac6-46b4-878d-6a1f1dd35f6d tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.037s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7519a510-c693-4060-80da-3bcb03bc850b]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-989a59ab-3ac6-46b4-878d-6a1f1dd35f6d tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-989a59ab-3ac6-46b4-878d-6a1f1dd35f6d tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] SCSI volumes sdk have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-989a59ab-3ac6-46b4-878d-6a1f1dd35f6d tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff43ad8d-9ec7-4c67-ad16-a521a641695c]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-989a59ab-3ac6-46b4-878d-6a1f1dd35f6d tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef7eee6-9745-4e83-bb50-0b7470841406]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-989a59ab-3ac6-46b4-878d-6a1f1dd35f6d tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b, portal: 172.16.0.220,3260]
Aug 14 16:38:40 user nova-compute[73056]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b, portal: 172.16.0.220,3260] successful.
Aug 14 16:38:40 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c343a9db-b962-4b29-b05a-5906a6df5a5b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b062b5ac-31fc-4c39-94cc-acaea2833784]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-989a59ab-3ac6-46b4-878d-6a1f1dd35f6d tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-989a59ab-3ac6-46b4-878d-6a1f1dd35f6d tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-989a59ab-3ac6-46b4-878d-6a1f1dd35f6d tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] <== disconnect_volume: return (340ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:38:40 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-989a59ab-3ac6-46b4-878d-6a1f1dd35f6d tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:38:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:47 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:38:47 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:38:48 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:38:48 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:38:48 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG nova.objects.instance [None req-989a59ab-3ac6-46b4-878d-6a1f1dd35f6d tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Lazy-loading 'flavor' on Instance uuid b990e37f-8611-430f-89b1-ae6aeed24b38 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-989a59ab-3ac6-46b4-878d-6a1f1dd35f6d tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Lock "b990e37f-8611-430f-89b1-ae6aeed24b38" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 9.690s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9927d1d6-6e26-4408-b509-c96df5f314d6/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG nova.compute.manager [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BKacklrm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9927d1d6-6e26-4408-b509-c96df5f314d6', 'attached_at': '', 'detached_at': '', 'volume_id': '250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b', 'serial': '250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oRfJwBhO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '9927d1d6-6e26-4408-b509-c96df5f314d6', 'attached_at': '', 'detached_at': '', 'volume_id': '54a15b78-0b03-4e36-b1bb-4772f342893b', 'serial'} {{(pid=73056) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BKacklrm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:38:49 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:38:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:38:49 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:38:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:38:49 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:38:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d14a52a-8b72-48e9-90b3-7573f596eba3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:38:49 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c649d811-5ba4-4817-864f-28131f6dbd8b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b] added
Aug 14 16:38:49 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c84750-d06d-428c-9b8b-3a3b938eb70e]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[30543687-0c21-4995-a7dd-b2558cc23488]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BKacklrm {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9927d1d6-6e26-4408-b509-c96df5f314d6/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9927d1d6-6e26-4408-b509-c96df5f314d6/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BKacklrm" returned: 0 in 0.060s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbe84a4-751b-4baf-bcbd-8a465e6fca20]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BKacklrm'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[266b42a2-eaa0-4521-b7b5-a2148d7d5490]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[28772cae-98da-43da-af15-431675e2be53]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b (non-flash)
Aug 14 16:38:49 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:49 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:49 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:49 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:49 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:38:49 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:38:49 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b (non-flash)
Aug 14 16:38:49 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:49 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:49 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:49 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:49 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:38:49 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:38:49 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0a332860-1c78-49d1-a378-150be14c62d8 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Acquiring lock "b990e37f-8611-430f-89b1-ae6aeed24b38" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0a332860-1c78-49d1-a378-150be14c62d8 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Lock "b990e37f-8611-430f-89b1-ae6aeed24b38" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0a332860-1c78-49d1-a378-150be14c62d8 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Acquiring lock "b990e37f-8611-430f-89b1-ae6aeed24b38-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0a332860-1c78-49d1-a378-150be14c62d8 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Lock "b990e37f-8611-430f-89b1-ae6aeed24b38-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0a332860-1c78-49d1-a378-150be14c62d8 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Lock "b990e37f-8611-430f-89b1-ae6aeed24b38-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:49 user nova-compute[73056]: INFO nova.compute.manager [None req-0a332860-1c78-49d1-a378-150be14c62d8 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Terminating instance
Aug 14 16:38:49 user nova-compute[73056]: DEBUG nova.compute.manager [None req-0a332860-1c78-49d1-a378-150be14c62d8 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ffb0ac-ff34-4174-be16-7fe71e59e8e0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b, portal: 172.16.0.220,3260]
Aug 14 16:38:50 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b, portal: 172.16.0.220,3260] successful.
Aug 14 16:38:50 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9927d1d6-6e26-4408-b509-c96df5f314d6/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a013b1e-7fc9-4ad7-a023-95827e2a4228/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b3242b-30fe-413f-9502-47382386fe43]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f2f54a-763b-4a23-8af1-355ecc47c21f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b (non-flash)
Aug 14 16:38:50 user nova-compute[73056]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b (non-flash)
Aug 14 16:38:50 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:50 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:50 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:50 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:50 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:38:50 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:38:50 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b (non-flash)
Aug 14 16:38:50 user nova-compute[73056]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b (non-flash)
Aug 14 16:38:50 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:50 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:50 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:50 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:50 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:38:50 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:38:50 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.451s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[992d7405-7370-478a-b741-cc5358943acb]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: None {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a013b1e-7fc9-4ad7-a023-95827e2a4228/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a013b1e-7fc9-4ad7-a023-95827e2a4228/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG nova.compute.manager [req-0ca1f0fb-146c-4450-bc42-e75fb7852cc4 req-2f2e9141-d6c9-4bcb-818b-45dd0384dbb7 service nova] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Received event network-vif-unplugged-56271c0a-c509-463b-88eb-05e97b76e470 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0ca1f0fb-146c-4450-bc42-e75fb7852cc4 req-2f2e9141-d6c9-4bcb-818b-45dd0384dbb7 service nova] Acquiring lock "b990e37f-8611-430f-89b1-ae6aeed24b38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0ca1f0fb-146c-4450-bc42-e75fb7852cc4 req-2f2e9141-d6c9-4bcb-818b-45dd0384dbb7 service nova] Lock "b990e37f-8611-430f-89b1-ae6aeed24b38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0ca1f0fb-146c-4450-bc42-e75fb7852cc4 req-2f2e9141-d6c9-4bcb-818b-45dd0384dbb7 service nova] Lock "b990e37f-8611-430f-89b1-ae6aeed24b38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG nova.compute.manager [req-0ca1f0fb-146c-4450-bc42-e75fb7852cc4 req-2f2e9141-d6c9-4bcb-818b-45dd0384dbb7 service nova] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] No waiting events found dispatching network-vif-unplugged-56271c0a-c509-463b-88eb-05e97b76e470 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG nova.compute.manager [req-0ca1f0fb-146c-4450-bc42-e75fb7852cc4 req-2f2e9141-d6c9-4bcb-818b-45dd0384dbb7 service nova] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Received event network-vif-unplugged-56271c0a-c509-463b-88eb-05e97b76e470 for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a013b1e-7fc9-4ad7-a023-95827e2a4228/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:50 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Instance destroyed successfully.
Aug 14 16:38:50 user nova-compute[73056]: DEBUG nova.objects.instance [None req-0a332860-1c78-49d1-a378-150be14c62d8 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Lazy-loading 'resources' on Instance uuid b990e37f-8611-430f-89b1-ae6aeed24b38 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-0a332860-1c78-49d1-a378-150be14c62d8 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:36:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-813253946',display_name='tempest-AttachSCSIVolumeTestJSON-server-813253946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-813253946',id=4,image_ref='cf874659-9a84-4ee7-81ef-80e69b332ef7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEBPpP93nZ8Sgk6bPlP2IPg9GfXAicLSRf2Hru7i9HNqz/4nVRI19B8iL9AI2VYIqA+I2VlGMKPUF6KrA3yvgBK2LH30YKtXnAJYfBSi6OqDJc913PAHY4laEJRhn84J0Q==',key_name='tempest-keypair-729882717',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:36:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='38887e3747844b33936f9b02b921c3d4',ramdisk_id='',reservation_id='r-hhkh1c9t',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf874659-9a84-4ee7-81ef-80e69b332ef7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1372218985',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1372218985-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:36:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a18eaacbc61402fbe681ff831089a2f',uuid=b990e37f-8611-430f-89b1-ae6aeed24b38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56271c0a-c509-463b-88eb-05e97b76e470", "address": "fa:16:3e:52:e6:55", "network": {"id": "0aca6007-75fe-4253-9996-634b8f099215", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1016531183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38887e3747844b33936f9b02b921c3d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56271c0a-c5", "ovs_interfaceid": "56271c0a-c509-463b-88eb-05e97b76e470", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-0a332860-1c78-49d1-a378-150be14c62d8 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Converting VIF {"id": "56271c0a-c509-463b-88eb-05e97b76e470", "address": "fa:16:3e:52:e6:55", "network": {"id": "0aca6007-75fe-4253-9996-634b8f099215", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1016531183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38887e3747844b33936f9b02b921c3d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56271c0a-c5", "ovs_interfaceid": "56271c0a-c509-463b-88eb-05e97b76e470", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-0a332860-1c78-49d1-a378-150be14c62d8 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:e6:55,bridge_name='br-int',has_traffic_filtering=True,id=56271c0a-c509-463b-88eb-05e97b76e470,network=Network(0aca6007-75fe-4253-9996-634b8f099215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56271c0a-c5') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG os_vif [None req-0a332860-1c78-49d1-a378-150be14c62d8 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:e6:55,bridge_name='br-int',has_traffic_filtering=True,id=56271c0a-c509-463b-88eb-05e97b76e470,network=Network(0aca6007-75fe-4253-9996-634b8f099215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56271c0a-c5') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56271c0a-c5, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:38:50 user nova-compute[73056]: INFO os_vif [None req-0a332860-1c78-49d1-a378-150be14c62d8 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:e6:55,bridge_name='br-int',has_traffic_filtering=True,id=56271c0a-c509-463b-88eb-05e97b76e470,network=Network(0aca6007-75fe-4253-9996-634b8f099215),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56271c0a-c5')
Aug 14 16:38:50 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-0a332860-1c78-49d1-a378-150be14c62d8 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Deleting instance files /opt/stack/data/nova/instances/b990e37f-8611-430f-89b1-ae6aeed24b38_del
Aug 14 16:38:50 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-0a332860-1c78-49d1-a378-150be14c62d8 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Deletion of /opt/stack/data/nova/instances/b990e37f-8611-430f-89b1-ae6aeed24b38_del complete
Aug 14 16:38:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:51 user nova-compute[73056]: INFO nova.compute.manager [None req-0a332860-1c78-49d1-a378-150be14c62d8 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Took 1.06 seconds to destroy the instance on the hypervisor.
Aug 14 16:38:51 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-0a332860-1c78-49d1-a378-150be14c62d8 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 16:38:51 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 16:38:51 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 16:38:51 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:51 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:51 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:38:51 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BKacklrm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:38:51 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.499s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:38:51 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] <== connect_volume: return (1502ms) {'type': 'block', 'scsi_wwn': '26539383733383435', 'path': '/dev/sdb'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:38:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539383733383435', 'path': '/dev/sdb'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:38:51 user nova-compute[73056]: DEBUG nova.objects.instance [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Lazy-loading 'flavor' on Instance uuid 9927d1d6-6e26-4408-b509-c96df5f314d6 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:38:51 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:51 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Error from libvirt while getting description of instance-00000004: [Error Code 42] Domain not found: no domain with matching uuid 'b990e37f-8611-430f-89b1-ae6aeed24b38' (instance-00000004): libvirt.libvirtError: Domain not found: no domain with matching uuid 'b990e37f-8611-430f-89b1-ae6aeed24b38' (instance-00000004)
Aug 14 16:38:51 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5ba83-0612-4ce2-bd44-3ab55820022f/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:51 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5ba83-0612-4ce2-bd44-3ab55820022f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:51 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5ba83-0612-4ce2-bd44-3ab55820022f/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=73056) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 16:38:51 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5ba83-0612-4ce2-bd44-3ab55820022f/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:38:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:38:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:38:51 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f3d2be-ec24-413c-b44e-873b82268212/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:52 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692031117.0188584, a329b987-231e-47a8-9f2d-71c15573f9f0 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:38:52 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] VM Stopped (Lifecycle Event)
Aug 14 16:38:52 user nova-compute[73056]: DEBUG nova.compute.manager [None req-9aa05c5c-fa08-44a7-9ec9-d226d036dcc6 None None] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:38:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] COPY block job progress, current cursor: 113246208 final cursor: 1073741824 {{(pid=73056) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 16:38:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f3d2be-ec24-413c-b44e-873b82268212/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f3d2be-ec24-413c-b44e-873b82268212/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f3d2be-ec24-413c-b44e-873b82268212/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:38:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:38:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:38:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-a5b23b64-5567-47d6-869c-f7595af9a6a4 req-232aaebc-55dd-46de-83ce-1d81b92ca273 service nova] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Received event network-vif-plugged-56271c0a-c509-463b-88eb-05e97b76e470 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:38:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a5b23b64-5567-47d6-869c-f7595af9a6a4 req-232aaebc-55dd-46de-83ce-1d81b92ca273 service nova] Acquiring lock "b990e37f-8611-430f-89b1-ae6aeed24b38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a5b23b64-5567-47d6-869c-f7595af9a6a4 req-232aaebc-55dd-46de-83ce-1d81b92ca273 service nova] Lock "b990e37f-8611-430f-89b1-ae6aeed24b38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a5b23b64-5567-47d6-869c-f7595af9a6a4 req-232aaebc-55dd-46de-83ce-1d81b92ca273 service nova] Lock "b990e37f-8611-430f-89b1-ae6aeed24b38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-a5b23b64-5567-47d6-869c-f7595af9a6a4 req-232aaebc-55dd-46de-83ce-1d81b92ca273 service nova] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] No waiting events found dispatching network-vif-plugged-56271c0a-c509-463b-88eb-05e97b76e470 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:38:53 user nova-compute[73056]: WARNING nova.compute.manager [req-a5b23b64-5567-47d6-869c-f7595af9a6a4 req-232aaebc-55dd-46de-83ce-1d81b92ca273 service nova] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Received unexpected event network-vif-plugged-56271c0a-c509-463b-88eb-05e97b76e470 for instance with vm_state active and task_state deleting.
Aug 14 16:38:53 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:38:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquiring lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:53 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] COPY block job progress, current cursor: 441450496 final cursor: 1073741824 {{(pid=73056) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 16:38:53 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:38:53 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:38:53 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=7266MB free_disk=25.59564208984375GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 16:38:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:53 user nova-compute[73056]: DEBUG nova.objects.instance [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lazy-loading 'flavor' on Instance uuid 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:38:53 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Took 2.42 seconds to deallocate network for instance.
Aug 14 16:38:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.167s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0a332860-1c78-49d1-a378-150be14c62d8 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:53 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 9f3a7f8a-e3b9-4918-9663-968677fe5c90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:38:53 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 0fd5ba83-0612-4ce2-bd44-3ab55820022f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:38:53 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance b990e37f-8611-430f-89b1-ae6aeed24b38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:38:53 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 3a013b1e-7fc9-4ad7-a023-95827e2a4228 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:38:53 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 9927d1d6-6e26-4408-b509-c96df5f314d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:38:53 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance a329b987-231e-47a8-9f2d-71c15573f9f0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:38:53 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:38:53 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 10d46e97-4721-49a0-beed-c022e9045b18 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:38:53 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance d15f23ae-f5a4-47cf-b136-7072c7838790 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:38:53 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 03f3d2be-ec24-413c-b44e-873b82268212 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:38:53 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 16:38:53 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 16:38:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquiring lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:53 user nova-compute[73056]: INFO nova.compute.manager [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Attaching volume cdf3d64f-ff30-4b56-8937-48b4d97bed1d to /dev/vdb
Aug 14 16:38:53 user nova-compute[73056]: DEBUG os_brick.utils [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:38:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:53 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] COPY block job progress, current cursor: 596639744 final cursor: 1073741824 {{(pid=73056) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 16:38:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:53 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[8923138c-6d21-4477-8795-fc6e8280f20a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.051s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:54 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1d2805-89b6-473d-8fb4-03ebfcc22925]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:54 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[3268e22c-0fc3-46be-9708-3dad57f377c3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:54 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f579c4-5eaf-4b9b-82ce-d40b9b4d4c1b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:38:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:38:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:38:54 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:38:54 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dca9cd7-1678-410e-9e50-d0ba97801990]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:38:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:38:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:38:54 user nova-compute[73056]: DEBUG os_brick.utils [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:38:54 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Updating existing volume attachment record: 0404e901-a433-4466-bb19-1bc78da2b962 {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 16:38:54 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:38:54 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:38:54 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 16:38:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.922s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0a332860-1c78-49d1-a378-150be14c62d8 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.734s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] COPY block job progress, current cursor: 621805568 final cursor: 1073741824 {{(pid=73056) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 16:38:54 user nova-compute[73056]: DEBUG nova.compute.manager [req-2e1d8df2-0902-43d2-8d40-dd72e855f26a req-6305623c-e506-4abb-aa4f-f2df931c5d0e service nova] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Received event network-vif-deleted-56271c0a-c509-463b-88eb-05e97b76e470 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:38:54 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-0a332860-1c78-49d1-a378-150be14c62d8 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:38:54 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-0a332860-1c78-49d1-a378-150be14c62d8 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:38:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0a332860-1c78-49d1-a378-150be14c62d8 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:54 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-0a332860-1c78-49d1-a378-150be14c62d8 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Deleted allocations for instance b990e37f-8611-430f-89b1-ae6aeed24b38
Aug 14 16:38:55 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] COPY block job progress, current cursor: 725614592 final cursor: 1073741824 {{(pid=73056) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 16:38:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0a332860-1c78-49d1-a378-150be14c62d8 tempest-AttachSCSIVolumeTestJSON-1372218985 tempest-AttachSCSIVolumeTestJSON-1372218985-project-member] Lock "b990e37f-8611-430f-89b1-ae6aeed24b38" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.014s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:55 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:38:55 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 16:38:55 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] COPY block job progress, current cursor: 881852416 final cursor: 1073741824 {{(pid=73056) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 16:38:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-0fd5ba83-0612-4ce2-bd44-3ab55820022f" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:38:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-0fd5ba83-0612-4ce2-bd44-3ab55820022f" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:38:55 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 16:38:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] COPY block job progress, current cursor: 1044381696 final cursor: 1073741824 {{(pid=73056) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Updating instance_info_cache with network_info: [{"id": "86a6c609-36e2-43e7-a675-670cdf35db58", "address": "fa:16:3e:eb:73:c7", "network": {"id": "2b53e507-f50b-411d-bce8-8769fc50bc28", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-515017098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4bf992869a24ad2b1d391e2baff2b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a6c609-36", "ovs_interfaceid": "86a6c609-36e2-43e7-a675-670cdf35db58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-0fd5ba83-0612-4ce2-bd44-3ab55820022f" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73056) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oRfJwBhO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:38:56 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:38:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[65cc856b-ef2a-4d34-bbcb-0ce038f40bdf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[def2381e-4c0a-457a-b9ea-5c000cd5d1fd]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b (non-flash)
Aug 14 16:38:56 user nova-compute[73056]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b (non-flash)
Aug 14 16:38:56 user nova-compute[73056]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:38:56 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:56 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:56 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:56 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:56 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:38:56 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:38:56 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b (non-flash)
Aug 14 16:38:56 user nova-compute[73056]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b (non-flash)
Aug 14 16:38:56 user nova-compute[73056]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:38:56 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:38:56 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:38:56 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:38:56 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:38:56 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:38:56 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:38:56 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff2dce5cd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b'): ({'sdi'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Removing single pathed devices sdi {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[527dfe8b-93cd-4ff7-8d8b-c29472fc0caf]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.026s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf354f2-e6b8-42bf-84f5-059c8cc7ec35]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Flushing IO for device /dev/sdi {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG nova.compute.manager [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.016s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36fd27c-e388-47bc-981c-336a060a74fb]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.045s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed017cd2-48a5-4c29-ae41-2382ef89c6bf]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] SCSI volumes sdi have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d729f3ee-4c64-4041-a7db-0ce0599c8ca9]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:38:56 user nova-compute[73056]: INFO nova.compute.claims [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Claim successful on node user
Aug 14 16:38:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9f95d0-8bf8-458a-a299-e8a5290bbab9]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b, portal: 172.16.0.220,3260]
Aug 14 16:38:56 user nova-compute[73056]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b, portal: 172.16.0.220,3260] successful.
Aug 14 16:38:56 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.048s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:57 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[6185c0b8-653d-428c-80a3-a93be122fff3]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:38:57 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:38:57 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:38:57 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] <== disconnect_volume: return (387ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:38:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:38:57 user nova-compute[73056]: DEBUG nova.compute.manager [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BKacklrm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '9927d1d6-6e26-4408-b509-c96df5f314d6', 'attached_at': '', 'detached_at': '', 'volume_id': '250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b', 'serial'} {{(pid=73056) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 14 16:38:57 user nova-compute[73056]: DEBUG nova.compute.manager [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] swap_volume: removing Cinder connection for volume 54a15b78-0b03-4e36-b1bb-4772f342893b {{(pid=73056) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 14 16:38:57 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:38:57 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:38:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.465s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:57 user nova-compute[73056]: DEBUG nova.compute.manager [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:38:57 user nova-compute[73056]: DEBUG nova.compute.manager [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:38:57 user nova-compute[73056]: DEBUG nova.network.neutron [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:38:57 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:38:57 user nova-compute[73056]: DEBUG nova.policy [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9404ed7386e14eed8d046e8c45942c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd5723fb8384aa985cf401d95aa7d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:38:57 user nova-compute[73056]: DEBUG nova.compute.manager [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:38:57 user nova-compute[73056]: DEBUG nova.compute.manager [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:38:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:38:57 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Creating image(s)
Aug 14 16:38:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "/opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "/opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "/opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.190s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "c889592ab94cd0b0ce896f27a2af0323771db234" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.191s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/disk 1073741824" returned: 0 in 0.097s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:58 user nova-compute[73056]: DEBUG nova.network.neutron [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Successfully created port: c2e32544-47df-43ff-ae83-c30388d9d618 {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:38:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.179s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:58 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 16:38:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:38:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:38:58 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Cannot resize image /opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 16:38:58 user nova-compute[73056]: DEBUG nova.objects.instance [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lazy-loading 'migration_context' on Instance uuid 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:38:58 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 16:38:58 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Ensure instance console log exists: /opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:38:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:38:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:38:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:58 user nova-compute[73056]: DEBUG nova.compute.manager [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] swap_volume: Updating volume 54a15b78-0b03-4e36-b1bb-4772f342893b BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "BKacklrm", "auth_password": "DoTCG4gq3689mF", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b"}, "status": "reserved", "instance": "9927d1d6-6e26-4408-b509-c96df5f314d6", "attached_at": "", "detached_at": "", "volume_id": "250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b", "serial": "250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b', 'no_device': None, 'attachment_id': '558f0fcb-b5d0-43f4-93fa-744ccd49af04'} {{(pid=73056) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 14 16:38:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-99a8247f-87e1-464a-b624-c17c4d9ea3e5 tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Lock "9927d1d6-6e26-4408-b509-c96df5f314d6" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 21.100s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG nova.network.neutron [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Successfully updated port: c2e32544-47df-43ff-ae83-c30388d9d618 {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "refresh_cache-5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquired lock "refresh_cache-5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG nova.network.neutron [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG nova.network.neutron [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG nova.compute.manager [req-e6b078ca-b3fd-46a8-8843-d2d559aa8099 req-018332ae-3a81-4660-93dd-364bdef64611 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Received event network-changed-c2e32544-47df-43ff-ae83-c30388d9d618 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG nova.compute.manager [req-e6b078ca-b3fd-46a8-8843-d2d559aa8099 req-018332ae-3a81-4660-93dd-364bdef64611 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Refreshing instance network info cache due to event network-changed-c2e32544-47df-43ff-ae83-c30388d9d618. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e6b078ca-b3fd-46a8-8843-d2d559aa8099 req-018332ae-3a81-4660-93dd-364bdef64611 service nova] Acquiring lock "refresh_cache-5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG nova.network.neutron [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Updating instance_info_cache with network_info: [{"id": "c2e32544-47df-43ff-ae83-c30388d9d618", "address": "fa:16:3e:9d:43:1e", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2e32544-47", "ovs_interfaceid": "c2e32544-47df-43ff-ae83-c30388d9d618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Releasing lock "refresh_cache-5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG nova.compute.manager [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Instance network_info: |[{"id": "c2e32544-47df-43ff-ae83-c30388d9d618", "address": "fa:16:3e:9d:43:1e", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2e32544-47", "ovs_interfaceid": "c2e32544-47df-43ff-ae83-c30388d9d618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e6b078ca-b3fd-46a8-8843-d2d559aa8099 req-018332ae-3a81-4660-93dd-364bdef64611 service nova] Acquired lock "refresh_cache-5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG nova.network.neutron [req-e6b078ca-b3fd-46a8-8843-d2d559aa8099 req-018332ae-3a81-4660-93dd-364bdef64611 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Refreshing network info cache for port c2e32544-47df-43ff-ae83-c30388d9d618 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Start _get_guest_xml network_info=[{"id": "c2e32544-47df-43ff-ae83-c30388d9d618", "address": "fa:16:3e:9d:43:1e", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2e32544-47", "ovs_interfaceid": "c2e32544-47df-43ff-ae83-c30388d9d618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:38:59 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:38:59 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:38:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:38:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1424363203',display_name='tempest-tempest.common.compute-instance-1424363203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1424363203',id=12,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzrXyeuWZXAQJXaMndVYP8YLJJO4IYhi0DtFWiIOZyO1xgLu2NdayGj34gx2+069d0uD51u6mLg7wO65+6tBrUyZO5VP+z88aMjR2XH1fCtm3ZNL2N1XZkwSHRBMKbi2w==',key_name='tempest-keypair-417234224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2dd5723fb8384aa985cf401d95aa7d08',ramdisk_id='',reservation_id='r-ueazm8wy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-380813086',owner_user_name='tempest-ServerActionsTestOtherA-380813086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:38:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9404ed7386e14eed8d046e8c45942c75',uuid=5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2e32544-47df-43ff-ae83-c30388d9d618", "address": "fa:16:3e:9d:43:1e", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2e32544-47", "ovs_interfaceid": "c2e32544-47df-43ff-ae83-c30388d9d618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Converting VIF {"id": "c2e32544-47df-43ff-ae83-c30388d9d618", "address": "fa:16:3e:9d:43:1e", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2e32544-47", "ovs_interfaceid": "c2e32544-47df-43ff-ae83-c30388d9d618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:43:1e,bridge_name='br-int',has_traffic_filtering=True,id=c2e32544-47df-43ff-ae83-c30388d9d618,network=Network(2c5f0d57-9485-4a0b-a847-49eea5cd17c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2e32544-47') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG nova.objects.instance [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lazy-loading 'pci_devices' on Instance uuid 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:38:59 user nova-compute[73056]:   <uuid>5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8</uuid>
Aug 14 16:38:59 user nova-compute[73056]:   <name>instance-0000000c</name>
Aug 14 16:38:59 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:38:59 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:38:59 user nova-compute[73056]:   <metadata>
Aug 14 16:38:59 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:38:59 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:38:59 user nova-compute[73056]:       <nova:name>tempest-tempest.common.compute-instance-1424363203</nova:name>
Aug 14 16:38:59 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:38:59</nova:creationTime>
Aug 14 16:38:59 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:38:59 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:38:59 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:38:59 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:38:59 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:38:59 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:38:59 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:38:59 user nova-compute[73056]:       <nova:owner>
Aug 14 16:38:59 user nova-compute[73056]:         <nova:user uuid="9404ed7386e14eed8d046e8c45942c75">tempest-ServerActionsTestOtherA-380813086-project-member</nova:user>
Aug 14 16:38:59 user nova-compute[73056]:         <nova:project uuid="2dd5723fb8384aa985cf401d95aa7d08">tempest-ServerActionsTestOtherA-380813086</nova:project>
Aug 14 16:38:59 user nova-compute[73056]:       </nova:owner>
Aug 14 16:38:59 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:38:59 user nova-compute[73056]:       <nova:ports>
Aug 14 16:38:59 user nova-compute[73056]:         <nova:port uuid="c2e32544-47df-43ff-ae83-c30388d9d618">
Aug 14 16:38:59 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 16:38:59 user nova-compute[73056]:         </nova:port>
Aug 14 16:38:59 user nova-compute[73056]:       </nova:ports>
Aug 14 16:38:59 user nova-compute[73056]:     </nova:instance>
Aug 14 16:38:59 user nova-compute[73056]:   </metadata>
Aug 14 16:38:59 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:38:59 user nova-compute[73056]:     <system>
Aug 14 16:38:59 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:38:59 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:38:59 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:38:59 user nova-compute[73056]:       <entry name="serial">5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8</entry>
Aug 14 16:38:59 user nova-compute[73056]:       <entry name="uuid">5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8</entry>
Aug 14 16:38:59 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:38:59 user nova-compute[73056]:     </system>
Aug 14 16:38:59 user nova-compute[73056]:   </sysinfo>
Aug 14 16:38:59 user nova-compute[73056]:   <os>
Aug 14 16:38:59 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:38:59 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:38:59 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:38:59 user nova-compute[73056]:   </os>
Aug 14 16:38:59 user nova-compute[73056]:   <features>
Aug 14 16:38:59 user nova-compute[73056]:     <acpi/>
Aug 14 16:38:59 user nova-compute[73056]:     <apic/>
Aug 14 16:38:59 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:38:59 user nova-compute[73056]:   </features>
Aug 14 16:38:59 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:38:59 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:38:59 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:38:59 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:38:59 user nova-compute[73056]:   </clock>
Aug 14 16:38:59 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:38:59 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:38:59 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:38:59 user nova-compute[73056]:   </cpu>
Aug 14 16:38:59 user nova-compute[73056]:   <devices>
Aug 14 16:38:59 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:38:59 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:38:59 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/disk"/>
Aug 14 16:38:59 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:38:59 user nova-compute[73056]:     </disk>
Aug 14 16:38:59 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:38:59 user nova-compute[73056]:       <mac address="fa:16:3e:9d:43:1e"/>
Aug 14 16:38:59 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:38:59 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:38:59 user nova-compute[73056]:       <target dev="tapc2e32544-47"/>
Aug 14 16:38:59 user nova-compute[73056]:     </interface>
Aug 14 16:38:59 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:38:59 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/console.log" append="off"/>
Aug 14 16:38:59 user nova-compute[73056]:     </serial>
Aug 14 16:38:59 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:38:59 user nova-compute[73056]:     <video>
Aug 14 16:38:59 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:38:59 user nova-compute[73056]:     </video>
Aug 14 16:38:59 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:38:59 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:38:59 user nova-compute[73056]:     </rng>
Aug 14 16:38:59 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:38:59 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:38:59 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:38:59 user nova-compute[73056]:     </memballoon>
Aug 14 16:38:59 user nova-compute[73056]:   </devices>
Aug 14 16:38:59 user nova-compute[73056]: </domain>
Aug 14 16:38:59 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:38:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1424363203',display_name='tempest-tempest.common.compute-instance-1424363203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1424363203',id=12,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzrXyeuWZXAQJXaMndVYP8YLJJO4IYhi0DtFWiIOZyO1xgLu2NdayGj34gx2+069d0uD51u6mLg7wO65+6tBrUyZO5VP+z88aMjR2XH1fCtm3ZNL2N1XZkwSHRBMKbi2w==',key_name='tempest-keypair-417234224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2dd5723fb8384aa985cf401d95aa7d08',ramdisk_id='',reservation_id='r-ueazm8wy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-380813086',owner_user_name='tempest-ServerActionsTestOtherA-380813086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:38:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9404ed7386e14eed8d046e8c45942c75',uuid=5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2e32544-47df-43ff-ae83-c30388d9d618", "address": "fa:16:3e:9d:43:1e", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2e32544-47", "ovs_interfaceid": "c2e32544-47df-43ff-ae83-c30388d9d618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Converting VIF {"id": "c2e32544-47df-43ff-ae83-c30388d9d618", "address": "fa:16:3e:9d:43:1e", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2e32544-47", "ovs_interfaceid": "c2e32544-47df-43ff-ae83-c30388d9d618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:43:1e,bridge_name='br-int',has_traffic_filtering=True,id=c2e32544-47df-43ff-ae83-c30388d9d618,network=Network(2c5f0d57-9485-4a0b-a847-49eea5cd17c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2e32544-47') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG os_vif [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:43:1e,bridge_name='br-int',has_traffic_filtering=True,id=c2e32544-47df-43ff-ae83-c30388d9d618,network=Network(2c5f0d57-9485-4a0b-a847-49eea5cd17c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2e32544-47') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2e32544-47, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc2e32544-47, col_values=(('external_ids', {'iface-id': 'c2e32544-47df-43ff-ae83-c30388d9d618', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:43:1e', 'vm-uuid': '5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:38:59 user nova-compute[73056]: INFO os_vif [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:43:1e,bridge_name='br-int',has_traffic_filtering=True,id=c2e32544-47df-43ff-ae83-c30388d9d618,network=Network(2c5f0d57-9485-4a0b-a847-49eea5cd17c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2e32544-47')
Aug 14 16:38:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:38:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] No VIF found with MAC fa:16:3e:9d:43:1e, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:39:00 user nova-compute[73056]: DEBUG nova.compute.manager [req-775fedc4-0799-4d11-a079-02b98d9114f7 req-7a19be73-691f-4071-84fc-11f3e4538176 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-changed-c81e86e3-8261-441f-b7b1-145aa7740e08 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:00 user nova-compute[73056]: DEBUG nova.compute.manager [req-775fedc4-0799-4d11-a079-02b98d9114f7 req-7a19be73-691f-4071-84fc-11f3e4538176 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Refreshing instance network info cache due to event network-changed-c81e86e3-8261-441f-b7b1-145aa7740e08. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:39:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-775fedc4-0799-4d11-a079-02b98d9114f7 req-7a19be73-691f-4071-84fc-11f3e4538176 service nova] Acquiring lock "refresh_cache-d15f23ae-f5a4-47cf-b136-7072c7838790" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:39:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-775fedc4-0799-4d11-a079-02b98d9114f7 req-7a19be73-691f-4071-84fc-11f3e4538176 service nova] Acquired lock "refresh_cache-d15f23ae-f5a4-47cf-b136-7072c7838790" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:39:00 user nova-compute[73056]: DEBUG nova.network.neutron [req-775fedc4-0799-4d11-a079-02b98d9114f7 req-7a19be73-691f-4071-84fc-11f3e4538176 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Refreshing network info cache for port c81e86e3-8261-441f-b7b1-145aa7740e08 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:39:00 user nova-compute[73056]: DEBUG nova.network.neutron [req-e6b078ca-b3fd-46a8-8843-d2d559aa8099 req-018332ae-3a81-4660-93dd-364bdef64611 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Updated VIF entry in instance network info cache for port c2e32544-47df-43ff-ae83-c30388d9d618. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:39:00 user nova-compute[73056]: DEBUG nova.network.neutron [req-e6b078ca-b3fd-46a8-8843-d2d559aa8099 req-018332ae-3a81-4660-93dd-364bdef64611 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Updating instance_info_cache with network_info: [{"id": "c2e32544-47df-43ff-ae83-c30388d9d618", "address": "fa:16:3e:9d:43:1e", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2e32544-47", "ovs_interfaceid": "c2e32544-47df-43ff-ae83-c30388d9d618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:39:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e6b078ca-b3fd-46a8-8843-d2d559aa8099 req-018332ae-3a81-4660-93dd-364bdef64611 service nova] Releasing lock "refresh_cache-5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:39:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Acquiring lock "9927d1d6-6e26-4408-b509-c96df5f314d6" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Lock "9927d1d6-6e26-4408-b509-c96df5f314d6" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:00 user nova-compute[73056]: DEBUG os_brick.utils [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:39:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:00 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7dab4b-df0e-4c92-9232-3e4d60b0cd84]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:00 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75f8a71-1db0-4c6a-ab93-3ed3018e7eef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:00 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[708fcf95-dee0-4142-82b6-c0754f202556]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:00 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66de30b-05d4-4f5b-9d4e-aedd3b8945b0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:39:00 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:39:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:39:00 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:39:00 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[829a832c-23e5-4eda-9e46-b3a638f4025c]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:00 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:39:00 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:39:00 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:39:00 user nova-compute[73056]: DEBUG os_brick.utils [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:39:00 user nova-compute[73056]: INFO nova.compute.manager [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Swapping volume 250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b for 54a15b78-0b03-4e36-b1bb-4772f342893b
Aug 14 16:39:00 user nova-compute[73056]: DEBUG nova.network.neutron [req-775fedc4-0799-4d11-a079-02b98d9114f7 req-7a19be73-691f-4071-84fc-11f3e4538176 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Updated VIF entry in instance network info cache for port c81e86e3-8261-441f-b7b1-145aa7740e08. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:39:00 user nova-compute[73056]: DEBUG nova.network.neutron [req-775fedc4-0799-4d11-a079-02b98d9114f7 req-7a19be73-691f-4071-84fc-11f3e4538176 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Updating instance_info_cache with network_info: [{"id": "c81e86e3-8261-441f-b7b1-145aa7740e08", "address": "fa:16:3e:80:07:c2", "network": {"id": "cffc94d2-2f90-4180-b640-81eac93db07e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-5276327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81e86e3-82", "ovs_interfaceid": "c81e86e3-8261-441f-b7b1-145aa7740e08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69edfecc-9201-4747-89e2-bd552f2616ed", "address": "fa:16:3e:b2:f1:d1", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69edfecc-92", "ovs_interfaceid": "69edfecc-9201-4747-89e2-bd552f2616ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b70d8306-e1df-4d66-9949-8f156c902305", "address": "fa:16:3e:68:92:b2", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70d8306-e1", "ovs_interfaceid": "b70d8306-e1df-4d66-9949-8f156c902305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea9bf8ed-60e0-4563-893c-33135ea49823", "address": "fa:16:3e:63:bd:25", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9bf8ed-60", "ovs_interfaceid": "ea9bf8ed-60e0-4563-893c-33135ea49823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9a54a741-25de-4758-921c-0b7e5c5730dd", "address": "fa:16:3e:bc:d6:2a", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a54a741-25", "ovs_interfaceid": "9a54a741-25de-4758-921c-0b7e5c5730dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e2daf22-7953-47ca-b2c6-98a1f0b00b72", "address": "fa:16:3e:b2:04:50", "network": {"id": "0cdd5be6-368d-4088-ad0c-d696845f9579", "bridge": "br-int", "label": "tempest-device-tagging-net2-999697901", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e2daf22-79", "ovs_interfaceid": "4e2daf22-7953-47ca-b2c6-98a1f0b00b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee13669b-f42c-4ca6-84e9-c95e35048ffc", "address": "fa:16:3e:28:49:8c", "network": {"id": "0cdd5be6-368d-4088-ad0c-d696845f9579", "bridge": "br-int", "label": "tempest-device-tagging-net2-999697901", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee13669b-f4", "ovs_interfaceid": "ee13669b-f42c-4ca6-84e9-c95e35048ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:39:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-775fedc4-0799-4d11-a079-02b98d9114f7 req-7a19be73-691f-4071-84fc-11f3e4538176 service nova] Releasing lock "refresh_cache-d15f23ae-f5a4-47cf-b136-7072c7838790" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:39:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:01 user nova-compute[73056]: DEBUG nova.compute.manager [req-373f0b95-7989-4a83-948b-84c99f3df13f req-f2a97860-5a9c-474d-8172-1a6bb077e2a1 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Received event network-vif-plugged-c2e32544-47df-43ff-ae83-c30388d9d618 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-373f0b95-7989-4a83-948b-84c99f3df13f req-f2a97860-5a9c-474d-8172-1a6bb077e2a1 service nova] Acquiring lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-373f0b95-7989-4a83-948b-84c99f3df13f req-f2a97860-5a9c-474d-8172-1a6bb077e2a1 service nova] Lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-373f0b95-7989-4a83-948b-84c99f3df13f req-f2a97860-5a9c-474d-8172-1a6bb077e2a1 service nova] Lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:01 user nova-compute[73056]: DEBUG nova.compute.manager [req-373f0b95-7989-4a83-948b-84c99f3df13f req-f2a97860-5a9c-474d-8172-1a6bb077e2a1 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] No waiting events found dispatching network-vif-plugged-c2e32544-47df-43ff-ae83-c30388d9d618 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:01 user nova-compute[73056]: WARNING nova.compute.manager [req-373f0b95-7989-4a83-948b-84c99f3df13f req-f2a97860-5a9c-474d-8172-1a6bb077e2a1 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Received unexpected event network-vif-plugged-c2e32544-47df-43ff-ae83-c30388d9d618 for instance with vm_state building and task_state spawning.
Aug 14 16:39:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:02 user nova-compute[73056]: DEBUG nova.compute.manager [req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 req-b97345cc-4888-43dd-868d-3b55d27b7fb3 service nova] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Received event volume-reimaged-663decc6-865c-4b8c-90f2-d6c4918e27d4 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 req-b97345cc-4888-43dd-868d-3b55d27b7fb3 service nova] Acquiring lock "a329b987-231e-47a8-9f2d-71c15573f9f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 req-b97345cc-4888-43dd-868d-3b55d27b7fb3 service nova] Lock "a329b987-231e-47a8-9f2d-71c15573f9f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 req-b97345cc-4888-43dd-868d-3b55d27b7fb3 service nova] Lock "a329b987-231e-47a8-9f2d-71c15573f9f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:02 user nova-compute[73056]: DEBUG nova.compute.manager [req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 req-b97345cc-4888-43dd-868d-3b55d27b7fb3 service nova] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Processing event volume-reimaged-663decc6-865c-4b8c-90f2-d6c4918e27d4 {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 14 16:39:02 user nova-compute[73056]: DEBUG nova.compute.manager [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Instance event wait completed in 22 seconds for volume-reimaged {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:39:02 user nova-compute[73056]: INFO nova.virt.block_device [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Booting with volume 663decc6-865c-4b8c-90f2-d6c4918e27d4 at /dev/vda
Aug 14 16:39:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:02 user nova-compute[73056]: DEBUG os_brick.utils [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:39:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:02 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[619b49ec-1e6b-4f7b-9b50-d0cbc00810c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:02 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cadf53-f056-47ae-acd6-a675560732b4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:02 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a718ae43-eaa0-49d5-b347-35be8e4699c9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:02 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2562250a-a49a-4d77-8f6c-5e5b998e0a23]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:39:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:39:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:39:02 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:39:02 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd86cdac-886b-407f-be16-ce1648c5977a]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:39:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:39:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:39:02 user nova-compute[73056]: DEBUG os_brick.utils [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:39:02 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Updating existing volume attachment record: bb5d07ca-7a70-43c7-96e2-4ae802e85ecb {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Acquiring lock "d15f23ae-f5a4-47cf-b136-7072c7838790" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Acquiring lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:03 user nova-compute[73056]: INFO nova.compute.manager [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Terminating instance
Aug 14 16:39:03 user nova-compute[73056]: DEBUG nova.compute.manager [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG nova.compute.manager [req-1f8ed2e2-9f06-478b-b61a-78992e2d52bb req-cf8ddee7-f63b-4ccb-a92c-4255c677be34 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Received event network-vif-plugged-c2e32544-47df-43ff-ae83-c30388d9d618 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1f8ed2e2-9f06-478b-b61a-78992e2d52bb req-cf8ddee7-f63b-4ccb-a92c-4255c677be34 service nova] Acquiring lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1f8ed2e2-9f06-478b-b61a-78992e2d52bb req-cf8ddee7-f63b-4ccb-a92c-4255c677be34 service nova] Lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1f8ed2e2-9f06-478b-b61a-78992e2d52bb req-cf8ddee7-f63b-4ccb-a92c-4255c677be34 service nova] Lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG nova.compute.manager [req-1f8ed2e2-9f06-478b-b61a-78992e2d52bb req-cf8ddee7-f63b-4ccb-a92c-4255c677be34 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] No waiting events found dispatching network-vif-plugged-c2e32544-47df-43ff-ae83-c30388d9d618 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:03 user nova-compute[73056]: WARNING nova.compute.manager [req-1f8ed2e2-9f06-478b-b61a-78992e2d52bb req-cf8ddee7-f63b-4ccb-a92c-4255c677be34 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Received unexpected event network-vif-plugged-c2e32544-47df-43ff-ae83-c30388d9d618 for instance with vm_state building and task_state spawning.
Aug 14 16:39:03 user nova-compute[73056]: DEBUG nova.compute.manager [req-1f8ed2e2-9f06-478b-b61a-78992e2d52bb req-cf8ddee7-f63b-4ccb-a92c-4255c677be34 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-vif-unplugged-c81e86e3-8261-441f-b7b1-145aa7740e08 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1f8ed2e2-9f06-478b-b61a-78992e2d52bb req-cf8ddee7-f63b-4ccb-a92c-4255c677be34 service nova] Acquiring lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1f8ed2e2-9f06-478b-b61a-78992e2d52bb req-cf8ddee7-f63b-4ccb-a92c-4255c677be34 service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1f8ed2e2-9f06-478b-b61a-78992e2d52bb req-cf8ddee7-f63b-4ccb-a92c-4255c677be34 service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG nova.compute.manager [req-1f8ed2e2-9f06-478b-b61a-78992e2d52bb req-cf8ddee7-f63b-4ccb-a92c-4255c677be34 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] No waiting events found dispatching network-vif-unplugged-c81e86e3-8261-441f-b7b1-145aa7740e08 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG nova.compute.manager [req-1f8ed2e2-9f06-478b-b61a-78992e2d52bb req-cf8ddee7-f63b-4ccb-a92c-4255c677be34 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-vif-unplugged-c81e86e3-8261-441f-b7b1-145aa7740e08 for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG nova.compute.manager [req-c98a83e4-3858-443c-857c-50f77a8ed30d req-7980a065-d29e-4a2f-ac29-f2b976866b21 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-vif-unplugged-b70d8306-e1df-4d66-9949-8f156c902305 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c98a83e4-3858-443c-857c-50f77a8ed30d req-7980a065-d29e-4a2f-ac29-f2b976866b21 service nova] Acquiring lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c98a83e4-3858-443c-857c-50f77a8ed30d req-7980a065-d29e-4a2f-ac29-f2b976866b21 service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c98a83e4-3858-443c-857c-50f77a8ed30d req-7980a065-d29e-4a2f-ac29-f2b976866b21 service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG nova.compute.manager [req-c98a83e4-3858-443c-857c-50f77a8ed30d req-7980a065-d29e-4a2f-ac29-f2b976866b21 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] No waiting events found dispatching network-vif-unplugged-b70d8306-e1df-4d66-9949-8f156c902305 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG nova.compute.manager [req-c98a83e4-3858-443c-857c-50f77a8ed30d req-7980a065-d29e-4a2f-ac29-f2b976866b21 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-vif-unplugged-b70d8306-e1df-4d66-9949-8f156c902305 for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG nova.compute.manager [req-260c9ead-2ec1-4f4a-9c1c-6a384b3b6cdf req-53244cf5-92c2-44ac-aa9a-f675e3c788e3 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-vif-unplugged-69edfecc-9201-4747-89e2-bd552f2616ed {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-260c9ead-2ec1-4f4a-9c1c-6a384b3b6cdf req-53244cf5-92c2-44ac-aa9a-f675e3c788e3 service nova] Acquiring lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-260c9ead-2ec1-4f4a-9c1c-6a384b3b6cdf req-53244cf5-92c2-44ac-aa9a-f675e3c788e3 service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-260c9ead-2ec1-4f4a-9c1c-6a384b3b6cdf req-53244cf5-92c2-44ac-aa9a-f675e3c788e3 service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG nova.compute.manager [req-260c9ead-2ec1-4f4a-9c1c-6a384b3b6cdf req-53244cf5-92c2-44ac-aa9a-f675e3c788e3 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] No waiting events found dispatching network-vif-unplugged-69edfecc-9201-4747-89e2-bd552f2616ed {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG nova.compute.manager [req-260c9ead-2ec1-4f4a-9c1c-6a384b3b6cdf req-53244cf5-92c2-44ac-aa9a-f675e3c788e3 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-vif-unplugged-69edfecc-9201-4747-89e2-bd552f2616ed for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG nova.compute.manager [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:39:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:39:04 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031143.9972985, 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:39:04 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] VM Resumed (Lifecycle Event)
Aug 14 16:39:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:04 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:39:04 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Instance spawned successfully.
Aug 14 16:39:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:39:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:04 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:39:04 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:39:04 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031144.031964, 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:39:04 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] VM Started (Lifecycle Event)
Aug 14 16:39:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:39:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:39:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:39:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:39:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:39:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:39:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:04 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:39:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:04 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:39:04 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:39:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:04 user nova-compute[73056]: INFO nova.compute.manager [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Took 6.61 seconds to spawn the instance on the hypervisor.
Aug 14 16:39:04 user nova-compute[73056]: DEBUG nova.compute.manager [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:39:04 user nova-compute[73056]: INFO nova.compute.manager [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Took 7.61 seconds to build instance.
Aug 14 16:39:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-45f4242f-573c-418c-9346-db4af4cf92c5 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.777s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:05 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Instance destroyed successfully.
Aug 14 16:39:05 user nova-compute[73056]: DEBUG nova.objects.instance [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Lazy-loading 'resources' on Instance uuid d15f23ae-f5a4-47cf-b136-7072c7838790 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802533514',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802533514',id=10,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbzTmfeZnkoTSmAI1r4E5kRdG5UwIoqyTDg413/OaV/+wRxXAc78iY7UpXYkMde2FmweqTVIQK1dSFwRjfSSDHLM1SWrj5/OU4A9+2sa7L/cEwqd5FK9hrf2mwDlgRx3g==',key_name='tempest-keypair-1403492348',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:37:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b973979ba4d4dfbb0a5088e9017ffa4',ramdisk_id='',reservation_id='r-f2tummsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1118695598',owner_user_name='tempest-TaggedBootDevicesTest-1118695598-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:37:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a104c41b03dc4828a4dd3313763e77dd',uuid=d15f23ae-f5a4-47cf-b136-7072c7838790,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c81e86e3-8261-441f-b7b1-145aa7740e08", "address": "fa:16:3e:80:07:c2", "network": {"id": "cffc94d2-2f90-4180-b640-81eac93db07e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-5276327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81e86e3-82", "ovs_interfaceid": "c81e86e3-8261-441f-b7b1-145aa7740e08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converting VIF {"id": "c81e86e3-8261-441f-b7b1-145aa7740e08", "address": "fa:16:3e:80:07:c2", "network": {"id": "cffc94d2-2f90-4180-b640-81eac93db07e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-5276327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81e86e3-82", "ovs_interfaceid": "c81e86e3-8261-441f-b7b1-145aa7740e08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:07:c2,bridge_name='br-int',has_traffic_filtering=True,id=c81e86e3-8261-441f-b7b1-145aa7740e08,network=Network(cffc94d2-2f90-4180-b640-81eac93db07e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc81e86e3-82') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG os_vif [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:07:c2,bridge_name='br-int',has_traffic_filtering=True,id=c81e86e3-8261-441f-b7b1-145aa7740e08,network=Network(cffc94d2-2f90-4180-b640-81eac93db07e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc81e86e3-82') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc81e86e3-82, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:05 user nova-compute[73056]: INFO os_vif [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:07:c2,bridge_name='br-int',has_traffic_filtering=True,id=c81e86e3-8261-441f-b7b1-145aa7740e08,network=Network(cffc94d2-2f90-4180-b640-81eac93db07e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc81e86e3-82')
Aug 14 16:39:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802533514',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802533514',id=10,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbzTmfeZnkoTSmAI1r4E5kRdG5UwIoqyTDg413/OaV/+wRxXAc78iY7UpXYkMde2FmweqTVIQK1dSFwRjfSSDHLM1SWrj5/OU4A9+2sa7L/cEwqd5FK9hrf2mwDlgRx3g==',key_name='tempest-keypair-1403492348',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:37:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b973979ba4d4dfbb0a5088e9017ffa4',ramdisk_id='',reservation_id='r-f2tummsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1118695598',owner_user_name='tempest-TaggedBootDevicesTest-1118695598-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:37:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a104c41b03dc4828a4dd3313763e77dd',uuid=d15f23ae-f5a4-47cf-b136-7072c7838790,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69edfecc-9201-4747-89e2-bd552f2616ed", "address": "fa:16:3e:b2:f1:d1", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69edfecc-92", "ovs_interfaceid": "69edfecc-9201-4747-89e2-bd552f2616ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converting VIF {"id": "69edfecc-9201-4747-89e2-bd552f2616ed", "address": "fa:16:3e:b2:f1:d1", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69edfecc-92", "ovs_interfaceid": "69edfecc-9201-4747-89e2-bd552f2616ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:f1:d1,bridge_name='br-int',has_traffic_filtering=True,id=69edfecc-9201-4747-89e2-bd552f2616ed,network=Network(49b33d8e-84cc-4c69-800d-395f46025327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap69edfecc-92') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG os_vif [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:f1:d1,bridge_name='br-int',has_traffic_filtering=True,id=69edfecc-9201-4747-89e2-bd552f2616ed,network=Network(49b33d8e-84cc-4c69-800d-395f46025327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap69edfecc-92') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69edfecc-92, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:05 user nova-compute[73056]: INFO os_vif [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:f1:d1,bridge_name='br-int',has_traffic_filtering=True,id=69edfecc-9201-4747-89e2-bd552f2616ed,network=Network(49b33d8e-84cc-4c69-800d-395f46025327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap69edfecc-92')
Aug 14 16:39:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802533514',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802533514',id=10,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbzTmfeZnkoTSmAI1r4E5kRdG5UwIoqyTDg413/OaV/+wRxXAc78iY7UpXYkMde2FmweqTVIQK1dSFwRjfSSDHLM1SWrj5/OU4A9+2sa7L/cEwqd5FK9hrf2mwDlgRx3g==',key_name='tempest-keypair-1403492348',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:37:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b973979ba4d4dfbb0a5088e9017ffa4',ramdisk_id='',reservation_id='r-f2tummsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1118695598',owner_user_name='tempest-TaggedBootDevicesTest-1118695598-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:37:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a104c41b03dc4828a4dd3313763e77dd',uuid=d15f23ae-f5a4-47cf-b136-7072c7838790,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b70d8306-e1df-4d66-9949-8f156c902305", "address": "fa:16:3e:68:92:b2", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70d8306-e1", "ovs_interfaceid": "b70d8306-e1df-4d66-9949-8f156c902305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converting VIF {"id": "b70d8306-e1df-4d66-9949-8f156c902305", "address": "fa:16:3e:68:92:b2", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70d8306-e1", "ovs_interfaceid": "b70d8306-e1df-4d66-9949-8f156c902305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:92:b2,bridge_name='br-int',has_traffic_filtering=True,id=b70d8306-e1df-4d66-9949-8f156c902305,network=Network(49b33d8e-84cc-4c69-800d-395f46025327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb70d8306-e1') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG os_vif [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:92:b2,bridge_name='br-int',has_traffic_filtering=True,id=b70d8306-e1df-4d66-9949-8f156c902305,network=Network(49b33d8e-84cc-4c69-800d-395f46025327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb70d8306-e1') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb70d8306-e1, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:05 user nova-compute[73056]: INFO os_vif [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:92:b2,bridge_name='br-int',has_traffic_filtering=True,id=b70d8306-e1df-4d66-9949-8f156c902305,network=Network(49b33d8e-84cc-4c69-800d-395f46025327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb70d8306-e1')
Aug 14 16:39:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802533514',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802533514',id=10,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbzTmfeZnkoTSmAI1r4E5kRdG5UwIoqyTDg413/OaV/+wRxXAc78iY7UpXYkMde2FmweqTVIQK1dSFwRjfSSDHLM1SWrj5/OU4A9+2sa7L/cEwqd5FK9hrf2mwDlgRx3g==',key_name='tempest-keypair-1403492348',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:37:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b973979ba4d4dfbb0a5088e9017ffa4',ramdisk_id='',reservation_id='r-f2tummsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1118695598',owner_user_name='tempest-TaggedBootDevicesTest-1118695598-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:37:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a104c41b03dc4828a4dd3313763e77dd',uuid=d15f23ae-f5a4-47cf-b136-7072c7838790,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea9bf8ed-60e0-4563-893c-33135ea49823", "address": "fa:16:3e:63:bd:25", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9bf8ed-60", "ovs_interfaceid": "ea9bf8ed-60e0-4563-893c-33135ea49823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converting VIF {"id": "ea9bf8ed-60e0-4563-893c-33135ea49823", "address": "fa:16:3e:63:bd:25", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9bf8ed-60", "ovs_interfaceid": "ea9bf8ed-60e0-4563-893c-33135ea49823", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:bd:25,bridge_name='br-int',has_traffic_filtering=True,id=ea9bf8ed-60e0-4563-893c-33135ea49823,network=Network(49b33d8e-84cc-4c69-800d-395f46025327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea9bf8ed-60') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG os_vif [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:bd:25,bridge_name='br-int',has_traffic_filtering=True,id=ea9bf8ed-60e0-4563-893c-33135ea49823,network=Network(49b33d8e-84cc-4c69-800d-395f46025327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea9bf8ed-60') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea9bf8ed-60, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:05 user nova-compute[73056]: INFO os_vif [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:bd:25,bridge_name='br-int',has_traffic_filtering=True,id=ea9bf8ed-60e0-4563-893c-33135ea49823,network=Network(49b33d8e-84cc-4c69-800d-395f46025327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea9bf8ed-60')
Aug 14 16:39:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802533514',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802533514',id=10,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbzTmfeZnkoTSmAI1r4E5kRdG5UwIoqyTDg413/OaV/+wRxXAc78iY7UpXYkMde2FmweqTVIQK1dSFwRjfSSDHLM1SWrj5/OU4A9+2sa7L/cEwqd5FK9hrf2mwDlgRx3g==',key_name='tempest-keypair-1403492348',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:37:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b973979ba4d4dfbb0a5088e9017ffa4',ramdisk_id='',reservation_id='r-f2tummsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1118695598',owner_user_name='tempest-TaggedBootDevicesTest-1118695598-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:37:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a104c41b03dc4828a4dd3313763e77dd',uuid=d15f23ae-f5a4-47cf-b136-7072c7838790,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a54a741-25de-4758-921c-0b7e5c5730dd", "address": "fa:16:3e:bc:d6:2a", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a54a741-25", "ovs_interfaceid": "9a54a741-25de-4758-921c-0b7e5c5730dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converting VIF {"id": "9a54a741-25de-4758-921c-0b7e5c5730dd", "address": "fa:16:3e:bc:d6:2a", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a54a741-25", "ovs_interfaceid": "9a54a741-25de-4758-921c-0b7e5c5730dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:d6:2a,bridge_name='br-int',has_traffic_filtering=True,id=9a54a741-25de-4758-921c-0b7e5c5730dd,network=Network(49b33d8e-84cc-4c69-800d-395f46025327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a54a741-25') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG os_vif [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:d6:2a,bridge_name='br-int',has_traffic_filtering=True,id=9a54a741-25de-4758-921c-0b7e5c5730dd,network=Network(49b33d8e-84cc-4c69-800d-395f46025327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a54a741-25') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a54a741-25, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:05 user nova-compute[73056]: INFO os_vif [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:d6:2a,bridge_name='br-int',has_traffic_filtering=True,id=9a54a741-25de-4758-921c-0b7e5c5730dd,network=Network(49b33d8e-84cc-4c69-800d-395f46025327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a54a741-25')
Aug 14 16:39:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802533514',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802533514',id=10,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbzTmfeZnkoTSmAI1r4E5kRdG5UwIoqyTDg413/OaV/+wRxXAc78iY7UpXYkMde2FmweqTVIQK1dSFwRjfSSDHLM1SWrj5/OU4A9+2sa7L/cEwqd5FK9hrf2mwDlgRx3g==',key_name='tempest-keypair-1403492348',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:37:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b973979ba4d4dfbb0a5088e9017ffa4',ramdisk_id='',reservation_id='r-f2tummsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1118695598',owner_user_name='tempest-TaggedBootDevicesTest-1118695598-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:37:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a104c41b03dc4828a4dd3313763e77dd',uuid=d15f23ae-f5a4-47cf-b136-7072c7838790,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e2daf22-7953-47ca-b2c6-98a1f0b00b72", "address": "fa:16:3e:b2:04:50", "network": {"id": "0cdd5be6-368d-4088-ad0c-d696845f9579", "bridge": "br-int", "label": "tempest-device-tagging-net2-999697901", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e2daf22-79", "ovs_interfaceid": "4e2daf22-7953-47ca-b2c6-98a1f0b00b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converting VIF {"id": "4e2daf22-7953-47ca-b2c6-98a1f0b00b72", "address": "fa:16:3e:b2:04:50", "network": {"id": "0cdd5be6-368d-4088-ad0c-d696845f9579", "bridge": "br-int", "label": "tempest-device-tagging-net2-999697901", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e2daf22-79", "ovs_interfaceid": "4e2daf22-7953-47ca-b2c6-98a1f0b00b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:04:50,bridge_name='br-int',has_traffic_filtering=True,id=4e2daf22-7953-47ca-b2c6-98a1f0b00b72,network=Network(0cdd5be6-368d-4088-ad0c-d696845f9579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e2daf22-79') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG os_vif [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:04:50,bridge_name='br-int',has_traffic_filtering=True,id=4e2daf22-7953-47ca-b2c6-98a1f0b00b72,network=Network(0cdd5be6-368d-4088-ad0c-d696845f9579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e2daf22-79') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e2daf22-79, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:05 user nova-compute[73056]: INFO os_vif [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:04:50,bridge_name='br-int',has_traffic_filtering=True,id=4e2daf22-7953-47ca-b2c6-98a1f0b00b72,network=Network(0cdd5be6-368d-4088-ad0c-d696845f9579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e2daf22-79')
Aug 14 16:39:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1802533514',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1802533514',id=10,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbzTmfeZnkoTSmAI1r4E5kRdG5UwIoqyTDg413/OaV/+wRxXAc78iY7UpXYkMde2FmweqTVIQK1dSFwRjfSSDHLM1SWrj5/OU4A9+2sa7L/cEwqd5FK9hrf2mwDlgRx3g==',key_name='tempest-keypair-1403492348',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:37:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b973979ba4d4dfbb0a5088e9017ffa4',ramdisk_id='',reservation_id='r-f2tummsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1118695598',owner_user_name='tempest-TaggedBootDevicesTest-1118695598-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:37:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a104c41b03dc4828a4dd3313763e77dd',uuid=d15f23ae-f5a4-47cf-b136-7072c7838790,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee13669b-f42c-4ca6-84e9-c95e35048ffc", "address": "fa:16:3e:28:49:8c", "network": {"id": "0cdd5be6-368d-4088-ad0c-d696845f9579", "bridge": "br-int", "label": "tempest-device-tagging-net2-999697901", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee13669b-f4", "ovs_interfaceid": "ee13669b-f42c-4ca6-84e9-c95e35048ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converting VIF {"id": "ee13669b-f42c-4ca6-84e9-c95e35048ffc", "address": "fa:16:3e:28:49:8c", "network": {"id": "0cdd5be6-368d-4088-ad0c-d696845f9579", "bridge": "br-int", "label": "tempest-device-tagging-net2-999697901", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee13669b-f4", "ovs_interfaceid": "ee13669b-f42c-4ca6-84e9-c95e35048ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:49:8c,bridge_name='br-int',has_traffic_filtering=True,id=ee13669b-f42c-4ca6-84e9-c95e35048ffc,network=Network(0cdd5be6-368d-4088-ad0c-d696845f9579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee13669b-f4') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG os_vif [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:49:8c,bridge_name='br-int',has_traffic_filtering=True,id=ee13669b-f42c-4ca6-84e9-c95e35048ffc,network=Network(0cdd5be6-368d-4088-ad0c-d696845f9579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee13669b-f4') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee13669b-f4, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:39:05 user nova-compute[73056]: INFO os_vif [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:49:8c,bridge_name='br-int',has_traffic_filtering=True,id=ee13669b-f42c-4ca6-84e9-c95e35048ffc,network=Network(0cdd5be6-368d-4088-ad0c-d696845f9579),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee13669b-f4')
Aug 14 16:39:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EmrNuQjh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:39:05 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:39:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d5b5eb-8a4a-4c30-bded-e169465c2f9a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG nova.compute.manager [req-a7d3c272-74a0-448b-8ad0-11b0c363fa94 req-4ead9787-8d35-48bf-9d97-68b7b792818d service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-vif-plugged-c81e86e3-8261-441f-b7b1-145aa7740e08 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a7d3c272-74a0-448b-8ad0-11b0c363fa94 req-4ead9787-8d35-48bf-9d97-68b7b792818d service nova] Acquiring lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a7d3c272-74a0-448b-8ad0-11b0c363fa94 req-4ead9787-8d35-48bf-9d97-68b7b792818d service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a7d3c272-74a0-448b-8ad0-11b0c363fa94 req-4ead9787-8d35-48bf-9d97-68b7b792818d service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG nova.compute.manager [req-a7d3c272-74a0-448b-8ad0-11b0c363fa94 req-4ead9787-8d35-48bf-9d97-68b7b792818d service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] No waiting events found dispatching network-vif-plugged-c81e86e3-8261-441f-b7b1-145aa7740e08 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:05 user nova-compute[73056]: WARNING nova.compute.manager [req-a7d3c272-74a0-448b-8ad0-11b0c363fa94 req-4ead9787-8d35-48bf-9d97-68b7b792818d service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received unexpected event network-vif-plugged-c81e86e3-8261-441f-b7b1-145aa7740e08 for instance with vm_state active and task_state deleting.
Aug 14 16:39:05 user nova-compute[73056]: DEBUG nova.compute.manager [req-a7d3c272-74a0-448b-8ad0-11b0c363fa94 req-4ead9787-8d35-48bf-9d97-68b7b792818d service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-vif-unplugged-ee13669b-f42c-4ca6-84e9-c95e35048ffc {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a7d3c272-74a0-448b-8ad0-11b0c363fa94 req-4ead9787-8d35-48bf-9d97-68b7b792818d service nova] Acquiring lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a7d3c272-74a0-448b-8ad0-11b0c363fa94 req-4ead9787-8d35-48bf-9d97-68b7b792818d service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a7d3c272-74a0-448b-8ad0-11b0c363fa94 req-4ead9787-8d35-48bf-9d97-68b7b792818d service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG nova.compute.manager [req-a7d3c272-74a0-448b-8ad0-11b0c363fa94 req-4ead9787-8d35-48bf-9d97-68b7b792818d service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] No waiting events found dispatching network-vif-unplugged-ee13669b-f42c-4ca6-84e9-c95e35048ffc {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG nova.compute.manager [req-a7d3c272-74a0-448b-8ad0-11b0c363fa94 req-4ead9787-8d35-48bf-9d97-68b7b792818d service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-vif-unplugged-ee13669b-f42c-4ca6-84e9-c95e35048ffc for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG nova.compute.manager [req-a7d3c272-74a0-448b-8ad0-11b0c363fa94 req-4ead9787-8d35-48bf-9d97-68b7b792818d service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-vif-plugged-ee13669b-f42c-4ca6-84e9-c95e35048ffc {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a7d3c272-74a0-448b-8ad0-11b0c363fa94 req-4ead9787-8d35-48bf-9d97-68b7b792818d service nova] Acquiring lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a7d3c272-74a0-448b-8ad0-11b0c363fa94 req-4ead9787-8d35-48bf-9d97-68b7b792818d service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a7d3c272-74a0-448b-8ad0-11b0c363fa94 req-4ead9787-8d35-48bf-9d97-68b7b792818d service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG nova.compute.manager [req-a7d3c272-74a0-448b-8ad0-11b0c363fa94 req-4ead9787-8d35-48bf-9d97-68b7b792818d service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] No waiting events found dispatching network-vif-plugged-ee13669b-f42c-4ca6-84e9-c95e35048ffc {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:05 user nova-compute[73056]: WARNING nova.compute.manager [req-a7d3c272-74a0-448b-8ad0-11b0c363fa94 req-4ead9787-8d35-48bf-9d97-68b7b792818d service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received unexpected event network-vif-plugged-ee13669b-f42c-4ca6-84e9-c95e35048ffc for instance with vm_state active and task_state deleting.
Aug 14 16:39:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f911226-4eed-4b8c-916d-90115f84b69c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b (non-flash)
Aug 14 16:39:05 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:39:05 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:39:05 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:39:05 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:39:05 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:39:05 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:39:05 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b (non-flash)
Aug 14 16:39:05 user nova-compute[73056]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f (non-flash)
Aug 14 16:39:05 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:39:05 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:39:05 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:39:05 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:39:05 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:39:05 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff30043a680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f'): ({'sdc'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Removing single pathed devices sdc {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692031130.855261, b990e37f-8611-430f-89b1-ae6aeed24b38 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:39:05 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] VM Stopped (Lifecycle Event)
Aug 14 16:39:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG nova.compute.manager [None req-f6990210-eb7c-4ce3-8676-33239f096114 None None] [instance: b990e37f-8611-430f-89b1-ae6aeed24b38] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a1d223-31ac-4056-8965-c315d094b34a]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3246c9d-28fd-41d9-817c-fbd63de2e2d9]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Flushing IO for device /dev/sdc {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c1b834-c825-4c4c-a352-60c2d0c2b13d]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG nova.compute.manager [req-eb804549-557b-4daa-8f00-acc34cc2af7e req-143cd60a-519d-4a62-a0a8-07d8e8af8f51 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-vif-plugged-b70d8306-e1df-4d66-9949-8f156c902305 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-eb804549-557b-4daa-8f00-acc34cc2af7e req-143cd60a-519d-4a62-a0a8-07d8e8af8f51 service nova] Acquiring lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-eb804549-557b-4daa-8f00-acc34cc2af7e req-143cd60a-519d-4a62-a0a8-07d8e8af8f51 service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-eb804549-557b-4daa-8f00-acc34cc2af7e req-143cd60a-519d-4a62-a0a8-07d8e8af8f51 service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG nova.compute.manager [req-eb804549-557b-4daa-8f00-acc34cc2af7e req-143cd60a-519d-4a62-a0a8-07d8e8af8f51 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] No waiting events found dispatching network-vif-plugged-b70d8306-e1df-4d66-9949-8f156c902305 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:05 user nova-compute[73056]: WARNING nova.compute.manager [req-eb804549-557b-4daa-8f00-acc34cc2af7e req-143cd60a-519d-4a62-a0a8-07d8e8af8f51 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received unexpected event network-vif-plugged-b70d8306-e1df-4d66-9949-8f156c902305 for instance with vm_state active and task_state deleting.
Aug 14 16:39:05 user nova-compute[73056]: DEBUG nova.compute.manager [req-eb804549-557b-4daa-8f00-acc34cc2af7e req-143cd60a-519d-4a62-a0a8-07d8e8af8f51 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-vif-unplugged-4e2daf22-7953-47ca-b2c6-98a1f0b00b72 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-eb804549-557b-4daa-8f00-acc34cc2af7e req-143cd60a-519d-4a62-a0a8-07d8e8af8f51 service nova] Acquiring lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-eb804549-557b-4daa-8f00-acc34cc2af7e req-143cd60a-519d-4a62-a0a8-07d8e8af8f51 service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-eb804549-557b-4daa-8f00-acc34cc2af7e req-143cd60a-519d-4a62-a0a8-07d8e8af8f51 service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG nova.compute.manager [req-eb804549-557b-4daa-8f00-acc34cc2af7e req-143cd60a-519d-4a62-a0a8-07d8e8af8f51 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] No waiting events found dispatching network-vif-unplugged-4e2daf22-7953-47ca-b2c6-98a1f0b00b72 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG nova.compute.manager [req-eb804549-557b-4daa-8f00-acc34cc2af7e req-143cd60a-519d-4a62-a0a8-07d8e8af8f51 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-vif-unplugged-4e2daf22-7953-47ca-b2c6-98a1f0b00b72 for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG nova.compute.manager [req-eb804549-557b-4daa-8f00-acc34cc2af7e req-143cd60a-519d-4a62-a0a8-07d8e8af8f51 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-vif-plugged-4e2daf22-7953-47ca-b2c6-98a1f0b00b72 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-eb804549-557b-4daa-8f00-acc34cc2af7e req-143cd60a-519d-4a62-a0a8-07d8e8af8f51 service nova] Acquiring lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-eb804549-557b-4daa-8f00-acc34cc2af7e req-143cd60a-519d-4a62-a0a8-07d8e8af8f51 service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-eb804549-557b-4daa-8f00-acc34cc2af7e req-143cd60a-519d-4a62-a0a8-07d8e8af8f51 service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:05 user nova-compute[73056]: DEBUG nova.compute.manager [req-eb804549-557b-4daa-8f00-acc34cc2af7e req-143cd60a-519d-4a62-a0a8-07d8e8af8f51 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] No waiting events found dispatching network-vif-plugged-4e2daf22-7953-47ca-b2c6-98a1f0b00b72 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:05 user nova-compute[73056]: WARNING nova.compute.manager [req-eb804549-557b-4daa-8f00-acc34cc2af7e req-143cd60a-519d-4a62-a0a8-07d8e8af8f51 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received unexpected event network-vif-plugged-4e2daf22-7953-47ca-b2c6-98a1f0b00b72 for instance with vm_state active and task_state deleting.
Aug 14 16:39:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG nova.compute.manager [req-cd3b90d3-2ae3-4e8e-8a84-0b638a1ea138 req-b0f1cc36-6fb9-4ede-8257-f8fcf679b0ce service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-vif-plugged-69edfecc-9201-4747-89e2-bd552f2616ed {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cd3b90d3-2ae3-4e8e-8a84-0b638a1ea138 req-b0f1cc36-6fb9-4ede-8257-f8fcf679b0ce service nova] Acquiring lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cd3b90d3-2ae3-4e8e-8a84-0b638a1ea138 req-b0f1cc36-6fb9-4ede-8257-f8fcf679b0ce service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cd3b90d3-2ae3-4e8e-8a84-0b638a1ea138 req-b0f1cc36-6fb9-4ede-8257-f8fcf679b0ce service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG nova.compute.manager [req-cd3b90d3-2ae3-4e8e-8a84-0b638a1ea138 req-b0f1cc36-6fb9-4ede-8257-f8fcf679b0ce service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] No waiting events found dispatching network-vif-plugged-69edfecc-9201-4747-89e2-bd552f2616ed {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:06 user nova-compute[73056]: WARNING nova.compute.manager [req-cd3b90d3-2ae3-4e8e-8a84-0b638a1ea138 req-b0f1cc36-6fb9-4ede-8257-f8fcf679b0ce service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received unexpected event network-vif-plugged-69edfecc-9201-4747-89e2-bd552f2616ed for instance with vm_state active and task_state deleting.
Aug 14 16:39:06 user nova-compute[73056]: DEBUG nova.compute.manager [req-cd3b90d3-2ae3-4e8e-8a84-0b638a1ea138 req-b0f1cc36-6fb9-4ede-8257-f8fcf679b0ce service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-vif-unplugged-ea9bf8ed-60e0-4563-893c-33135ea49823 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cd3b90d3-2ae3-4e8e-8a84-0b638a1ea138 req-b0f1cc36-6fb9-4ede-8257-f8fcf679b0ce service nova] Acquiring lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cd3b90d3-2ae3-4e8e-8a84-0b638a1ea138 req-b0f1cc36-6fb9-4ede-8257-f8fcf679b0ce service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cd3b90d3-2ae3-4e8e-8a84-0b638a1ea138 req-b0f1cc36-6fb9-4ede-8257-f8fcf679b0ce service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG nova.compute.manager [req-cd3b90d3-2ae3-4e8e-8a84-0b638a1ea138 req-b0f1cc36-6fb9-4ede-8257-f8fcf679b0ce service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] No waiting events found dispatching network-vif-unplugged-ea9bf8ed-60e0-4563-893c-33135ea49823 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG nova.compute.manager [req-cd3b90d3-2ae3-4e8e-8a84-0b638a1ea138 req-b0f1cc36-6fb9-4ede-8257-f8fcf679b0ce service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-vif-unplugged-ea9bf8ed-60e0-4563-893c-33135ea49823 for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG nova.compute.manager [req-cd3b90d3-2ae3-4e8e-8a84-0b638a1ea138 req-b0f1cc36-6fb9-4ede-8257-f8fcf679b0ce service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-vif-plugged-ea9bf8ed-60e0-4563-893c-33135ea49823 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cd3b90d3-2ae3-4e8e-8a84-0b638a1ea138 req-b0f1cc36-6fb9-4ede-8257-f8fcf679b0ce service nova] Acquiring lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cd3b90d3-2ae3-4e8e-8a84-0b638a1ea138 req-b0f1cc36-6fb9-4ede-8257-f8fcf679b0ce service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cd3b90d3-2ae3-4e8e-8a84-0b638a1ea138 req-b0f1cc36-6fb9-4ede-8257-f8fcf679b0ce service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG nova.compute.manager [req-cd3b90d3-2ae3-4e8e-8a84-0b638a1ea138 req-b0f1cc36-6fb9-4ede-8257-f8fcf679b0ce service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] No waiting events found dispatching network-vif-plugged-ea9bf8ed-60e0-4563-893c-33135ea49823 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:06 user nova-compute[73056]: WARNING nova.compute.manager [req-cd3b90d3-2ae3-4e8e-8a84-0b638a1ea138 req-b0f1cc36-6fb9-4ede-8257-f8fcf679b0ce service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received unexpected event network-vif-plugged-ea9bf8ed-60e0-4563-893c-33135ea49823 for instance with vm_state active and task_state deleting.
Aug 14 16:39:06 user nova-compute[73056]: DEBUG nova.compute.manager [req-cd3b90d3-2ae3-4e8e-8a84-0b638a1ea138 req-b0f1cc36-6fb9-4ede-8257-f8fcf679b0ce service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-vif-unplugged-9a54a741-25de-4758-921c-0b7e5c5730dd {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cd3b90d3-2ae3-4e8e-8a84-0b638a1ea138 req-b0f1cc36-6fb9-4ede-8257-f8fcf679b0ce service nova] Acquiring lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cd3b90d3-2ae3-4e8e-8a84-0b638a1ea138 req-b0f1cc36-6fb9-4ede-8257-f8fcf679b0ce service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cd3b90d3-2ae3-4e8e-8a84-0b638a1ea138 req-b0f1cc36-6fb9-4ede-8257-f8fcf679b0ce service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG nova.compute.manager [req-cd3b90d3-2ae3-4e8e-8a84-0b638a1ea138 req-b0f1cc36-6fb9-4ede-8257-f8fcf679b0ce service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] No waiting events found dispatching network-vif-unplugged-9a54a741-25de-4758-921c-0b7e5c5730dd {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG nova.compute.manager [req-cd3b90d3-2ae3-4e8e-8a84-0b638a1ea138 req-b0f1cc36-6fb9-4ede-8257-f8fcf679b0ce service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-vif-unplugged-9a54a741-25de-4758-921c-0b7e5c5730dd for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.064s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c1caa7-1e5d-4bd0-8745-b9f15550747c]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] SCSI volumes sdc have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2602fc16-b6bd-48bc-aa8a-a540855dcbb5]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f -p 172.16.0.220:3260 --logout" returned: 0 in 0.098s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[413e88f4-c1cf-4121-8308-81ef2afc4a7c]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f, portal: 172.16.0.220,3260]
Aug 14 16:39:06 user nova-compute[73056]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f, portal: 172.16.0.220,3260] successful.
Aug 14 16:39:06 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957e6707-8ee8-47f6-8191-969f2f44496f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1820b28-06f7-4dc6-b776-b20290beabe5]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.440s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] <== disconnect_volume: return (442ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QZTwFLJN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:39:06 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[13339464-5df3-4cdb-b292-5d5a8ca3f9ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[1619507b-3182-4453-9e17-5406b98763f8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b (non-flash)
Aug 14 16:39:06 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:39:06 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:39:06 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:39:06 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:39:06 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:39:06 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b (non-flash)
Aug 14 16:39:06 user nova-compute[73056]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a (non-flash)
Aug 14 16:39:06 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:39:06 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:39:06 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:39:06 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:39:06 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff2dcec0550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a'): ({'sdd'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Removing single pathed devices sdd {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ac13cd-0499-47c2-bb07-18306668695f]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5811626c-a6dc-47de-859a-8fd4ee4b3c95]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Flushing IO for device /dev/sdd {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ccbb97-51e5-4730-adf3-61d6564ad71b]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[958592b9-1278-45b6-aa6b-933c99457de5]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] SCSI volumes sdd have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[566869ed-7435-49bd-9073-7ec5dfb63896]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[381b436a-f2bd-4b9a-89a0-4e2448faf993]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a, portal: 172.16.0.220,3260]
Aug 14 16:39:06 user nova-compute[73056]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a, portal: 172.16.0.220,3260] successful.
Aug 14 16:39:06 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:040300fa-4882-4b0e-93f0-5ebeb1d9c48a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1cbb9c-ac84-4228-bc94-abb536ac89f0]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] <== disconnect_volume: return (393ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oNXLTfHE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:39:06 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fee20f-0d4f-4987-8faa-951b7cd79033]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[df00b700-342b-453e-821f-cc548e37a897]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b (non-flash)
Aug 14 16:39:06 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:39:06 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:39:06 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:39:06 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:39:06 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b (non-flash)
Aug 14 16:39:06 user nova-compute[73056]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 (non-flash)
Aug 14 16:39:06 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:39:06 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:39:06 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:39:06 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff2dcec0550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346'): ({'sde'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Removing single pathed devices sde {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf50448-c655-404d-b518-7543166a8078]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[82546a73-5ee6-4df9-bb1a-c74e635ec92d]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Flushing IO for device /dev/sde {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[14334034-ee0a-4d86-8a00-95428925e967]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.070s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0cc4a7-512a-4433-a00c-a25243fb1230]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] SCSI volumes sde have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc512516-9614-47ef-b7bf-63ea0f1da2fd]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59c0dff-ac52-4f36-acf3-60cf4dcf0034]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346, portal: 172.16.0.220,3260]
Aug 14 16:39:06 user nova-compute[73056]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346, portal: 172.16.0.220,3260] successful.
Aug 14 16:39:06 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f709d3df-9c5d-478b-b3c5-ecc33e581346 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:07 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde25927-9afb-49c3-8552-05bb4f8c91d9]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:07 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:07 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:39:07 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] <== disconnect_volume: return (388ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:39:07 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:39:07 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Deleting instance files /opt/stack/data/nova/instances/d15f23ae-f5a4-47cf-b136-7072c7838790_del
Aug 14 16:39:07 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Deletion of /opt/stack/data/nova/instances/d15f23ae-f5a4-47cf-b136-7072c7838790_del complete
Aug 14 16:39:07 user nova-compute[73056]: INFO nova.compute.manager [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Took 4.11 seconds to destroy the instance on the hypervisor.
Aug 14 16:39:07 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 16:39:07 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 16:39:07 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 16:39:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:07 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:39:07 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrxZnPzJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:39:07 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:39:07 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:39:07 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:39:07 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:39:07 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:39:07 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:39:07 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:39:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:07 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8547843-94e8-4d3e-9122-3d68bf5463b0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:07 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:39:07 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:07 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[952cbc0d-eb70-4ee6-84be-ae476504e19a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:07 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d] added
Aug 14 16:39:07 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.184s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[71978e42-ceb4-48c2-8079-c506eb41d8d2]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b240e9f-8cef-41ba-a719-d9c8c361ade3]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CrxZnPzJ {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CrxZnPzJ" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9f48bf-ad89-4d5d-94e9-787878c7318f]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CrxZnPzJ'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[384957ae-1c0d-4e87-9c96-46d86cad9e95]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[24183e45-cb10-46b0-a219-4b8a6bc8ab80]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b (non-flash)
Aug 14 16:39:08 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:39:08 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:39:08 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:39:08 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b (non-flash)
Aug 14 16:39:08 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:39:08 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:39:08 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:39:08 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG nova.compute.manager [req-b752bbf0-9b72-407c-bf79-61144d06114a req-e0e2415a-b78a-43af-b01f-5afec861c029 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-vif-plugged-9a54a741-25de-4758-921c-0b7e5c5730dd {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-b752bbf0-9b72-407c-bf79-61144d06114a req-e0e2415a-b78a-43af-b01f-5afec861c029 service nova] Acquiring lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-b752bbf0-9b72-407c-bf79-61144d06114a req-e0e2415a-b78a-43af-b01f-5afec861c029 service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-b752bbf0-9b72-407c-bf79-61144d06114a req-e0e2415a-b78a-43af-b01f-5afec861c029 service nova] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG nova.compute.manager [req-b752bbf0-9b72-407c-bf79-61144d06114a req-e0e2415a-b78a-43af-b01f-5afec861c029 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] No waiting events found dispatching network-vif-plugged-9a54a741-25de-4758-921c-0b7e5c5730dd {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:08 user nova-compute[73056]: WARNING nova.compute.manager [req-b752bbf0-9b72-407c-bf79-61144d06114a req-e0e2415a-b78a-43af-b01f-5afec861c029 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received unexpected event network-vif-plugged-9a54a741-25de-4758-921c-0b7e5c5730dd for instance with vm_state active and task_state deleting.
Aug 14 16:39:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec17299b-c499-4549-a375-0ad63008710d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d, portal: 172.16.0.220,3260]
Aug 14 16:39:08 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d, portal: 172.16.0.220,3260] successful.
Aug 14 16:39:08 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87a0445-1c20-457a-9b2f-8c24556a6ceb]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[eefdc515-38cc-447f-8815-0444692400da]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b (non-flash)
Aug 14 16:39:08 user nova-compute[73056]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)
Aug 14 16:39:08 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:39:08 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:39:08 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:39:08 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b (non-flash)
Aug 14 16:39:08 user nova-compute[73056]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)
Aug 14 16:39:08 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:39:08 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:39:08 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:39:08 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.561s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[73724df3-c9ea-424f-8527-782fcb4c3fe9]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:39:08 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrxZnPzJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:39:09 user nova-compute[73056]: DEBUG nova.compute.manager [req-18676345-8ae1-4281-b192-b5a9d60274c6 req-13801798-1d82-4148-b6ff-eac682a10b14 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-vif-deleted-ea9bf8ed-60e0-4563-893c-33135ea49823 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:09 user nova-compute[73056]: INFO nova.compute.manager [req-18676345-8ae1-4281-b192-b5a9d60274c6 req-13801798-1d82-4148-b6ff-eac682a10b14 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Neutron deleted interface ea9bf8ed-60e0-4563-893c-33135ea49823; detaching it from the instance and deleting it from the info cache
Aug 14 16:39:09 user nova-compute[73056]: DEBUG nova.network.neutron [req-18676345-8ae1-4281-b192-b5a9d60274c6 req-13801798-1d82-4148-b6ff-eac682a10b14 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Updating instance_info_cache with network_info: [{"id": "c81e86e3-8261-441f-b7b1-145aa7740e08", "address": "fa:16:3e:80:07:c2", "network": {"id": "cffc94d2-2f90-4180-b640-81eac93db07e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-5276327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81e86e3-82", "ovs_interfaceid": "c81e86e3-8261-441f-b7b1-145aa7740e08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69edfecc-9201-4747-89e2-bd552f2616ed", "address": "fa:16:3e:b2:f1:d1", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69edfecc-92", "ovs_interfaceid": "69edfecc-9201-4747-89e2-bd552f2616ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b70d8306-e1df-4d66-9949-8f156c902305", "address": "fa:16:3e:68:92:b2", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70d8306-e1", "ovs_interfaceid": "b70d8306-e1df-4d66-9949-8f156c902305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9a54a741-25de-4758-921c-0b7e5c5730dd", "address": "fa:16:3e:bc:d6:2a", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a54a741-25", "ovs_interfaceid": "9a54a741-25de-4758-921c-0b7e5c5730dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e2daf22-7953-47ca-b2c6-98a1f0b00b72", "address": "fa:16:3e:b2:04:50", "network": {"id": "0cdd5be6-368d-4088-ad0c-d696845f9579", "bridge": "br-int", "label": "tempest-device-tagging-net2-999697901", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e2daf22-79", "ovs_interfaceid": "4e2daf22-7953-47ca-b2c6-98a1f0b00b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee13669b-f42c-4ca6-84e9-c95e35048ffc", "address": "fa:16:3e:28:49:8c", "network": {"id": "0cdd5be6-368d-4088-ad0c-d696845f9579", "bridge": "br-int", "label": "tempest-device-tagging-net2-999697901", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee13669b-f4", "ovs_interfaceid": "ee13669b-f42c-4ca6-84e9-c95e35048ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:39:09 user nova-compute[73056]: DEBUG nova.compute.manager [req-18676345-8ae1-4281-b192-b5a9d60274c6 req-13801798-1d82-4148-b6ff-eac682a10b14 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Detach interface failed, port_id=ea9bf8ed-60e0-4563-893c-33135ea49823, reason: Instance d15f23ae-f5a4-47cf-b136-7072c7838790 could not be found. {{(pid=73056) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 16:39:09 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.617s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:39:09 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] <== connect_volume: return (1619ms) {'type': 'block', 'scsi_wwn': '26239643538363331', 'path': '/dev/sdc'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:39:09 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239643538363331', 'path': '/dev/sdc'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:39:09 user nova-compute[73056]: DEBUG nova.objects.instance [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lazy-loading 'flavor' on Instance uuid 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:39:09 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 16:39:09 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:39:09 user nova-compute[73056]:   <source dev="/dev/sdc"/>
Aug 14 16:39:09 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:39:09 user nova-compute[73056]:   <serial>cdf3d64f-ff30-4b56-8937-48b4d97bed1d</serial>
Aug 14 16:39:09 user nova-compute[73056]: </disk>
Aug 14 16:39:09 user nova-compute[73056]:  {{(pid=73056) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 16:39:10 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:39:10 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:39:10 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] No VIF found with MAC fa:16:3e:8d:d8:88, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:39:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-647ae903-8ed3-4632-a52f-4fd78bbac1bc tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.547s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:11 user nova-compute[73056]: DEBUG nova.compute.manager [req-c780fc86-8cfe-4ca4-9f1f-ba38eb822b48 req-170ef7cd-0e27-410f-a1e5-e9479a48a903 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-vif-deleted-4e2daf22-7953-47ca-b2c6-98a1f0b00b72 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:11 user nova-compute[73056]: INFO nova.compute.manager [req-c780fc86-8cfe-4ca4-9f1f-ba38eb822b48 req-170ef7cd-0e27-410f-a1e5-e9479a48a903 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Neutron deleted interface 4e2daf22-7953-47ca-b2c6-98a1f0b00b72; detaching it from the instance and deleting it from the info cache
Aug 14 16:39:11 user nova-compute[73056]: DEBUG nova.network.neutron [req-c780fc86-8cfe-4ca4-9f1f-ba38eb822b48 req-170ef7cd-0e27-410f-a1e5-e9479a48a903 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Updating instance_info_cache with network_info: [{"id": "c81e86e3-8261-441f-b7b1-145aa7740e08", "address": "fa:16:3e:80:07:c2", "network": {"id": "cffc94d2-2f90-4180-b640-81eac93db07e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-5276327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81e86e3-82", "ovs_interfaceid": "c81e86e3-8261-441f-b7b1-145aa7740e08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69edfecc-9201-4747-89e2-bd552f2616ed", "address": "fa:16:3e:b2:f1:d1", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69edfecc-92", "ovs_interfaceid": "69edfecc-9201-4747-89e2-bd552f2616ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b70d8306-e1df-4d66-9949-8f156c902305", "address": "fa:16:3e:68:92:b2", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70d8306-e1", "ovs_interfaceid": "b70d8306-e1df-4d66-9949-8f156c902305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9a54a741-25de-4758-921c-0b7e5c5730dd", "address": "fa:16:3e:bc:d6:2a", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a54a741-25", "ovs_interfaceid": "9a54a741-25de-4758-921c-0b7e5c5730dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee13669b-f42c-4ca6-84e9-c95e35048ffc", "address": "fa:16:3e:28:49:8c", "network": {"id": "0cdd5be6-368d-4088-ad0c-d696845f9579", "bridge": "br-int", "label": "tempest-device-tagging-net2-999697901", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee13669b-f4", "ovs_interfaceid": "ee13669b-f42c-4ca6-84e9-c95e35048ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:39:11 user nova-compute[73056]: DEBUG nova.compute.manager [req-c780fc86-8cfe-4ca4-9f1f-ba38eb822b48 req-170ef7cd-0e27-410f-a1e5-e9479a48a903 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Detach interface failed, port_id=4e2daf22-7953-47ca-b2c6-98a1f0b00b72, reason: Instance d15f23ae-f5a4-47cf-b136-7072c7838790 could not be found. {{(pid=73056) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 16:39:11 user nova-compute[73056]: DEBUG nova.compute.manager [req-c780fc86-8cfe-4ca4-9f1f-ba38eb822b48 req-170ef7cd-0e27-410f-a1e5-e9479a48a903 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-vif-deleted-c81e86e3-8261-441f-b7b1-145aa7740e08 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:11 user nova-compute[73056]: INFO nova.compute.manager [req-c780fc86-8cfe-4ca4-9f1f-ba38eb822b48 req-170ef7cd-0e27-410f-a1e5-e9479a48a903 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Neutron deleted interface c81e86e3-8261-441f-b7b1-145aa7740e08; detaching it from the instance and deleting it from the info cache
Aug 14 16:39:11 user nova-compute[73056]: DEBUG nova.network.neutron [req-c780fc86-8cfe-4ca4-9f1f-ba38eb822b48 req-170ef7cd-0e27-410f-a1e5-e9479a48a903 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Updating instance_info_cache with network_info: [{"id": "69edfecc-9201-4747-89e2-bd552f2616ed", "address": "fa:16:3e:b2:f1:d1", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69edfecc-92", "ovs_interfaceid": "69edfecc-9201-4747-89e2-bd552f2616ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b70d8306-e1df-4d66-9949-8f156c902305", "address": "fa:16:3e:68:92:b2", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70d8306-e1", "ovs_interfaceid": "b70d8306-e1df-4d66-9949-8f156c902305", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9a54a741-25de-4758-921c-0b7e5c5730dd", "address": "fa:16:3e:bc:d6:2a", "network": {"id": "49b33d8e-84cc-4c69-800d-395f46025327", "bridge": "br-int", "label": "tempest-device-tagging-net1-1428769815", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a54a741-25", "ovs_interfaceid": "9a54a741-25de-4758-921c-0b7e5c5730dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee13669b-f42c-4ca6-84e9-c95e35048ffc", "address": "fa:16:3e:28:49:8c", "network": {"id": "0cdd5be6-368d-4088-ad0c-d696845f9579", "bridge": "br-int", "label": "tempest-device-tagging-net2-999697901", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1b973979ba4d4dfbb0a5088e9017ffa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee13669b-f4", "ovs_interfaceid": "ee13669b-f42c-4ca6-84e9-c95e35048ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:39:11 user nova-compute[73056]: DEBUG nova.compute.manager [req-c780fc86-8cfe-4ca4-9f1f-ba38eb822b48 req-170ef7cd-0e27-410f-a1e5-e9479a48a903 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Detach interface failed, port_id=c81e86e3-8261-441f-b7b1-145aa7740e08, reason: Instance d15f23ae-f5a4-47cf-b136-7072c7838790 could not be found. {{(pid=73056) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 16:39:11 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:39:11 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Took 4.79 seconds to deallocate network for instance.
Aug 14 16:39:13 user nova-compute[73056]: DEBUG nova.compute.manager [req-fda8cf36-0153-481c-9fe2-528b07ab9445 req-76cc3266-0166-48ec-a79d-70561d1a6106 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-vif-deleted-9a54a741-25de-4758-921c-0b7e5c5730dd {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:13 user nova-compute[73056]: DEBUG nova.compute.manager [req-fda8cf36-0153-481c-9fe2-528b07ab9445 req-76cc3266-0166-48ec-a79d-70561d1a6106 service nova] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Received event network-vif-deleted-ee13669b-f42c-4ca6-84e9-c95e35048ffc {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:14 user nova-compute[73056]: INFO nova.compute.manager [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Took 2.77 seconds to detach 3 volumes for instance.
Aug 14 16:39:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:39:15 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Creating image(s)
Aug 14 16:39:15 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Did not create local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Ensure instance console log exists: /opt/stack/data/nova/instances/a329b987-231e-47a8-9f2d-71c15573f9f0/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Start _get_guest_xml network_info=[{"id": "17d6adb4-b6f5-4c34-936d-35d1a4920106", "address": "fa:16:3e:b5:bf:bb", "network": {"id": "e6b5cbb1-4f9c-4d4e-9a5a-c6b9fb6f2c0a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-787940559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "858651f51ffd49a48f3e98e7de4d87e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d6adb4-b6", "ovs_interfaceid": "17d6adb4-b6f5-4c34-936d-35d1a4920106", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mCfQgvrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a329b987-231e-47a8-9f2d-71c15573f9f0', 'attached_at': '', 'detached_at': '', 'volume_id': '663decc6-865c-4b8c-90f2-d6c4918e27d4', 'serial': '663decc6-865c-4b8c-90f2-d6c4918e27d4'}, 'attachment_id': 'bb5d07ca-7a70-43c7-96e2-4ae802e85ecb', 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:39:15 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 14 16:39:15 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 14 16:39:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.451s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG nova.objects.instance [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lazy-loading 'vcpu_model' on Instance uuid a329b987-231e-47a8-9f2d-71c15573f9f0 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:39:15 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Deleted allocations for instance d15f23ae-f5a4-47cf-b136-7072c7838790
Aug 14 16:39:15 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mCfQgvrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:39:15 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 16:39:15 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:39:15 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 16:39:15 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:39:15 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:39:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff647a0f-ce0b-43fe-960e-e52e03ba0375]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:39:15 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.452s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4b0feb-ba12-4830-bae6-efc40f7ac38e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4] added
Aug 14 16:39:15 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-88392a1d-e01e-4237-9479-ed1f2ee6a5e0 tempest-TaggedBootDevicesTest-1118695598 tempest-TaggedBootDevicesTest-1118695598-project-member] Lock "d15f23ae-f5a4-47cf-b136-7072c7838790" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.859s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7cdfb5-a9c7-45a5-b457-33ec8eed9af9]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[acaeb4b5-9f76-4176-bfef-3805ccfd1eb0]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mCfQgvrh {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mCfQgvrh" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[413fc671-38bf-4ce8-9f89-28ffe3dcf236]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mCfQgvrh'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.036s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e870fe5f-d2a5-4ba1-808a-d1e8723419f8]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:16 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:16 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ae7c17-fc18-41f6-a410-37bbcf66e889]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:16 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b (non-flash)
Aug 14 16:39:16 user nova-compute[73056]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)
Aug 14 16:39:16 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:39:16 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:39:16 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:39:16 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:39:16 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b (non-flash)
Aug 14 16:39:16 user nova-compute[73056]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)
Aug 14 16:39:16 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:39:16 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:39:16 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:39:16 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:39:16 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:16 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:16 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46bb054-dd9a-4c73-8179-e257c3540cca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:16 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4, portal: 172.16.0.220,3260]
Aug 14 16:39:16 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4, portal: 172.16.0.220,3260] successful.
Aug 14 16:39:16 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:16 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:16 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.083s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:16 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd2a0c3-714a-4030-b05d-6f04774028f0]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:16 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:16 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:16 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:16 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5aaca38-030f-40cc-a5c9-4caf80801763]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:16 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b (non-flash)
Aug 14 16:39:16 user nova-compute[73056]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)
Aug 14 16:39:16 user nova-compute[73056]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:39:16 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:39:16 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:39:16 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:39:16 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:39:16 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b (non-flash)
Aug 14 16:39:16 user nova-compute[73056]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)
Aug 14 16:39:16 user nova-compute[73056]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:39:16 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:39:16 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:39:16 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:39:16 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:39:16 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.906s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:39:16 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:39:16 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:39:16 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:39:16 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:16 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:16 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec59f49-8143-4b41-891b-68f2ed167f12]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:16 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: None {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:39:16 user nova-compute[73056]: DEBUG nova.compute.manager [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oRfJwBhO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9927d1d6-6e26-4408-b509-c96df5f314d6', 'attached_at': '', 'detached_at': '', 'volume_id': '54a15b78-0b03-4e36-b1bb-4772f342893b', 'serial': '54a15b78-0b03-4e36-b1bb-4772f342893b'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BKacklrm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b'}, 'status': 'reserved', 'instance': '9927d1d6-6e26-4408-b509-c96df5f314d6', 'attached_at': '', 'detached_at': '', 'volume_id': '250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b', 'serial'} {{(pid=73056) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 14 16:39:16 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:39:16 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oRfJwBhO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:39:16 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:39:16 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mCfQgvrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.943s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] <== connect_volume: return (1944ms) {'type': 'block', 'scsi_wwn': '26436353862626335', 'path': '/dev/sdd'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436353862626335', 'path': '/dev/sdd'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.931s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:39:17 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:39:17 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:39:17 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:39:17 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T16:36:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2031154332',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-816611793',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrF6zQFCvY9I3Tx9Li4l8oLTxmzYxKp1UXPWnmTcCEWQmNrSST0nsa4EPNdzwiM8Sv72y8YAykbLtymkPXgs3ARLo+xvw/dSjjcHO5qsCxzDKWOJT1CHZ5oKqFnSSvojQ==',key_name='tempest-keypair-1364462886',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:37:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='858651f51ffd49a48f3e98e7de4d87e3',ramdisk_id='',reservation_id='r-2hejxwxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-153336784',owner_user_name='tempest-ServerActionsV293TestJSON-153336784-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:39:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da42a829953a49519d1e52647597e48a',uuid=a329b987-231e-47a8-9f2d-71c15573f9f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "17d6adb4-b6f5-4c34-936d-35d1a4920106", "address": "fa:16:3e:b5:bf:bb", "network": {"id": "e6b5cbb1-4f9c-4d4e-9a5a-c6b9fb6f2c0a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-787940559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "858651f51ffd49a48f3e98e7de4d87e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d6adb4-b6", "ovs_interfaceid": "17d6adb4-b6f5-4c34-936d-35d1a4920106", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Converting VIF {"id": "17d6adb4-b6f5-4c34-936d-35d1a4920106", "address": "fa:16:3e:b5:bf:bb", "network": {"id": "e6b5cbb1-4f9c-4d4e-9a5a-c6b9fb6f2c0a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-787940559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "858651f51ffd49a48f3e98e7de4d87e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d6adb4-b6", "ovs_interfaceid": "17d6adb4-b6f5-4c34-936d-35d1a4920106", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:bf:bb,bridge_name='br-int',has_traffic_filtering=True,id=17d6adb4-b6f5-4c34-936d-35d1a4920106,network=Network(e6b5cbb1-4f9c-4d4e-9a5a-c6b9fb6f2c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17d6adb4-b6') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:39:17 user nova-compute[73056]:   <uuid>a329b987-231e-47a8-9f2d-71c15573f9f0</uuid>
Aug 14 16:39:17 user nova-compute[73056]:   <name>instance-00000007</name>
Aug 14 16:39:17 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:39:17 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:39:17 user nova-compute[73056]:   <metadata>
Aug 14 16:39:17 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:39:17 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:39:17 user nova-compute[73056]:       <nova:name>tempest-ServerActionsV293TestJSON-server-2031154332</nova:name>
Aug 14 16:39:17 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:39:15</nova:creationTime>
Aug 14 16:39:17 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:39:17 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:39:17 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:39:17 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:39:17 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:39:17 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:39:17 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:39:17 user nova-compute[73056]:       <nova:owner>
Aug 14 16:39:17 user nova-compute[73056]:         <nova:user uuid="da42a829953a49519d1e52647597e48a">tempest-ServerActionsV293TestJSON-153336784-project-member</nova:user>
Aug 14 16:39:17 user nova-compute[73056]:         <nova:project uuid="858651f51ffd49a48f3e98e7de4d87e3">tempest-ServerActionsV293TestJSON-153336784</nova:project>
Aug 14 16:39:17 user nova-compute[73056]:       </nova:owner>
Aug 14 16:39:17 user nova-compute[73056]:       <nova:ports>
Aug 14 16:39:17 user nova-compute[73056]:         <nova:port uuid="17d6adb4-b6f5-4c34-936d-35d1a4920106">
Aug 14 16:39:17 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 14 16:39:17 user nova-compute[73056]:         </nova:port>
Aug 14 16:39:17 user nova-compute[73056]:       </nova:ports>
Aug 14 16:39:17 user nova-compute[73056]:     </nova:instance>
Aug 14 16:39:17 user nova-compute[73056]:   </metadata>
Aug 14 16:39:17 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:39:17 user nova-compute[73056]:     <system>
Aug 14 16:39:17 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:39:17 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:39:17 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:39:17 user nova-compute[73056]:       <entry name="serial">a329b987-231e-47a8-9f2d-71c15573f9f0</entry>
Aug 14 16:39:17 user nova-compute[73056]:       <entry name="uuid">a329b987-231e-47a8-9f2d-71c15573f9f0</entry>
Aug 14 16:39:17 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:39:17 user nova-compute[73056]:     </system>
Aug 14 16:39:17 user nova-compute[73056]:   </sysinfo>
Aug 14 16:39:17 user nova-compute[73056]:   <os>
Aug 14 16:39:17 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:39:17 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:39:17 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:39:17 user nova-compute[73056]:   </os>
Aug 14 16:39:17 user nova-compute[73056]:   <features>
Aug 14 16:39:17 user nova-compute[73056]:     <acpi/>
Aug 14 16:39:17 user nova-compute[73056]:     <apic/>
Aug 14 16:39:17 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:39:17 user nova-compute[73056]:   </features>
Aug 14 16:39:17 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:39:17 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:39:17 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:39:17 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:39:17 user nova-compute[73056]:   </clock>
Aug 14 16:39:17 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:39:17 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:39:17 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:39:17 user nova-compute[73056]:   </cpu>
Aug 14 16:39:17 user nova-compute[73056]:   <devices>
Aug 14 16:39:17 user nova-compute[73056]:     <disk type="block" device="disk">
Aug 14 16:39:17 user nova-compute[73056]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:39:17 user nova-compute[73056]:       <source dev="/dev/sdd"/>
Aug 14 16:39:17 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:39:17 user nova-compute[73056]:       <serial>663decc6-865c-4b8c-90f2-d6c4918e27d4</serial>
Aug 14 16:39:17 user nova-compute[73056]:     </disk>
Aug 14 16:39:17 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:39:17 user nova-compute[73056]:       <mac address="fa:16:3e:b5:bf:bb"/>
Aug 14 16:39:17 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:39:17 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:39:17 user nova-compute[73056]:       <target dev="tap17d6adb4-b6"/>
Aug 14 16:39:17 user nova-compute[73056]:     </interface>
Aug 14 16:39:17 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:39:17 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/a329b987-231e-47a8-9f2d-71c15573f9f0/console.log" append="off"/>
Aug 14 16:39:17 user nova-compute[73056]:     </serial>
Aug 14 16:39:17 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:39:17 user nova-compute[73056]:     <video>
Aug 14 16:39:17 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:39:17 user nova-compute[73056]:     </video>
Aug 14 16:39:17 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:39:17 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:39:17 user nova-compute[73056]:     </rng>
Aug 14 16:39:17 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:39:17 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:39:17 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:39:17 user nova-compute[73056]:     </memballoon>
Aug 14 16:39:17 user nova-compute[73056]:   </devices>
Aug 14 16:39:17 user nova-compute[73056]: </domain>
Aug 14 16:39:17 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T16:36:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2031154332',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-816611793',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrF6zQFCvY9I3Tx9Li4l8oLTxmzYxKp1UXPWnmTcCEWQmNrSST0nsa4EPNdzwiM8Sv72y8YAykbLtymkPXgs3ARLo+xvw/dSjjcHO5qsCxzDKWOJT1CHZ5oKqFnSSvojQ==',key_name='tempest-keypair-1364462886',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:37:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='858651f51ffd49a48f3e98e7de4d87e3',ramdisk_id='',reservation_id='r-2hejxwxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-153336784',owner_user_name='tempest-ServerActionsV293TestJSON-153336784-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:39:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da42a829953a49519d1e52647597e48a',uuid=a329b987-231e-47a8-9f2d-71c15573f9f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "17d6adb4-b6f5-4c34-936d-35d1a4920106", "address": "fa:16:3e:b5:bf:bb", "network": {"id": "e6b5cbb1-4f9c-4d4e-9a5a-c6b9fb6f2c0a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-787940559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "858651f51ffd49a48f3e98e7de4d87e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d6adb4-b6", "ovs_interfaceid": "17d6adb4-b6f5-4c34-936d-35d1a4920106", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Converting VIF {"id": "17d6adb4-b6f5-4c34-936d-35d1a4920106", "address": "fa:16:3e:b5:bf:bb", "network": {"id": "e6b5cbb1-4f9c-4d4e-9a5a-c6b9fb6f2c0a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-787940559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "858651f51ffd49a48f3e98e7de4d87e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d6adb4-b6", "ovs_interfaceid": "17d6adb4-b6f5-4c34-936d-35d1a4920106", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:bf:bb,bridge_name='br-int',has_traffic_filtering=True,id=17d6adb4-b6f5-4c34-936d-35d1a4920106,network=Network(e6b5cbb1-4f9c-4d4e-9a5a-c6b9fb6f2c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17d6adb4-b6') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG os_vif [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:bf:bb,bridge_name='br-int',has_traffic_filtering=True,id=17d6adb4-b6f5-4c34-936d-35d1a4920106,network=Network(e6b5cbb1-4f9c-4d4e-9a5a-c6b9fb6f2c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17d6adb4-b6') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd34d7e-60fa-4e84-8e69-ee2fe30cb8ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:39:17 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap17d6adb4-b6, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap17d6adb4-b6, col_values=(('external_ids', {'iface-id': '17d6adb4-b6f5-4c34-936d-35d1a4920106', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:bf:bb', 'vm-uuid': 'a329b987-231e-47a8-9f2d-71c15573f9f0'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:17 user nova-compute[73056]: INFO os_vif [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:bf:bb,bridge_name='br-int',has_traffic_filtering=True,id=17d6adb4-b6f5-4c34-936d-35d1a4920106,network=Network(e6b5cbb1-4f9c-4d4e-9a5a-c6b9fb6f2c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17d6adb4-b6')
Aug 14 16:39:17 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d4a439-bfe9-4381-bc4e-1a49ff931164]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b] added
Aug 14 16:39:17 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e872bf8d-0ceb-4b43-a6ae-15655802adcf]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] No VIF found with MAC fa:16:3e:b5:bf:bb, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afe79c9-be77-4eca-97e9-6f8cec41a990]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oRfJwBhO {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oRfJwBhO" returned: 0 in 0.027s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0dbea6-1c3c-40ae-919e-ef575dcac9e1]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oRfJwBhO'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc7b7c8-59b4-4d54-bd79-599f7d32d226]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e3f66f-99d3-4032-be30-dff1f33275bc]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b (non-flash)
Aug 14 16:39:17 user nova-compute[73056]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)
Aug 14 16:39:17 user nova-compute[73056]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:39:17 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:39:17 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:39:17 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:39:17 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b (non-flash)
Aug 14 16:39:17 user nova-compute[73056]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)
Aug 14 16:39:17 user nova-compute[73056]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:39:17 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:39:17 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:39:17 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:39:17 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc95385-91a9-4188-abb1-62d661cc48d2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b, portal: 172.16.0.220,3260]
Aug 14 16:39:17 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b, portal: 172.16.0.220,3260] successful.
Aug 14 16:39:17 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[1889ff91-3744-439c-b4f7-44fecaf0d18e]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8a6112-2fa6-4449-bd57-60c6a6d90ab9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b (non-flash)
Aug 14 16:39:17 user nova-compute[73056]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)
Aug 14 16:39:17 user nova-compute[73056]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:39:17 user nova-compute[73056]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b (non-flash)
Aug 14 16:39:17 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:39:17 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:39:17 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:39:17 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b (non-flash)
Aug 14 16:39:17 user nova-compute[73056]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)
Aug 14 16:39:17 user nova-compute[73056]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:39:17 user nova-compute[73056]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b (non-flash)
Aug 14 16:39:17 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:39:17 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:39:17 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:39:17 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.379s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] HCTL ('36', '-', '-', 0) found on session 18 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83f273a-9ecc-44cf-ba30-bb867a447e2d]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Searching for a device in session 18 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:39:17 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oRfJwBhO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:39:18 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.425s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:39:18 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] <== connect_volume: return (2357ms) {'type': 'block', 'scsi_wwn': '26230303162313961', 'path': '/dev/sde'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:39:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230303162313961', 'path': '/dev/sde'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:39:18 user nova-compute[73056]: DEBUG nova.objects.instance [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Lazy-loading 'flavor' on Instance uuid 9927d1d6-6e26-4408-b509-c96df5f314d6 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:39:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:19 user nova-compute[73056]: DEBUG nova.compute.manager [req-2eabfc63-7a29-42c1-bd4c-91ff7b45f209 req-dabd4b15-eae9-4f14-aded-4845a34fc6c7 service nova] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Received event network-vif-plugged-17d6adb4-b6f5-4c34-936d-35d1a4920106 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2eabfc63-7a29-42c1-bd4c-91ff7b45f209 req-dabd4b15-eae9-4f14-aded-4845a34fc6c7 service nova] Acquiring lock "a329b987-231e-47a8-9f2d-71c15573f9f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2eabfc63-7a29-42c1-bd4c-91ff7b45f209 req-dabd4b15-eae9-4f14-aded-4845a34fc6c7 service nova] Lock "a329b987-231e-47a8-9f2d-71c15573f9f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2eabfc63-7a29-42c1-bd4c-91ff7b45f209 req-dabd4b15-eae9-4f14-aded-4845a34fc6c7 service nova] Lock "a329b987-231e-47a8-9f2d-71c15573f9f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:19 user nova-compute[73056]: DEBUG nova.compute.manager [req-2eabfc63-7a29-42c1-bd4c-91ff7b45f209 req-dabd4b15-eae9-4f14-aded-4845a34fc6c7 service nova] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] No waiting events found dispatching network-vif-plugged-17d6adb4-b6f5-4c34-936d-35d1a4920106 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:19 user nova-compute[73056]: WARNING nova.compute.manager [req-2eabfc63-7a29-42c1-bd4c-91ff7b45f209 req-dabd4b15-eae9-4f14-aded-4845a34fc6c7 service nova] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Received unexpected event network-vif-plugged-17d6adb4-b6f5-4c34-936d-35d1a4920106 for instance with vm_state active and task_state rebuild_spawning.
Aug 14 16:39:19 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=73056) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 16:39:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:19 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] COPY block job progress, current cursor: 158334976 final cursor: 1073741824 {{(pid=73056) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 16:39:20 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692031145.2189522, d15f23ae-f5a4-47cf-b136-7072c7838790 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:39:20 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] VM Stopped (Lifecycle Event)
Aug 14 16:39:20 user nova-compute[73056]: DEBUG nova.compute.manager [None req-90887c39-aeb6-4a37-9392-9cb696fe54e7 None None] [instance: d15f23ae-f5a4-47cf-b136-7072c7838790] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:39:20 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] COPY block job progress, current cursor: 260046848 final cursor: 1073741824 {{(pid=73056) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 16:39:20 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] COPY block job progress, current cursor: 429916160 final cursor: 1073741824 {{(pid=73056) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 16:39:21 user nova-compute[73056]: DEBUG nova.compute.manager [req-3c0a216a-77d2-4608-8eec-749a7a072b37 req-1ae69b65-0024-4277-a202-679cb41964e6 service nova] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Received event network-vif-plugged-17d6adb4-b6f5-4c34-936d-35d1a4920106 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:21 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3c0a216a-77d2-4608-8eec-749a7a072b37 req-1ae69b65-0024-4277-a202-679cb41964e6 service nova] Acquiring lock "a329b987-231e-47a8-9f2d-71c15573f9f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:21 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3c0a216a-77d2-4608-8eec-749a7a072b37 req-1ae69b65-0024-4277-a202-679cb41964e6 service nova] Lock "a329b987-231e-47a8-9f2d-71c15573f9f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:21 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3c0a216a-77d2-4608-8eec-749a7a072b37 req-1ae69b65-0024-4277-a202-679cb41964e6 service nova] Lock "a329b987-231e-47a8-9f2d-71c15573f9f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:21 user nova-compute[73056]: DEBUG nova.compute.manager [req-3c0a216a-77d2-4608-8eec-749a7a072b37 req-1ae69b65-0024-4277-a202-679cb41964e6 service nova] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] No waiting events found dispatching network-vif-plugged-17d6adb4-b6f5-4c34-936d-35d1a4920106 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:21 user nova-compute[73056]: WARNING nova.compute.manager [req-3c0a216a-77d2-4608-8eec-749a7a072b37 req-1ae69b65-0024-4277-a202-679cb41964e6 service nova] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Received unexpected event network-vif-plugged-17d6adb4-b6f5-4c34-936d-35d1a4920106 for instance with vm_state active and task_state rebuild_spawning.
Aug 14 16:39:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] COPY block job progress, current cursor: 612368384 final cursor: 1073741824 {{(pid=73056) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 16:39:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] COPY block job progress, current cursor: 727711744 final cursor: 1073741824 {{(pid=73056) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 16:39:22 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031162.0940685, a329b987-231e-47a8-9f2d-71c15573f9f0 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:39:22 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] VM Resumed (Lifecycle Event)
Aug 14 16:39:22 user nova-compute[73056]: DEBUG nova.compute.manager [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:39:22 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:39:22 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Instance spawned successfully.
Aug 14 16:39:22 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:39:22 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:39:22 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:39:22 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:39:22 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:39:22 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:39:22 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:39:22 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:39:22 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:39:22 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 14 16:39:22 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031162.0984683, a329b987-231e-47a8-9f2d-71c15573f9f0 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:39:22 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] VM Started (Lifecycle Event)
Aug 14 16:39:22 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:39:22 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:39:22 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 14 16:39:22 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:22 user nova-compute[73056]: DEBUG nova.compute.manager [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:39:22 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:22 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] COPY block job progress, current cursor: 890241024 final cursor: 1073741824 {{(pid=73056) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 16:39:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:22 user nova-compute[73056]: DEBUG nova.objects.instance [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73056) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 14 16:39:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-f9e6173c-75a7-4a7b-ba4d-7961f3c787b5 tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.189s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:22 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] COPY block job progress, current cursor: 1064304640 final cursor: 1073741824 {{(pid=73056) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73056) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BKacklrm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b'}, None), 'kwargs': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:39:23 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:39:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[864fbf34-3fb4-42d0-9271-8e3d3b571316]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ebcd66-620c-4c60-ae91-8c3c56e2dd8c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b (non-flash)
Aug 14 16:39:23 user nova-compute[73056]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)
Aug 14 16:39:23 user nova-compute[73056]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:39:23 user nova-compute[73056]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b (non-flash)
Aug 14 16:39:23 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:39:23 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:39:23 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:39:23 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b (non-flash)
Aug 14 16:39:23 user nova-compute[73056]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)
Aug 14 16:39:23 user nova-compute[73056]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:39:23 user nova-compute[73056]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b (non-flash)
Aug 14 16:39:23 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:39:23 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:39:23 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:39:23 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3007e2950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b'): ({'sdb'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Removing single pathed devices sdb {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6dfa31-9f01-4cda-9d28-5d3b2d985962]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e5798b-9f3d-4e6d-8f0e-ac2aa2f3e80a]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Flushing IO for device /dev/sdb {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e072637-58a1-44e7-a74b-992f94046ea7]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a19aedb-81ca-4350-8201-99b7dd6b7081]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] SCSI volumes sdb have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c968d6a3-d6aa-4dff-b02e-11efc242f4d7]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd50c1a-7831-4dea-a365-a54c1237a4dd]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b, portal: 172.16.0.220,3260]
Aug 14 16:39:23 user nova-compute[73056]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b, portal: 172.16.0.220,3260] successful.
Aug 14 16:39:23 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[14779501-96de-4602-80e9-8c3bfa3efd06]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] <== disconnect_volume: return (319ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG nova.compute.manager [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oRfJwBhO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '9927d1d6-6e26-4408-b509-c96df5f314d6', 'attached_at': '', 'detached_at': '', 'volume_id': '54a15b78-0b03-4e36-b1bb-4772f342893b', 'serial'} {{(pid=73056) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 14 16:39:23 user nova-compute[73056]: DEBUG nova.compute.manager [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] swap_volume: removing Cinder connection for volume 250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b {{(pid=73056) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 14 16:39:24 user nova-compute[73056]: DEBUG nova.compute.manager [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] swap_volume: Updating volume 250a76c5-f43e-4a7b-bb3d-d28a3e01ce8b BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "oRfJwBhO", "auth_password": "KosqtGx4mrVRCp", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "54a15b78-0b03-4e36-b1bb-4772f342893b"}, "status": "reserved", "instance": "9927d1d6-6e26-4408-b509-c96df5f314d6", "attached_at": "", "detached_at": "", "volume_id": "54a15b78-0b03-4e36-b1bb-4772f342893b", "serial": "54a15b78-0b03-4e36-b1bb-4772f342893b"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '54a15b78-0b03-4e36-b1bb-4772f342893b', 'no_device': None, 'attachment_id': '6ab32a24-a735-46df-a5ec-67dec54d0dc6'} {{(pid=73056) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 14 16:39:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-69f55cef-c79a-4ba6-b8bf-c9c2e65e460c tempest-TestVolumeSwap-198403235 tempest-TestVolumeSwap-198403235-project-admin] Lock "9927d1d6-6e26-4408-b509-c96df5f314d6" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 24.431s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bde49731-fb51-48f5-a237-928060dc2bcf tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Acquiring lock "9927d1d6-6e26-4408-b509-c96df5f314d6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bde49731-fb51-48f5-a237-928060dc2bcf tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Lock "9927d1d6-6e26-4408-b509-c96df5f314d6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:25 user nova-compute[73056]: INFO nova.compute.manager [None req-bde49731-fb51-48f5-a237-928060dc2bcf tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Detaching volume 54a15b78-0b03-4e36-b1bb-4772f342893b
Aug 14 16:39:25 user nova-compute[73056]: INFO nova.virt.block_device [None req-bde49731-fb51-48f5-a237-928060dc2bcf tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Attempting to driver detach volume 54a15b78-0b03-4e36-b1bb-4772f342893b from mountpoint /dev/vdb
Aug 14 16:39:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-bde49731-fb51-48f5-a237-928060dc2bcf tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Attempting to detach device vdb from instance 9927d1d6-6e26-4408-b509-c96df5f314d6 from the persistent domain config. {{(pid=73056) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 16:39:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-bde49731-fb51-48f5-a237-928060dc2bcf tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 16:39:25 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:39:25 user nova-compute[73056]:   <source dev="/dev/sde"/>
Aug 14 16:39:25 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:39:25 user nova-compute[73056]:   <serial>54a15b78-0b03-4e36-b1bb-4772f342893b</serial>
Aug 14 16:39:25 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 16:39:25 user nova-compute[73056]: </disk>
Aug 14 16:39:25 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 16:39:25 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-bde49731-fb51-48f5-a237-928060dc2bcf tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Successfully detached device vdb from instance 9927d1d6-6e26-4408-b509-c96df5f314d6 from the persistent domain config.
Aug 14 16:39:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-bde49731-fb51-48f5-a237-928060dc2bcf tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9927d1d6-6e26-4408-b509-c96df5f314d6 from the live domain config. {{(pid=73056) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 16:39:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-bde49731-fb51-48f5-a237-928060dc2bcf tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 16:39:25 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:39:25 user nova-compute[73056]:   <source dev="/dev/sde"/>
Aug 14 16:39:25 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:39:25 user nova-compute[73056]:   <serial>54a15b78-0b03-4e36-b1bb-4772f342893b</serial>
Aug 14 16:39:25 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 16:39:25 user nova-compute[73056]: </disk>
Aug 14 16:39:25 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-16decca9-6e14-4e8e-999b-873e563fcd97 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Acquiring lock "3a013b1e-7fc9-4ad7-a023-95827e2a4228" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-16decca9-6e14-4e8e-999b-873e563fcd97 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Lock "3a013b1e-7fc9-4ad7-a023-95827e2a4228" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-16decca9-6e14-4e8e-999b-873e563fcd97 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Acquiring lock "3a013b1e-7fc9-4ad7-a023-95827e2a4228-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-16decca9-6e14-4e8e-999b-873e563fcd97 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Lock "3a013b1e-7fc9-4ad7-a023-95827e2a4228-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-16decca9-6e14-4e8e-999b-873e563fcd97 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Lock "3a013b1e-7fc9-4ad7-a023-95827e2a4228-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:26 user nova-compute[73056]: INFO nova.compute.manager [None req-16decca9-6e14-4e8e-999b-873e563fcd97 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Terminating instance
Aug 14 16:39:26 user nova-compute[73056]: DEBUG nova.compute.manager [None req-16decca9-6e14-4e8e-999b-873e563fcd97 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Received event <DeviceRemovedEvent: 1692031166.2894943, 9927d1d6-6e26-4408-b509-c96df5f314d6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73056) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-bde49731-fb51-48f5-a237-928060dc2bcf tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9927d1d6-6e26-4408-b509-c96df5f314d6 {{(pid=73056) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 16:39:26 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-bde49731-fb51-48f5-a237-928060dc2bcf tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Successfully detached device vdb from instance 9927d1d6-6e26-4408-b509-c96df5f314d6 from the live domain config.
Aug 14 16:39:26 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bde49731-fb51-48f5-a237-928060dc2bcf tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-bde49731-fb51-48f5-a237-928060dc2bcf tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oRfJwBhO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '54a15b78-0b03-4e36-b1bb-4772f342893b'}, None), 'kwargs': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:39:26 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-bde49731-fb51-48f5-a237-928060dc2bcf tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:39:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-bde49731-fb51-48f5-a237-928060dc2bcf tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-bde49731-fb51-48f5-a237-928060dc2bcf tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-bde49731-fb51-48f5-a237-928060dc2bcf tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68e81c7-3a67-41a5-a595-3543eb9c7e33]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8817030-d33f-47e5-90b5-7db99225a60f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-bde49731-fb51-48f5-a237-928060dc2bcf tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)
Aug 14 16:39:26 user nova-compute[73056]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:39:26 user nova-compute[73056]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b (non-flash)
Aug 14 16:39:26 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:39:26 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:39:26 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:39:26 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-bde49731-fb51-48f5-a237-928060dc2bcf tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)
Aug 14 16:39:26 user nova-compute[73056]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:39:26 user nova-compute[73056]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b (non-flash)
Aug 14 16:39:26 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:39:26 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:39:26 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:39:26 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-bde49731-fb51-48f5-a237-928060dc2bcf tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff2dcec00d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b'): ({'sde'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-bde49731-fb51-48f5-a237-928060dc2bcf tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Removing single pathed devices sde {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.035s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[266c0dc4-3733-4813-a98a-a459f6e2dcad]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[786cc0cd-3854-456f-ab75-17576b6f674c]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-bde49731-fb51-48f5-a237-928060dc2bcf tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Flushing IO for device /dev/sde {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e914f5-9c15-4d16-a1ac-87758ef2d29a]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-bde49731-fb51-48f5-a237-928060dc2bcf tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.069s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3680741-c6a4-49f5-9e7b-f2b53934c4fe]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-bde49731-fb51-48f5-a237-928060dc2bcf tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-bde49731-fb51-48f5-a237-928060dc2bcf tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] SCSI volumes sde have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-bde49731-fb51-48f5-a237-928060dc2bcf tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.042s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48c8ba3-9d83-481a-80d3-1e4723b70007]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-bde49731-fb51-48f5-a237-928060dc2bcf tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG nova.compute.manager [req-36cd6c95-ff2e-40c4-8bc5-779ed373b5b3 req-6a4b3991-44eb-4742-9e46-79aefec2ce28 service nova] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Received event network-vif-unplugged-fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-36cd6c95-ff2e-40c4-8bc5-779ed373b5b3 req-6a4b3991-44eb-4742-9e46-79aefec2ce28 service nova] Acquiring lock "3a013b1e-7fc9-4ad7-a023-95827e2a4228-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-36cd6c95-ff2e-40c4-8bc5-779ed373b5b3 req-6a4b3991-44eb-4742-9e46-79aefec2ce28 service nova] Lock "3a013b1e-7fc9-4ad7-a023-95827e2a4228-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-36cd6c95-ff2e-40c4-8bc5-779ed373b5b3 req-6a4b3991-44eb-4742-9e46-79aefec2ce28 service nova] Lock "3a013b1e-7fc9-4ad7-a023-95827e2a4228-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG nova.compute.manager [req-36cd6c95-ff2e-40c4-8bc5-779ed373b5b3 req-6a4b3991-44eb-4742-9e46-79aefec2ce28 service nova] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] No waiting events found dispatching network-vif-unplugged-fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG nova.compute.manager [req-36cd6c95-ff2e-40c4-8bc5-779ed373b5b3 req-6a4b3991-44eb-4742-9e46-79aefec2ce28 service nova] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Received event network-vif-unplugged-fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed19e15-390a-43b5-9a76-5236c2c06711]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-bde49731-fb51-48f5-a237-928060dc2bcf tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b, portal: 172.16.0.220,3260]
Aug 14 16:39:26 user nova-compute[73056]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b, portal: 172.16.0.220,3260] successful.
Aug 14 16:39:26 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a15b78-0b03-4e36-b1bb-4772f342893b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0311636-d0c6-4dc1-bf7f-dd4333f7f6e5]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-bde49731-fb51-48f5-a237-928060dc2bcf tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-bde49731-fb51-48f5-a237-928060dc2bcf tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.431s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-bde49731-fb51-48f5-a237-928060dc2bcf tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] <== disconnect_volume: return (432ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bde49731-fb51-48f5-a237-928060dc2bcf tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Acquiring lock "2c9cee38-2588-49e4-bda6-31661f7a9cd5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "2c9cee38-2588-49e4-bda6-31661f7a9cd5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG nova.compute.manager [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:39:26 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Instance destroyed successfully.
Aug 14 16:39:26 user nova-compute[73056]: DEBUG nova.objects.instance [None req-16decca9-6e14-4e8e-999b-873e563fcd97 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Lazy-loading 'resources' on Instance uuid 3a013b1e-7fc9-4ad7-a023-95827e2a4228 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-16decca9-6e14-4e8e-999b-873e563fcd97 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:36:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1710600714',display_name='tempest-VolumesAssistedSnapshotsTest-server-1710600714',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1710600714',id=5,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZcSqhzk1kqSRnaZZuziYCuXITAT6BbhK/ghNk/p+jMRpb4ejOBmpC8OJemJskt86tCSHqFNuUP5K4Xuo8gj0/I3zS+QgKFK2mjTT+kCdYm8Je2sqQ+amF5kvBmxouufQ==',key_name='tempest-keypair-68602083',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:36:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ea76956556248748abedf58955cf248',ramdisk_id='',reservation_id='r-94hhfcd7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-354409156',owner_user_name='tempest-VolumesAssistedSnapshotsTest-354409156-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:36:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ab6fc2872964eb2b0059a09c0959db2',uuid=3a013b1e-7fc9-4ad7-a023-95827e2a4228,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd", "address": "fa:16:3e:88:c3:7f", "network": {"id": "4d2c0fab-5e0a-40dd-a124-3ceb55f395bf", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1914390784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ea76956556248748abedf58955cf248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe86f39-73", "ovs_interfaceid": "fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-16decca9-6e14-4e8e-999b-873e563fcd97 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Converting VIF {"id": "fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd", "address": "fa:16:3e:88:c3:7f", "network": {"id": "4d2c0fab-5e0a-40dd-a124-3ceb55f395bf", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1914390784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ea76956556248748abedf58955cf248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe86f39-73", "ovs_interfaceid": "fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-16decca9-6e14-4e8e-999b-873e563fcd97 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:c3:7f,bridge_name='br-int',has_traffic_filtering=True,id=fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd,network=Network(4d2c0fab-5e0a-40dd-a124-3ceb55f395bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbe86f39-73') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG os_vif [None req-16decca9-6e14-4e8e-999b-873e563fcd97 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:c3:7f,bridge_name='br-int',has_traffic_filtering=True,id=fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd,network=Network(4d2c0fab-5e0a-40dd-a124-3ceb55f395bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbe86f39-73') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfbe86f39-73, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:26 user nova-compute[73056]: INFO os_vif [None req-16decca9-6e14-4e8e-999b-873e563fcd97 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:c3:7f,bridge_name='br-int',has_traffic_filtering=True,id=fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd,network=Network(4d2c0fab-5e0a-40dd-a124-3ceb55f395bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbe86f39-73')
Aug 14 16:39:26 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-16decca9-6e14-4e8e-999b-873e563fcd97 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Deleting instance files /opt/stack/data/nova/instances/3a013b1e-7fc9-4ad7-a023-95827e2a4228_del
Aug 14 16:39:26 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-16decca9-6e14-4e8e-999b-873e563fcd97 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Deletion of /opt/stack/data/nova/instances/3a013b1e-7fc9-4ad7-a023-95827e2a4228_del complete
Aug 14 16:39:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:26 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:39:26 user nova-compute[73056]: INFO nova.compute.claims [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Claim successful on node user
Aug 14 16:39:27 user nova-compute[73056]: INFO nova.compute.manager [None req-16decca9-6e14-4e8e-999b-873e563fcd97 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 14 16:39:27 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-16decca9-6e14-4e8e-999b-873e563fcd97 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 16:39:27 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 16:39:27 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 16:39:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:27 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:39:27 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:39:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.548s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:27 user nova-compute[73056]: DEBUG nova.compute.manager [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:39:27 user nova-compute[73056]: DEBUG nova.compute.manager [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:39:27 user nova-compute[73056]: DEBUG nova.network.neutron [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:39:27 user nova-compute[73056]: DEBUG nova.objects.instance [None req-bde49731-fb51-48f5-a237-928060dc2bcf tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Lazy-loading 'flavor' on Instance uuid 9927d1d6-6e26-4408-b509-c96df5f314d6 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:39:27 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:39:27 user nova-compute[73056]: DEBUG nova.compute.manager [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:39:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bde49731-fb51-48f5-a237-928060dc2bcf tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Lock "9927d1d6-6e26-4408-b509-c96df5f314d6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.077s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:27 user nova-compute[73056]: DEBUG nova.policy [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b76fb5a2ba84410584b31e9006c67f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf992869a24ad2b1d391e2baff2b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:39:27 user nova-compute[73056]: DEBUG nova.compute.manager [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:39:27 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:39:27 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Creating image(s)
Aug 14 16:39:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Acquiring lock "/opt/stack/data/nova/instances/2c9cee38-2588-49e4-bda6-31661f7a9cd5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "/opt/stack/data/nova/instances/2c9cee38-2588-49e4-bda6-31661f7a9cd5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "/opt/stack/data/nova/instances/2c9cee38-2588-49e4-bda6-31661f7a9cd5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:27 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.234s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Acquiring lock "c889592ab94cd0b0ce896f27a2af0323771db234" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.215s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/2c9cee38-2588-49e4-bda6-31661f7a9cd5/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/2c9cee38-2588-49e4-bda6-31661f7a9cd5/disk 1073741824" returned: 0 in 0.073s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.196s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:28 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2c9cee38-2588-49e4-bda6-31661f7a9cd5/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 16:39:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9cee38-2588-49e4-bda6-31661f7a9cd5/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:28 user nova-compute[73056]: DEBUG nova.network.neutron [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Successfully created port: 163edb7f-e2e2-4885-89c6-873c7d7c9c1d {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:39:28 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:39:28 user nova-compute[73056]: DEBUG nova.compute.manager [req-7d43af04-d25e-4c54-acc3-1acb9766bd36 req-269c808e-3cf7-4f9d-b676-a5a2824b5b70 service nova] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Received event network-vif-deleted-fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:28 user nova-compute[73056]: INFO nova.compute.manager [req-7d43af04-d25e-4c54-acc3-1acb9766bd36 req-269c808e-3cf7-4f9d-b676-a5a2824b5b70 service nova] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Neutron deleted interface fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd; detaching it from the instance and deleting it from the info cache
Aug 14 16:39:28 user nova-compute[73056]: DEBUG nova.network.neutron [req-7d43af04-d25e-4c54-acc3-1acb9766bd36 req-269c808e-3cf7-4f9d-b676-a5a2824b5b70 service nova] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:39:28 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Took 1.61 seconds to deallocate network for instance.
Aug 14 16:39:28 user nova-compute[73056]: DEBUG nova.compute.manager [req-7d43af04-d25e-4c54-acc3-1acb9766bd36 req-269c808e-3cf7-4f9d-b676-a5a2824b5b70 service nova] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Detach interface failed, port_id=fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd, reason: Instance 3a013b1e-7fc9-4ad7-a023-95827e2a4228 could not be found. {{(pid=73056) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 16:39:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-16decca9-6e14-4e8e-999b-873e563fcd97 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-16decca9-6e14-4e8e-999b-873e563fcd97 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9cee38-2588-49e4-bda6-31661f7a9cd5/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:28 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Cannot resize image /opt/stack/data/nova/instances/2c9cee38-2588-49e4-bda6-31661f7a9cd5/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 16:39:28 user nova-compute[73056]: DEBUG nova.objects.instance [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lazy-loading 'migration_context' on Instance uuid 2c9cee38-2588-49e4-bda6-31661f7a9cd5 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:39:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 16:39:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Ensure instance console log exists: /opt/stack/data/nova/instances/2c9cee38-2588-49e4-bda6-31661f7a9cd5/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:39:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:28 user nova-compute[73056]: DEBUG nova.compute.manager [req-f8b56ce2-0961-4b07-b257-e001bba35c62 req-80c6e253-02ed-4648-a6ca-a8194f07d276 service nova] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Received event network-vif-plugged-fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f8b56ce2-0961-4b07-b257-e001bba35c62 req-80c6e253-02ed-4648-a6ca-a8194f07d276 service nova] Acquiring lock "3a013b1e-7fc9-4ad7-a023-95827e2a4228-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f8b56ce2-0961-4b07-b257-e001bba35c62 req-80c6e253-02ed-4648-a6ca-a8194f07d276 service nova] Lock "3a013b1e-7fc9-4ad7-a023-95827e2a4228-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f8b56ce2-0961-4b07-b257-e001bba35c62 req-80c6e253-02ed-4648-a6ca-a8194f07d276 service nova] Lock "3a013b1e-7fc9-4ad7-a023-95827e2a4228-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:28 user nova-compute[73056]: DEBUG nova.compute.manager [req-f8b56ce2-0961-4b07-b257-e001bba35c62 req-80c6e253-02ed-4648-a6ca-a8194f07d276 service nova] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] No waiting events found dispatching network-vif-plugged-fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:28 user nova-compute[73056]: WARNING nova.compute.manager [req-f8b56ce2-0961-4b07-b257-e001bba35c62 req-80c6e253-02ed-4648-a6ca-a8194f07d276 service nova] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Received unexpected event network-vif-plugged-fbe86f39-73a7-40c8-bc6c-ed4b9269ccdd for instance with vm_state deleted and task_state None.
Aug 14 16:39:29 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-16decca9-6e14-4e8e-999b-873e563fcd97 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:39:29 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-16decca9-6e14-4e8e-999b-873e563fcd97 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:39:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-16decca9-6e14-4e8e-999b-873e563fcd97 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.445s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:29 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-16decca9-6e14-4e8e-999b-873e563fcd97 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Deleted allocations for instance 3a013b1e-7fc9-4ad7-a023-95827e2a4228
Aug 14 16:39:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-16decca9-6e14-4e8e-999b-873e563fcd97 tempest-VolumesAssistedSnapshotsTest-354409156 tempest-VolumesAssistedSnapshotsTest-354409156-project-member] Lock "3a013b1e-7fc9-4ad7-a023-95827e2a4228" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.339s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0462c352-0540-4555-9348-087fe0a4d80d tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Acquiring lock "03f3d2be-ec24-413c-b44e-873b82268212" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0462c352-0540-4555-9348-087fe0a4d80d tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Lock "03f3d2be-ec24-413c-b44e-873b82268212" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0462c352-0540-4555-9348-087fe0a4d80d tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Acquiring lock "03f3d2be-ec24-413c-b44e-873b82268212-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0462c352-0540-4555-9348-087fe0a4d80d tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Lock "03f3d2be-ec24-413c-b44e-873b82268212-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0462c352-0540-4555-9348-087fe0a4d80d tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Lock "03f3d2be-ec24-413c-b44e-873b82268212-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:29 user nova-compute[73056]: INFO nova.compute.manager [None req-0462c352-0540-4555-9348-087fe0a4d80d tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Terminating instance
Aug 14 16:39:29 user nova-compute[73056]: DEBUG nova.compute.manager [None req-0462c352-0540-4555-9348-087fe0a4d80d tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 16:39:29 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:29 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:29 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:29 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:29 user nova-compute[73056]: DEBUG nova.network.neutron [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Successfully updated port: 163edb7f-e2e2-4885-89c6-873c7d7c9c1d {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:39:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Acquiring lock "refresh_cache-2c9cee38-2588-49e4-bda6-31661f7a9cd5" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:39:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Acquired lock "refresh_cache-2c9cee38-2588-49e4-bda6-31661f7a9cd5" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:39:29 user nova-compute[73056]: DEBUG nova.network.neutron [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:39:29 user nova-compute[73056]: DEBUG nova.compute.manager [req-bedaa4dd-5c63-46ce-8c82-b7254d4c5b38 req-9a613b3a-a36a-45bc-af47-8db6394aa747 service nova] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Received event network-changed-163edb7f-e2e2-4885-89c6-873c7d7c9c1d {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:29 user nova-compute[73056]: DEBUG nova.compute.manager [req-bedaa4dd-5c63-46ce-8c82-b7254d4c5b38 req-9a613b3a-a36a-45bc-af47-8db6394aa747 service nova] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Refreshing instance network info cache due to event network-changed-163edb7f-e2e2-4885-89c6-873c7d7c9c1d. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:39:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-bedaa4dd-5c63-46ce-8c82-b7254d4c5b38 req-9a613b3a-a36a-45bc-af47-8db6394aa747 service nova] Acquiring lock "refresh_cache-2c9cee38-2588-49e4-bda6-31661f7a9cd5" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:39:29 user nova-compute[73056]: DEBUG nova.network.neutron [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:30 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Instance destroyed successfully.
Aug 14 16:39:30 user nova-compute[73056]: DEBUG nova.objects.instance [None req-0462c352-0540-4555-9348-087fe0a4d80d tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Lazy-loading 'resources' on Instance uuid 03f3d2be-ec24-413c-b44e-873b82268212 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-0462c352-0540-4555-9348-087fe0a4d80d tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:37:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1391910034',display_name='tempest-VolumesActionsTest-instance-1391910034',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1391910034',id=11,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:37:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7613ed7cdbf24a8285c1ede9b24ea476',ramdisk_id='',reservation_id='r-xacrqef4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2061382771',owner_user_name='tempest-VolumesActionsTest-2061382771-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:37:25Z,user_data=None,user_id='636c066370684bc6ba775713606d9df7',uuid=03f3d2be-ec24-413c-b44e-873b82268212,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4cb3320-fcd8-47a3-b3c5-f14754282ce9", "address": "fa:16:3e:94:6a:16", "network": {"id": "1f2ac013-0ba6-4f28-add5-919268c1b275", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1342198244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7613ed7cdbf24a8285c1ede9b24ea476", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4cb3320-fc", "ovs_interfaceid": "d4cb3320-fcd8-47a3-b3c5-f14754282ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-0462c352-0540-4555-9348-087fe0a4d80d tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Converting VIF {"id": "d4cb3320-fcd8-47a3-b3c5-f14754282ce9", "address": "fa:16:3e:94:6a:16", "network": {"id": "1f2ac013-0ba6-4f28-add5-919268c1b275", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1342198244-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7613ed7cdbf24a8285c1ede9b24ea476", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4cb3320-fc", "ovs_interfaceid": "d4cb3320-fcd8-47a3-b3c5-f14754282ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-0462c352-0540-4555-9348-087fe0a4d80d tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:6a:16,bridge_name='br-int',has_traffic_filtering=True,id=d4cb3320-fcd8-47a3-b3c5-f14754282ce9,network=Network(1f2ac013-0ba6-4f28-add5-919268c1b275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4cb3320-fc') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG os_vif [None req-0462c352-0540-4555-9348-087fe0a4d80d tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:6a:16,bridge_name='br-int',has_traffic_filtering=True,id=d4cb3320-fcd8-47a3-b3c5-f14754282ce9,network=Network(1f2ac013-0ba6-4f28-add5-919268c1b275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4cb3320-fc') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4cb3320-fc, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:30 user nova-compute[73056]: INFO os_vif [None req-0462c352-0540-4555-9348-087fe0a4d80d tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:6a:16,bridge_name='br-int',has_traffic_filtering=True,id=d4cb3320-fcd8-47a3-b3c5-f14754282ce9,network=Network(1f2ac013-0ba6-4f28-add5-919268c1b275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4cb3320-fc')
Aug 14 16:39:30 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-0462c352-0540-4555-9348-087fe0a4d80d tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Deleting instance files /opt/stack/data/nova/instances/03f3d2be-ec24-413c-b44e-873b82268212_del
Aug 14 16:39:30 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-0462c352-0540-4555-9348-087fe0a4d80d tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Deletion of /opt/stack/data/nova/instances/03f3d2be-ec24-413c-b44e-873b82268212_del complete
Aug 14 16:39:30 user nova-compute[73056]: INFO nova.compute.manager [None req-0462c352-0540-4555-9348-087fe0a4d80d tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 14 16:39:30 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-0462c352-0540-4555-9348-087fe0a4d80d tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG nova.network.neutron [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Updating instance_info_cache with network_info: [{"id": "163edb7f-e2e2-4885-89c6-873c7d7c9c1d", "address": "fa:16:3e:ec:14:76", "network": {"id": "2b53e507-f50b-411d-bce8-8769fc50bc28", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-515017098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4bf992869a24ad2b1d391e2baff2b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap163edb7f-e2", "ovs_interfaceid": "163edb7f-e2e2-4885-89c6-873c7d7c9c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Releasing lock "refresh_cache-2c9cee38-2588-49e4-bda6-31661f7a9cd5" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG nova.compute.manager [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Instance network_info: |[{"id": "163edb7f-e2e2-4885-89c6-873c7d7c9c1d", "address": "fa:16:3e:ec:14:76", "network": {"id": "2b53e507-f50b-411d-bce8-8769fc50bc28", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-515017098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4bf992869a24ad2b1d391e2baff2b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap163edb7f-e2", "ovs_interfaceid": "163edb7f-e2e2-4885-89c6-873c7d7c9c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-bedaa4dd-5c63-46ce-8c82-b7254d4c5b38 req-9a613b3a-a36a-45bc-af47-8db6394aa747 service nova] Acquired lock "refresh_cache-2c9cee38-2588-49e4-bda6-31661f7a9cd5" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG nova.network.neutron [req-bedaa4dd-5c63-46ce-8c82-b7254d4c5b38 req-9a613b3a-a36a-45bc-af47-8db6394aa747 service nova] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Refreshing network info cache for port 163edb7f-e2e2-4885-89c6-873c7d7c9c1d {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Start _get_guest_xml network_info=[{"id": "163edb7f-e2e2-4885-89c6-873c7d7c9c1d", "address": "fa:16:3e:ec:14:76", "network": {"id": "2b53e507-f50b-411d-bce8-8769fc50bc28", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-515017098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4bf992869a24ad2b1d391e2baff2b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap163edb7f-e2", "ovs_interfaceid": "163edb7f-e2e2-4885-89c6-873c7d7c9c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:39:30 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:39:30 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:39:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:39:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-250238643',display_name='tempest-VolumesAdminNegativeTest-server-250238643',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-250238643',id=13,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4bf992869a24ad2b1d391e2baff2b34',ramdisk_id='',reservation_id='r-u1w6s8zt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1902234353',owner_user_name='tempest-VolumesAdminNegativeTest-1902234353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:39:28Z,user_data=None,user_id='b76fb5a2ba84410584b31e9006c67f37',uuid=2c9cee38-2588-49e4-bda6-31661f7a9cd5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "163edb7f-e2e2-4885-89c6-873c7d7c9c1d", "address": "fa:16:3e:ec:14:76", "network": {"id": "2b53e507-f50b-411d-bce8-8769fc50bc28", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-515017098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4bf992869a24ad2b1d391e2baff2b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap163edb7f-e2", "ovs_interfaceid": "163edb7f-e2e2-4885-89c6-873c7d7c9c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Converting VIF {"id": "163edb7f-e2e2-4885-89c6-873c7d7c9c1d", "address": "fa:16:3e:ec:14:76", "network": {"id": "2b53e507-f50b-411d-bce8-8769fc50bc28", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-515017098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4bf992869a24ad2b1d391e2baff2b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap163edb7f-e2", "ovs_interfaceid": "163edb7f-e2e2-4885-89c6-873c7d7c9c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:14:76,bridge_name='br-int',has_traffic_filtering=True,id=163edb7f-e2e2-4885-89c6-873c7d7c9c1d,network=Network(2b53e507-f50b-411d-bce8-8769fc50bc28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap163edb7f-e2') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG nova.objects.instance [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c9cee38-2588-49e4-bda6-31661f7a9cd5 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:39:30 user nova-compute[73056]:   <uuid>2c9cee38-2588-49e4-bda6-31661f7a9cd5</uuid>
Aug 14 16:39:30 user nova-compute[73056]:   <name>instance-0000000d</name>
Aug 14 16:39:30 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:39:30 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:39:30 user nova-compute[73056]:   <metadata>
Aug 14 16:39:30 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:39:30 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:39:30 user nova-compute[73056]:       <nova:name>tempest-VolumesAdminNegativeTest-server-250238643</nova:name>
Aug 14 16:39:30 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:39:30</nova:creationTime>
Aug 14 16:39:30 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:39:30 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:39:30 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:39:30 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:39:30 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:39:30 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:39:30 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:39:30 user nova-compute[73056]:       <nova:owner>
Aug 14 16:39:30 user nova-compute[73056]:         <nova:user uuid="b76fb5a2ba84410584b31e9006c67f37">tempest-VolumesAdminNegativeTest-1902234353-project-member</nova:user>
Aug 14 16:39:30 user nova-compute[73056]:         <nova:project uuid="a4bf992869a24ad2b1d391e2baff2b34">tempest-VolumesAdminNegativeTest-1902234353</nova:project>
Aug 14 16:39:30 user nova-compute[73056]:       </nova:owner>
Aug 14 16:39:30 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:39:30 user nova-compute[73056]:       <nova:ports>
Aug 14 16:39:30 user nova-compute[73056]:         <nova:port uuid="163edb7f-e2e2-4885-89c6-873c7d7c9c1d">
Aug 14 16:39:30 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 16:39:30 user nova-compute[73056]:         </nova:port>
Aug 14 16:39:30 user nova-compute[73056]:       </nova:ports>
Aug 14 16:39:30 user nova-compute[73056]:     </nova:instance>
Aug 14 16:39:30 user nova-compute[73056]:   </metadata>
Aug 14 16:39:30 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:39:30 user nova-compute[73056]:     <system>
Aug 14 16:39:30 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:39:30 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:39:30 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:39:30 user nova-compute[73056]:       <entry name="serial">2c9cee38-2588-49e4-bda6-31661f7a9cd5</entry>
Aug 14 16:39:30 user nova-compute[73056]:       <entry name="uuid">2c9cee38-2588-49e4-bda6-31661f7a9cd5</entry>
Aug 14 16:39:30 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:39:30 user nova-compute[73056]:     </system>
Aug 14 16:39:30 user nova-compute[73056]:   </sysinfo>
Aug 14 16:39:30 user nova-compute[73056]:   <os>
Aug 14 16:39:30 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:39:30 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:39:30 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:39:30 user nova-compute[73056]:   </os>
Aug 14 16:39:30 user nova-compute[73056]:   <features>
Aug 14 16:39:30 user nova-compute[73056]:     <acpi/>
Aug 14 16:39:30 user nova-compute[73056]:     <apic/>
Aug 14 16:39:30 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:39:30 user nova-compute[73056]:   </features>
Aug 14 16:39:30 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:39:30 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:39:30 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:39:30 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:39:30 user nova-compute[73056]:   </clock>
Aug 14 16:39:30 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:39:30 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:39:30 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:39:30 user nova-compute[73056]:   </cpu>
Aug 14 16:39:30 user nova-compute[73056]:   <devices>
Aug 14 16:39:30 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:39:30 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:39:30 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/2c9cee38-2588-49e4-bda6-31661f7a9cd5/disk"/>
Aug 14 16:39:30 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:39:30 user nova-compute[73056]:     </disk>
Aug 14 16:39:30 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:39:30 user nova-compute[73056]:       <mac address="fa:16:3e:ec:14:76"/>
Aug 14 16:39:30 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:39:30 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:39:30 user nova-compute[73056]:       <target dev="tap163edb7f-e2"/>
Aug 14 16:39:30 user nova-compute[73056]:     </interface>
Aug 14 16:39:30 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:39:30 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/2c9cee38-2588-49e4-bda6-31661f7a9cd5/console.log" append="off"/>
Aug 14 16:39:30 user nova-compute[73056]:     </serial>
Aug 14 16:39:30 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:39:30 user nova-compute[73056]:     <video>
Aug 14 16:39:30 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:39:30 user nova-compute[73056]:     </video>
Aug 14 16:39:30 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:39:30 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:39:30 user nova-compute[73056]:     </rng>
Aug 14 16:39:30 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:39:30 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:39:30 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:39:30 user nova-compute[73056]:     </memballoon>
Aug 14 16:39:30 user nova-compute[73056]:   </devices>
Aug 14 16:39:30 user nova-compute[73056]: </domain>
Aug 14 16:39:30 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:39:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-250238643',display_name='tempest-VolumesAdminNegativeTest-server-250238643',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-250238643',id=13,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4bf992869a24ad2b1d391e2baff2b34',ramdisk_id='',reservation_id='r-u1w6s8zt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1902234353',owner_user_name='tempest-VolumesAdminNegativeTest-1902234353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:39:28Z,user_data=None,user_id='b76fb5a2ba84410584b31e9006c67f37',uuid=2c9cee38-2588-49e4-bda6-31661f7a9cd5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "163edb7f-e2e2-4885-89c6-873c7d7c9c1d", "address": "fa:16:3e:ec:14:76", "network": {"id": "2b53e507-f50b-411d-bce8-8769fc50bc28", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-515017098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4bf992869a24ad2b1d391e2baff2b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap163edb7f-e2", "ovs_interfaceid": "163edb7f-e2e2-4885-89c6-873c7d7c9c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Converting VIF {"id": "163edb7f-e2e2-4885-89c6-873c7d7c9c1d", "address": "fa:16:3e:ec:14:76", "network": {"id": "2b53e507-f50b-411d-bce8-8769fc50bc28", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-515017098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4bf992869a24ad2b1d391e2baff2b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap163edb7f-e2", "ovs_interfaceid": "163edb7f-e2e2-4885-89c6-873c7d7c9c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:14:76,bridge_name='br-int',has_traffic_filtering=True,id=163edb7f-e2e2-4885-89c6-873c7d7c9c1d,network=Network(2b53e507-f50b-411d-bce8-8769fc50bc28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap163edb7f-e2') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG os_vif [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:14:76,bridge_name='br-int',has_traffic_filtering=True,id=163edb7f-e2e2-4885-89c6-873c7d7c9c1d,network=Network(2b53e507-f50b-411d-bce8-8769fc50bc28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap163edb7f-e2') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap163edb7f-e2, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap163edb7f-e2, col_values=(('external_ids', {'iface-id': '163edb7f-e2e2-4885-89c6-873c7d7c9c1d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:14:76', 'vm-uuid': '2c9cee38-2588-49e4-bda6-31661f7a9cd5'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:30 user nova-compute[73056]: INFO os_vif [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:14:76,bridge_name='br-int',has_traffic_filtering=True,id=163edb7f-e2e2-4885-89c6-873c7d7c9c1d,network=Network(2b53e507-f50b-411d-bce8-8769fc50bc28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap163edb7f-e2')
Aug 14 16:39:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:39:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] No VIF found with MAC fa:16:3e:ec:14:76, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:39:31 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:39:31 user nova-compute[73056]: DEBUG nova.compute.manager [req-f0e1fa06-b5d3-47bc-99ec-3578a193202b req-f5cb938c-0541-43eb-917e-7b28e43bc246 service nova] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Received event network-vif-deleted-d4cb3320-fcd8-47a3-b3c5-f14754282ce9 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:31 user nova-compute[73056]: INFO nova.compute.manager [req-f0e1fa06-b5d3-47bc-99ec-3578a193202b req-f5cb938c-0541-43eb-917e-7b28e43bc246 service nova] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Neutron deleted interface d4cb3320-fcd8-47a3-b3c5-f14754282ce9; detaching it from the instance and deleting it from the info cache
Aug 14 16:39:31 user nova-compute[73056]: DEBUG nova.network.neutron [req-f0e1fa06-b5d3-47bc-99ec-3578a193202b req-f5cb938c-0541-43eb-917e-7b28e43bc246 service nova] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:39:31 user nova-compute[73056]: DEBUG nova.compute.manager [req-8a2966a5-8e88-4353-bd5b-1cabd5d7d4d0 req-e29a6e70-b066-41be-b238-1d7f10cac09d service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Received event network-changed-1f7ab99b-ea66-43bf-91e2-da6938d28d2f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:31 user nova-compute[73056]: DEBUG nova.compute.manager [req-8a2966a5-8e88-4353-bd5b-1cabd5d7d4d0 req-e29a6e70-b066-41be-b238-1d7f10cac09d service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Refreshing instance network info cache due to event network-changed-1f7ab99b-ea66-43bf-91e2-da6938d28d2f. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:39:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8a2966a5-8e88-4353-bd5b-1cabd5d7d4d0 req-e29a6e70-b066-41be-b238-1d7f10cac09d service nova] Acquiring lock "refresh_cache-9bb2cf77-cd65-49fd-a85b-d7961c2db3bf" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:39:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8a2966a5-8e88-4353-bd5b-1cabd5d7d4d0 req-e29a6e70-b066-41be-b238-1d7f10cac09d service nova] Acquired lock "refresh_cache-9bb2cf77-cd65-49fd-a85b-d7961c2db3bf" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:39:31 user nova-compute[73056]: DEBUG nova.network.neutron [req-8a2966a5-8e88-4353-bd5b-1cabd5d7d4d0 req-e29a6e70-b066-41be-b238-1d7f10cac09d service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Refreshing network info cache for port 1f7ab99b-ea66-43bf-91e2-da6938d28d2f {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:39:31 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Took 0.73 seconds to deallocate network for instance.
Aug 14 16:39:31 user nova-compute[73056]: DEBUG nova.compute.manager [req-f0e1fa06-b5d3-47bc-99ec-3578a193202b req-f5cb938c-0541-43eb-917e-7b28e43bc246 service nova] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Detach interface failed, port_id=d4cb3320-fcd8-47a3-b3c5-f14754282ce9, reason: Instance 03f3d2be-ec24-413c-b44e-873b82268212 could not be found. {{(pid=73056) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 16:39:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0462c352-0540-4555-9348-087fe0a4d80d tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0462c352-0540-4555-9348-087fe0a4d80d tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:31 user nova-compute[73056]: DEBUG nova.compute.manager [req-8ce65a1e-b2d6-422d-b228-6eecf29ab58d req-df622366-9a09-4c8d-a537-bb1e80865b39 service nova] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Received event network-vif-unplugged-d4cb3320-fcd8-47a3-b3c5-f14754282ce9 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8ce65a1e-b2d6-422d-b228-6eecf29ab58d req-df622366-9a09-4c8d-a537-bb1e80865b39 service nova] Acquiring lock "03f3d2be-ec24-413c-b44e-873b82268212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8ce65a1e-b2d6-422d-b228-6eecf29ab58d req-df622366-9a09-4c8d-a537-bb1e80865b39 service nova] Lock "03f3d2be-ec24-413c-b44e-873b82268212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8ce65a1e-b2d6-422d-b228-6eecf29ab58d req-df622366-9a09-4c8d-a537-bb1e80865b39 service nova] Lock "03f3d2be-ec24-413c-b44e-873b82268212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:31 user nova-compute[73056]: DEBUG nova.compute.manager [req-8ce65a1e-b2d6-422d-b228-6eecf29ab58d req-df622366-9a09-4c8d-a537-bb1e80865b39 service nova] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] No waiting events found dispatching network-vif-unplugged-d4cb3320-fcd8-47a3-b3c5-f14754282ce9 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:31 user nova-compute[73056]: WARNING nova.compute.manager [req-8ce65a1e-b2d6-422d-b228-6eecf29ab58d req-df622366-9a09-4c8d-a537-bb1e80865b39 service nova] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Received unexpected event network-vif-unplugged-d4cb3320-fcd8-47a3-b3c5-f14754282ce9 for instance with vm_state deleted and task_state None.
Aug 14 16:39:31 user nova-compute[73056]: DEBUG nova.compute.manager [req-8ce65a1e-b2d6-422d-b228-6eecf29ab58d req-df622366-9a09-4c8d-a537-bb1e80865b39 service nova] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Received event network-vif-plugged-d4cb3320-fcd8-47a3-b3c5-f14754282ce9 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8ce65a1e-b2d6-422d-b228-6eecf29ab58d req-df622366-9a09-4c8d-a537-bb1e80865b39 service nova] Acquiring lock "03f3d2be-ec24-413c-b44e-873b82268212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8ce65a1e-b2d6-422d-b228-6eecf29ab58d req-df622366-9a09-4c8d-a537-bb1e80865b39 service nova] Lock "03f3d2be-ec24-413c-b44e-873b82268212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8ce65a1e-b2d6-422d-b228-6eecf29ab58d req-df622366-9a09-4c8d-a537-bb1e80865b39 service nova] Lock "03f3d2be-ec24-413c-b44e-873b82268212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:31 user nova-compute[73056]: DEBUG nova.compute.manager [req-8ce65a1e-b2d6-422d-b228-6eecf29ab58d req-df622366-9a09-4c8d-a537-bb1e80865b39 service nova] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] No waiting events found dispatching network-vif-plugged-d4cb3320-fcd8-47a3-b3c5-f14754282ce9 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:31 user nova-compute[73056]: WARNING nova.compute.manager [req-8ce65a1e-b2d6-422d-b228-6eecf29ab58d req-df622366-9a09-4c8d-a537-bb1e80865b39 service nova] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Received unexpected event network-vif-plugged-d4cb3320-fcd8-47a3-b3c5-f14754282ce9 for instance with vm_state deleted and task_state None.
Aug 14 16:39:31 user nova-compute[73056]: DEBUG nova.network.neutron [req-bedaa4dd-5c63-46ce-8c82-b7254d4c5b38 req-9a613b3a-a36a-45bc-af47-8db6394aa747 service nova] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Updated VIF entry in instance network info cache for port 163edb7f-e2e2-4885-89c6-873c7d7c9c1d. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:39:31 user nova-compute[73056]: DEBUG nova.network.neutron [req-bedaa4dd-5c63-46ce-8c82-b7254d4c5b38 req-9a613b3a-a36a-45bc-af47-8db6394aa747 service nova] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Updating instance_info_cache with network_info: [{"id": "163edb7f-e2e2-4885-89c6-873c7d7c9c1d", "address": "fa:16:3e:ec:14:76", "network": {"id": "2b53e507-f50b-411d-bce8-8769fc50bc28", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-515017098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4bf992869a24ad2b1d391e2baff2b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap163edb7f-e2", "ovs_interfaceid": "163edb7f-e2e2-4885-89c6-873c7d7c9c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:39:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-bedaa4dd-5c63-46ce-8c82-b7254d4c5b38 req-9a613b3a-a36a-45bc-af47-8db6394aa747 service nova] Releasing lock "refresh_cache-2c9cee38-2588-49e4-bda6-31661f7a9cd5" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:39:32 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-0462c352-0540-4555-9348-087fe0a4d80d tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:39:32 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-0462c352-0540-4555-9348-087fe0a4d80d tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:39:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0462c352-0540-4555-9348-087fe0a4d80d tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.457s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:32 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-0462c352-0540-4555-9348-087fe0a4d80d tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Deleted allocations for instance 03f3d2be-ec24-413c-b44e-873b82268212
Aug 14 16:39:32 user nova-compute[73056]: DEBUG nova.network.neutron [req-8a2966a5-8e88-4353-bd5b-1cabd5d7d4d0 req-e29a6e70-b066-41be-b238-1d7f10cac09d service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Updated VIF entry in instance network info cache for port 1f7ab99b-ea66-43bf-91e2-da6938d28d2f. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:39:32 user nova-compute[73056]: DEBUG nova.network.neutron [req-8a2966a5-8e88-4353-bd5b-1cabd5d7d4d0 req-e29a6e70-b066-41be-b238-1d7f10cac09d service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Updating instance_info_cache with network_info: [{"id": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "address": "fa:16:3e:8d:d8:88", "network": {"id": "dd844e8d-9264-4868-819d-0b01ad3b1d41", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-568480417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e6131531ab4553b55ea090d5e7f47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7ab99b-ea", "ovs_interfaceid": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:39:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0462c352-0540-4555-9348-087fe0a4d80d tempest-VolumesActionsTest-2061382771 tempest-VolumesActionsTest-2061382771-project-member] Lock "03f3d2be-ec24-413c-b44e-873b82268212" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.903s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8a2966a5-8e88-4353-bd5b-1cabd5d7d4d0 req-e29a6e70-b066-41be-b238-1d7f10cac09d service nova] Releasing lock "refresh_cache-9bb2cf77-cd65-49fd-a85b-d7961c2db3bf" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:39:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:33 user nova-compute[73056]: DEBUG nova.compute.manager [req-fe2b7b72-1b3b-4b82-9fb4-f0f03aef24cd req-5e3859e2-b045-47c8-ba3b-e9ef18871c77 service nova] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Received event network-vif-plugged-163edb7f-e2e2-4885-89c6-873c7d7c9c1d {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-fe2b7b72-1b3b-4b82-9fb4-f0f03aef24cd req-5e3859e2-b045-47c8-ba3b-e9ef18871c77 service nova] Acquiring lock "2c9cee38-2588-49e4-bda6-31661f7a9cd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-fe2b7b72-1b3b-4b82-9fb4-f0f03aef24cd req-5e3859e2-b045-47c8-ba3b-e9ef18871c77 service nova] Lock "2c9cee38-2588-49e4-bda6-31661f7a9cd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-fe2b7b72-1b3b-4b82-9fb4-f0f03aef24cd req-5e3859e2-b045-47c8-ba3b-e9ef18871c77 service nova] Lock "2c9cee38-2588-49e4-bda6-31661f7a9cd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:33 user nova-compute[73056]: DEBUG nova.compute.manager [req-fe2b7b72-1b3b-4b82-9fb4-f0f03aef24cd req-5e3859e2-b045-47c8-ba3b-e9ef18871c77 service nova] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] No waiting events found dispatching network-vif-plugged-163edb7f-e2e2-4885-89c6-873c7d7c9c1d {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:33 user nova-compute[73056]: WARNING nova.compute.manager [req-fe2b7b72-1b3b-4b82-9fb4-f0f03aef24cd req-5e3859e2-b045-47c8-ba3b-e9ef18871c77 service nova] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Received unexpected event network-vif-plugged-163edb7f-e2e2-4885-89c6-873c7d7c9c1d for instance with vm_state building and task_state spawning.
Aug 14 16:39:33 user nova-compute[73056]: DEBUG nova.compute.manager [req-fe2b7b72-1b3b-4b82-9fb4-f0f03aef24cd req-5e3859e2-b045-47c8-ba3b-e9ef18871c77 service nova] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Received event network-vif-plugged-163edb7f-e2e2-4885-89c6-873c7d7c9c1d {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-fe2b7b72-1b3b-4b82-9fb4-f0f03aef24cd req-5e3859e2-b045-47c8-ba3b-e9ef18871c77 service nova] Acquiring lock "2c9cee38-2588-49e4-bda6-31661f7a9cd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-fe2b7b72-1b3b-4b82-9fb4-f0f03aef24cd req-5e3859e2-b045-47c8-ba3b-e9ef18871c77 service nova] Lock "2c9cee38-2588-49e4-bda6-31661f7a9cd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-fe2b7b72-1b3b-4b82-9fb4-f0f03aef24cd req-5e3859e2-b045-47c8-ba3b-e9ef18871c77 service nova] Lock "2c9cee38-2588-49e4-bda6-31661f7a9cd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:33 user nova-compute[73056]: DEBUG nova.compute.manager [req-fe2b7b72-1b3b-4b82-9fb4-f0f03aef24cd req-5e3859e2-b045-47c8-ba3b-e9ef18871c77 service nova] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] No waiting events found dispatching network-vif-plugged-163edb7f-e2e2-4885-89c6-873c7d7c9c1d {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:33 user nova-compute[73056]: WARNING nova.compute.manager [req-fe2b7b72-1b3b-4b82-9fb4-f0f03aef24cd req-5e3859e2-b045-47c8-ba3b-e9ef18871c77 service nova] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Received unexpected event network-vif-plugged-163edb7f-e2e2-4885-89c6-873c7d7c9c1d for instance with vm_state building and task_state spawning.
Aug 14 16:39:33 user nova-compute[73056]: DEBUG nova.compute.manager [req-0c647011-bddf-4aad-8a8d-cb17e7b93080 req-2269d442-20ea-4221-b6f9-09c40102b894 service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Received event network-changed-1f7ab99b-ea66-43bf-91e2-da6938d28d2f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:33 user nova-compute[73056]: DEBUG nova.compute.manager [req-0c647011-bddf-4aad-8a8d-cb17e7b93080 req-2269d442-20ea-4221-b6f9-09c40102b894 service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Refreshing instance network info cache due to event network-changed-1f7ab99b-ea66-43bf-91e2-da6938d28d2f. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:39:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0c647011-bddf-4aad-8a8d-cb17e7b93080 req-2269d442-20ea-4221-b6f9-09c40102b894 service nova] Acquiring lock "refresh_cache-9bb2cf77-cd65-49fd-a85b-d7961c2db3bf" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:39:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0c647011-bddf-4aad-8a8d-cb17e7b93080 req-2269d442-20ea-4221-b6f9-09c40102b894 service nova] Acquired lock "refresh_cache-9bb2cf77-cd65-49fd-a85b-d7961c2db3bf" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:39:33 user nova-compute[73056]: DEBUG nova.network.neutron [req-0c647011-bddf-4aad-8a8d-cb17e7b93080 req-2269d442-20ea-4221-b6f9-09c40102b894 service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Refreshing network info cache for port 1f7ab99b-ea66-43bf-91e2-da6938d28d2f {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:39:34 user nova-compute[73056]: DEBUG nova.network.neutron [req-0c647011-bddf-4aad-8a8d-cb17e7b93080 req-2269d442-20ea-4221-b6f9-09c40102b894 service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Updated VIF entry in instance network info cache for port 1f7ab99b-ea66-43bf-91e2-da6938d28d2f. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:39:34 user nova-compute[73056]: DEBUG nova.network.neutron [req-0c647011-bddf-4aad-8a8d-cb17e7b93080 req-2269d442-20ea-4221-b6f9-09c40102b894 service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Updating instance_info_cache with network_info: [{"id": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "address": "fa:16:3e:8d:d8:88", "network": {"id": "dd844e8d-9264-4868-819d-0b01ad3b1d41", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-568480417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e6131531ab4553b55ea090d5e7f47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7ab99b-ea", "ovs_interfaceid": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:39:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0c647011-bddf-4aad-8a8d-cb17e7b93080 req-2269d442-20ea-4221-b6f9-09c40102b894 service nova] Releasing lock "refresh_cache-9bb2cf77-cd65-49fd-a85b-d7961c2db3bf" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:39:34 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031174.6519132, 2c9cee38-2588-49e4-bda6-31661f7a9cd5 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:39:34 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] VM Resumed (Lifecycle Event)
Aug 14 16:39:34 user nova-compute[73056]: DEBUG nova.compute.manager [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:39:34 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:39:34 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Instance spawned successfully.
Aug 14 16:39:34 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:39:34 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:39:34 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:39:34 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:39:34 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:39:34 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:39:34 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:39:34 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:39:34 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:39:34 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:39:34 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031174.6533208, 2c9cee38-2588-49e4-bda6-31661f7a9cd5 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:39:34 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] VM Started (Lifecycle Event)
Aug 14 16:39:34 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:39:34 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:39:34 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:39:34 user nova-compute[73056]: INFO nova.compute.manager [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Took 6.97 seconds to spawn the instance on the hypervisor.
Aug 14 16:39:34 user nova-compute[73056]: DEBUG nova.compute.manager [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:39:34 user nova-compute[73056]: INFO nova.compute.manager [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Took 7.92 seconds to build instance.
Aug 14 16:39:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-53e19fb5-db04-47b0-9225-dd8bd8e85b30 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "2c9cee38-2588-49e4-bda6-31661f7a9cd5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.116s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:37 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquiring lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:40 user nova-compute[73056]: INFO nova.compute.manager [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Rebooting instance
Aug 14 16:39:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquiring lock "refresh_cache-9bb2cf77-cd65-49fd-a85b-d7961c2db3bf" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:39:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquired lock "refresh_cache-9bb2cf77-cd65-49fd-a85b-d7961c2db3bf" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:39:40 user nova-compute[73056]: DEBUG nova.network.neutron [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:39:41 user nova-compute[73056]: DEBUG nova.network.neutron [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Updating instance_info_cache with network_info: [{"id": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "address": "fa:16:3e:8d:d8:88", "network": {"id": "dd844e8d-9264-4868-819d-0b01ad3b1d41", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-568480417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e6131531ab4553b55ea090d5e7f47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7ab99b-ea", "ovs_interfaceid": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:39:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Releasing lock "refresh_cache-9bb2cf77-cd65-49fd-a85b-d7961c2db3bf" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:39:41 user nova-compute[73056]: DEBUG nova.compute.manager [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:39:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:41 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692031166.9032552, 3a013b1e-7fc9-4ad7-a023-95827e2a4228 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:39:41 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] VM Stopped (Lifecycle Event)
Aug 14 16:39:41 user nova-compute[73056]: DEBUG nova.compute.manager [None req-eff3a82b-b2f8-473b-a870-fdf55b0c6536 None None] [instance: 3a013b1e-7fc9-4ad7-a023-95827e2a4228] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:39:41 user nova-compute[73056]: DEBUG nova.compute.manager [req-af3f6cb2-faf7-4859-85c2-d20736f86d7a req-984e4790-687e-4551-9c47-b35055ca9608 service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Received event network-vif-unplugged-1f7ab99b-ea66-43bf-91e2-da6938d28d2f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-af3f6cb2-faf7-4859-85c2-d20736f86d7a req-984e4790-687e-4551-9c47-b35055ca9608 service nova] Acquiring lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-af3f6cb2-faf7-4859-85c2-d20736f86d7a req-984e4790-687e-4551-9c47-b35055ca9608 service nova] Lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-af3f6cb2-faf7-4859-85c2-d20736f86d7a req-984e4790-687e-4551-9c47-b35055ca9608 service nova] Lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:41 user nova-compute[73056]: DEBUG nova.compute.manager [req-af3f6cb2-faf7-4859-85c2-d20736f86d7a req-984e4790-687e-4551-9c47-b35055ca9608 service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] No waiting events found dispatching network-vif-unplugged-1f7ab99b-ea66-43bf-91e2-da6938d28d2f {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:41 user nova-compute[73056]: WARNING nova.compute.manager [req-af3f6cb2-faf7-4859-85c2-d20736f86d7a req-984e4790-687e-4551-9c47-b35055ca9608 service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Received unexpected event network-vif-unplugged-1f7ab99b-ea66-43bf-91e2-da6938d28d2f for instance with vm_state active and task_state reboot_started_hard.
Aug 14 16:39:42 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Instance destroyed successfully.
Aug 14 16:39:42 user nova-compute[73056]: DEBUG nova.objects.instance [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lazy-loading 'resources' on Instance uuid 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:36:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-364355732',display_name='tempest-TestMinimumBasicScenario-server-364355732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-364355732',id=8,image_ref='db2f8653-21f9-470f-aa59-8a25169ac11e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuQWFEsEgmiiXIvuQi3N5xOhs1P8YjYnRlzicPQUcOOw+2bb9wXe4RzvSbe0On1iDTJZMKYHX2WGcWfSPj8whHQVrmn2R8JQ6dGhqXQ/Yqt8WAGBvV80bIdSH+vTO7dOA==',key_name='tempest-TestMinimumBasicScenario-2085563484',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:37:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95e6131531ab4553b55ea090d5e7f47d',ramdisk_id='',reservation_id='r-3mcfhmfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='db2f8653-21f9-470f-aa59-8a25169ac11e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2039952053',owner_user_name='tempest-TestMinimumBasicScenario-2039952053-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:39:41Z,user_data=None,user_id='78a1ab88047b4199bb611c0d7c8d6dee',uuid=9bb2cf77-cd65-49fd-a85b-d7961c2db3bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "address": "fa:16:3e:8d:d8:88", "network": {"id": "dd844e8d-9264-4868-819d-0b01ad3b1d41", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-568480417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e6131531ab4553b55ea090d5e7f47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7ab99b-ea", "ovs_interfaceid": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Converting VIF {"id": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "address": "fa:16:3e:8d:d8:88", "network": {"id": "dd844e8d-9264-4868-819d-0b01ad3b1d41", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-568480417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e6131531ab4553b55ea090d5e7f47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7ab99b-ea", "ovs_interfaceid": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:d8:88,bridge_name='br-int',has_traffic_filtering=True,id=1f7ab99b-ea66-43bf-91e2-da6938d28d2f,network=Network(dd844e8d-9264-4868-819d-0b01ad3b1d41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7ab99b-ea') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG os_vif [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:d8:88,bridge_name='br-int',has_traffic_filtering=True,id=1f7ab99b-ea66-43bf-91e2-da6938d28d2f,network=Network(dd844e8d-9264-4868-819d-0b01ad3b1d41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7ab99b-ea') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f7ab99b-ea, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:42 user nova-compute[73056]: INFO os_vif [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:d8:88,bridge_name='br-int',has_traffic_filtering=True,id=1f7ab99b-ea66-43bf-91e2-da6938d28d2f,network=Network(dd844e8d-9264-4868-819d-0b01ad3b1d41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7ab99b-ea')
Aug 14 16:39:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrxZnPzJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:39:42 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:39:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b6185c-fd8a-4d5b-83ce-6c611ba021e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0bfeca-a1eb-4c93-b4a5-9ae625290ddb]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)
Aug 14 16:39:42 user nova-compute[73056]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:39:42 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:39:42 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:39:42 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:39:42 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)
Aug 14 16:39:42 user nova-compute[73056]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:39:42 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:39:42 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:39:42 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:39:42 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff300303eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d'): ({'sdc'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Removing single pathed devices sdc {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35ca161-bbbd-46de-9512-a2d653a74055]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[8999d9ed-af87-47ab-a115-c922687b9042]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Flushing IO for device /dev/sdc {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d08e36-ed28-4616-b770-cb216d8d906b]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e87ef4f-e7ed-40ac-b4f2-462a687b2db1]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] SCSI volumes sdc have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac617293-181a-4a41-8ab4-51f9c0330bf8]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[509a04ea-5c02-4879-88fc-042181673c6b]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d, portal: 172.16.0.220,3260]
Aug 14 16:39:42 user nova-compute[73056]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d, portal: 172.16.0.220,3260] successful.
Aug 14 16:39:42 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[918fd11b-e87d-436a-a729-68fc3c17a345]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] <== disconnect_volume: return (281ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Start _get_guest_xml network_info=[{"id": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "address": "fa:16:3e:8d:d8:88", "network": {"id": "dd844e8d-9264-4868-819d-0b01ad3b1d41", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-568480417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e6131531ab4553b55ea090d5e7f47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7ab99b-ea", "ovs_interfaceid": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=db2f8653-21f9-470f-aa59-8a25169ac11e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'db2f8653-21f9-470f-aa59-8a25169ac11e'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrxZnPzJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '9bb2cf77-cd65-49fd-a85b-d7961c2db3bf', 'attached_at': '', 'detached_at': '', 'volume_id': 'cdf3d64f-ff30-4b56-8937-48b4d97bed1d', 'serial': 'cdf3d64f-ff30-4b56-8937-48b4d97bed1d'}, 'attachment_id': '0404e901-a433-4466-bb19-1bc78da2b962', 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:39:42 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:39:42 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:39:42 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=db2f8653-21f9-470f-aa59-8a25169ac11e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG nova.objects.instance [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrxZnPzJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:39:42 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:39:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:39:42 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:39:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:39:42 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8b51d3-3b3c-4d6e-bcfd-495282d09266]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:39:42 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8dc6af-3099-4cd1-b4d3-ad01f341815a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d] added
Aug 14 16:39:42 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd90812d-79da-4384-9ebf-e1970e2fc33b]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[07686680-c50c-4a0c-8a61-e1b0fda3c75b]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CrxZnPzJ {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CrxZnPzJ" returned: 0 in 0.033s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad7de7f-01cb-4d61-8a9f-4c3ee4661b73]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CrxZnPzJ'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0c0960-5894-49bd-add0-583b21c8867b]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c711e6-a03d-434b-9afc-2f85bab6f5e0]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:39:42 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:39:42 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:39:42 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:39:42 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:39:42 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:39:42 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:39:42 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:39:42 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:39:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:43 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb343d8-8be3-4c3b-8f3c-0baff0efe009]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:43 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d, portal: 172.16.0.220,3260]
Aug 14 16:39:43 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d, portal: 172.16.0.220,3260] successful.
Aug 14 16:39:43 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:43 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[537c9fe8-8651-408f-89d3-86ff5b45592a]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:43 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:43 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d554190-9606-4897-9ad1-a1b2bbf77bbe]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:43 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:39:43 user nova-compute[73056]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)
Aug 14 16:39:43 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:39:43 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:39:43 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:39:43 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:39:43 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:39:43 user nova-compute[73056]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)
Aug 14 16:39:43 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:39:43 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:39:43 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:39:43 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:39:43 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:39:43 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:39:43 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:39:43 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:39:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:43 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ea839f-c368-4709-b7d5-30c1ea7beb0b]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:43 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: None {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:39:44 user nova-compute[73056]: DEBUG nova.compute.manager [req-8726092f-3fcd-4e36-835d-7b5188bed6de req-805eb636-f611-47d1-9606-302200554b08 service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Received event network-vif-plugged-1f7ab99b-ea66-43bf-91e2-da6938d28d2f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8726092f-3fcd-4e36-835d-7b5188bed6de req-805eb636-f611-47d1-9606-302200554b08 service nova] Acquiring lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8726092f-3fcd-4e36-835d-7b5188bed6de req-805eb636-f611-47d1-9606-302200554b08 service nova] Lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8726092f-3fcd-4e36-835d-7b5188bed6de req-805eb636-f611-47d1-9606-302200554b08 service nova] Lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:44 user nova-compute[73056]: DEBUG nova.compute.manager [req-8726092f-3fcd-4e36-835d-7b5188bed6de req-805eb636-f611-47d1-9606-302200554b08 service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] No waiting events found dispatching network-vif-plugged-1f7ab99b-ea66-43bf-91e2-da6938d28d2f {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:44 user nova-compute[73056]: WARNING nova.compute.manager [req-8726092f-3fcd-4e36-835d-7b5188bed6de req-805eb636-f611-47d1-9606-302200554b08 service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Received unexpected event network-vif-plugged-1f7ab99b-ea66-43bf-91e2-da6938d28d2f for instance with vm_state active and task_state reboot_started_hard.
Aug 14 16:39:44 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:39:44 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrxZnPzJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:39:44 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:39:44 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '26239643538363331', 'path': '/dev/sdb'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:39:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239643538363331', 'path': '/dev/sdb'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:39:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:36:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-364355732',display_name='tempest-TestMinimumBasicScenario-server-364355732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-364355732',id=8,image_ref='db2f8653-21f9-470f-aa59-8a25169ac11e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuQWFEsEgmiiXIvuQi3N5xOhs1P8YjYnRlzicPQUcOOw+2bb9wXe4RzvSbe0On1iDTJZMKYHX2WGcWfSPj8whHQVrmn2R8JQ6dGhqXQ/Yqt8WAGBvV80bIdSH+vTO7dOA==',key_name='tempest-TestMinimumBasicScenario-2085563484',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:37:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95e6131531ab4553b55ea090d5e7f47d',ramdisk_id='',reservation_id='r-3mcfhmfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='db2f8653-21f9-470f-aa59-8a25169ac11e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2039952053',owner_user_name='tempest-TestMinimumBasicScenario-2039952053-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:39:41Z,user_data=None,user_id='78a1ab88047b4199bb611c0d7c8d6dee',uuid=9bb2cf77-cd65-49fd-a85b-d7961c2db3bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "address": "fa:16:3e:8d:d8:88", "network": {"id": "dd844e8d-9264-4868-819d-0b01ad3b1d41", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-568480417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e6131531ab4553b55ea090d5e7f47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7ab99b-ea", "ovs_interfaceid": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:39:44 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Converting VIF {"id": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "address": "fa:16:3e:8d:d8:88", "network": {"id": "dd844e8d-9264-4868-819d-0b01ad3b1d41", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-568480417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e6131531ab4553b55ea090d5e7f47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7ab99b-ea", "ovs_interfaceid": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:39:44 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:d8:88,bridge_name='br-int',has_traffic_filtering=True,id=1f7ab99b-ea66-43bf-91e2-da6938d28d2f,network=Network(dd844e8d-9264-4868-819d-0b01ad3b1d41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7ab99b-ea') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:39:44 user nova-compute[73056]: DEBUG nova.objects.instance [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lazy-loading 'pci_devices' on Instance uuid 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:39:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:39:44 user nova-compute[73056]:   <uuid>9bb2cf77-cd65-49fd-a85b-d7961c2db3bf</uuid>
Aug 14 16:39:44 user nova-compute[73056]:   <name>instance-00000008</name>
Aug 14 16:39:44 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:39:44 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:39:44 user nova-compute[73056]:   <metadata>
Aug 14 16:39:44 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:39:44 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:39:44 user nova-compute[73056]:       <nova:name>tempest-TestMinimumBasicScenario-server-364355732</nova:name>
Aug 14 16:39:44 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:39:42</nova:creationTime>
Aug 14 16:39:44 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:39:44 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:39:44 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:39:44 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:39:44 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:39:44 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:39:44 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:39:44 user nova-compute[73056]:       <nova:owner>
Aug 14 16:39:44 user nova-compute[73056]:         <nova:user uuid="78a1ab88047b4199bb611c0d7c8d6dee">tempest-TestMinimumBasicScenario-2039952053-project-member</nova:user>
Aug 14 16:39:44 user nova-compute[73056]:         <nova:project uuid="95e6131531ab4553b55ea090d5e7f47d">tempest-TestMinimumBasicScenario-2039952053</nova:project>
Aug 14 16:39:44 user nova-compute[73056]:       </nova:owner>
Aug 14 16:39:44 user nova-compute[73056]:       <nova:root type="image" uuid="db2f8653-21f9-470f-aa59-8a25169ac11e"/>
Aug 14 16:39:44 user nova-compute[73056]:       <nova:ports>
Aug 14 16:39:44 user nova-compute[73056]:         <nova:port uuid="1f7ab99b-ea66-43bf-91e2-da6938d28d2f">
Aug 14 16:39:44 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 16:39:44 user nova-compute[73056]:         </nova:port>
Aug 14 16:39:44 user nova-compute[73056]:       </nova:ports>
Aug 14 16:39:44 user nova-compute[73056]:     </nova:instance>
Aug 14 16:39:44 user nova-compute[73056]:   </metadata>
Aug 14 16:39:44 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:39:44 user nova-compute[73056]:     <system>
Aug 14 16:39:44 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:39:44 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:39:44 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:39:44 user nova-compute[73056]:       <entry name="serial">9bb2cf77-cd65-49fd-a85b-d7961c2db3bf</entry>
Aug 14 16:39:44 user nova-compute[73056]:       <entry name="uuid">9bb2cf77-cd65-49fd-a85b-d7961c2db3bf</entry>
Aug 14 16:39:44 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:39:44 user nova-compute[73056]:     </system>
Aug 14 16:39:44 user nova-compute[73056]:   </sysinfo>
Aug 14 16:39:44 user nova-compute[73056]:   <os>
Aug 14 16:39:44 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:39:44 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:39:44 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:39:44 user nova-compute[73056]:   </os>
Aug 14 16:39:44 user nova-compute[73056]:   <features>
Aug 14 16:39:44 user nova-compute[73056]:     <acpi/>
Aug 14 16:39:44 user nova-compute[73056]:     <apic/>
Aug 14 16:39:44 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:39:44 user nova-compute[73056]:   </features>
Aug 14 16:39:44 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:39:44 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:39:44 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:39:44 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:39:44 user nova-compute[73056]:   </clock>
Aug 14 16:39:44 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:39:44 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:39:44 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:39:44 user nova-compute[73056]:   </cpu>
Aug 14 16:39:44 user nova-compute[73056]:   <devices>
Aug 14 16:39:44 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:39:44 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:39:44 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/disk"/>
Aug 14 16:39:44 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:39:44 user nova-compute[73056]:     </disk>
Aug 14 16:39:44 user nova-compute[73056]:     <disk type="block" device="disk">
Aug 14 16:39:44 user nova-compute[73056]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:39:44 user nova-compute[73056]:       <source dev="/dev/sdb"/>
Aug 14 16:39:44 user nova-compute[73056]:       <target dev="vdb" bus="virtio"/>
Aug 14 16:39:44 user nova-compute[73056]:       <serial>cdf3d64f-ff30-4b56-8937-48b4d97bed1d</serial>
Aug 14 16:39:44 user nova-compute[73056]:     </disk>
Aug 14 16:39:44 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:39:44 user nova-compute[73056]:       <mac address="fa:16:3e:8d:d8:88"/>
Aug 14 16:39:44 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:39:44 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:39:44 user nova-compute[73056]:       <target dev="tap1f7ab99b-ea"/>
Aug 14 16:39:44 user nova-compute[73056]:     </interface>
Aug 14 16:39:44 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:39:44 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/console.log" append="off"/>
Aug 14 16:39:44 user nova-compute[73056]:     </serial>
Aug 14 16:39:44 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:39:44 user nova-compute[73056]:     <video>
Aug 14 16:39:44 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:39:44 user nova-compute[73056]:     </video>
Aug 14 16:39:44 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:39:44 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:39:44 user nova-compute[73056]:     </rng>
Aug 14 16:39:44 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:39:44 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:39:44 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:39:44 user nova-compute[73056]:     </memballoon>
Aug 14 16:39:44 user nova-compute[73056]:   </devices>
Aug 14 16:39:44 user nova-compute[73056]: </domain>
Aug 14 16:39:44 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:39:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:39:44 user nova-compute[73056]: DEBUG nova.objects.instance [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:39:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42e35594cd1db4c7dfc03dd6291c1035e6fb08b0 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42e35594cd1db4c7dfc03dd6291c1035e6fb08b0 --force-share --output=json" returned: 0 in 0.176s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:44 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 16:39:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:44 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Cannot resize image /opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 16:39:44 user nova-compute[73056]: DEBUG nova.objects.instance [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lazy-loading 'migration_context' on Instance uuid 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:39:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:36:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-364355732',display_name='tempest-TestMinimumBasicScenario-server-364355732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-364355732',id=8,image_ref='db2f8653-21f9-470f-aa59-8a25169ac11e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuQWFEsEgmiiXIvuQi3N5xOhs1P8YjYnRlzicPQUcOOw+2bb9wXe4RzvSbe0On1iDTJZMKYHX2WGcWfSPj8whHQVrmn2R8JQ6dGhqXQ/Yqt8WAGBvV80bIdSH+vTO7dOA==',key_name='tempest-TestMinimumBasicScenario-2085563484',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:37:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='95e6131531ab4553b55ea090d5e7f47d',ramdisk_id='',reservation_id='r-3mcfhmfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='db2f8653-21f9-470f-aa59-8a25169ac11e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2039952053',owner_user_name='tempest-TestMinimumBasicScenario-2039952053-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:39:41Z,user_data=None,user_id='78a1ab88047b4199bb611c0d7c8d6dee',uuid=9bb2cf77-cd65-49fd-a85b-d7961c2db3bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "address": "fa:16:3e:8d:d8:88", "network": {"id": "dd844e8d-9264-4868-819d-0b01ad3b1d41", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-568480417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e6131531ab4553b55ea090d5e7f47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7ab99b-ea", "ovs_interfaceid": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:39:44 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Converting VIF {"id": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "address": "fa:16:3e:8d:d8:88", "network": {"id": "dd844e8d-9264-4868-819d-0b01ad3b1d41", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-568480417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e6131531ab4553b55ea090d5e7f47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7ab99b-ea", "ovs_interfaceid": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:39:44 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:d8:88,bridge_name='br-int',has_traffic_filtering=True,id=1f7ab99b-ea66-43bf-91e2-da6938d28d2f,network=Network(dd844e8d-9264-4868-819d-0b01ad3b1d41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7ab99b-ea') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:39:44 user nova-compute[73056]: DEBUG os_vif [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:d8:88,bridge_name='br-int',has_traffic_filtering=True,id=1f7ab99b-ea66-43bf-91e2-da6938d28d2f,network=Network(dd844e8d-9264-4868-819d-0b01ad3b1d41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7ab99b-ea') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:39:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:39:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:39:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f7ab99b-ea, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:39:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1f7ab99b-ea, col_values=(('external_ids', {'iface-id': '1f7ab99b-ea66-43bf-91e2-da6938d28d2f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:d8:88', 'vm-uuid': '9bb2cf77-cd65-49fd-a85b-d7961c2db3bf'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:39:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:39:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:44 user nova-compute[73056]: INFO os_vif [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:d8:88,bridge_name='br-int',has_traffic_filtering=True,id=1f7ab99b-ea66-43bf-91e2-da6938d28d2f,network=Network(dd844e8d-9264-4868-819d-0b01ad3b1d41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7ab99b-ea')
Aug 14 16:39:45 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692031170.25609, 03f3d2be-ec24-413c-b44e-873b82268212 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:39:45 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] VM Stopped (Lifecycle Event)
Aug 14 16:39:45 user nova-compute[73056]: DEBUG nova.compute.manager [None req-e6a10e53-6b7b-421a-bdcc-3ad0e7e5f717 None None] [instance: 03f3d2be-ec24-413c-b44e-873b82268212] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:39:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:46 user nova-compute[73056]: DEBUG nova.compute.manager [req-c01f8664-9b29-413f-85f2-81ef805f7f7a req-516f4c57-1e47-4c60-baf6-a5f5e3d49bc7 service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Received event network-vif-plugged-1f7ab99b-ea66-43bf-91e2-da6938d28d2f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c01f8664-9b29-413f-85f2-81ef805f7f7a req-516f4c57-1e47-4c60-baf6-a5f5e3d49bc7 service nova] Acquiring lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c01f8664-9b29-413f-85f2-81ef805f7f7a req-516f4c57-1e47-4c60-baf6-a5f5e3d49bc7 service nova] Lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c01f8664-9b29-413f-85f2-81ef805f7f7a req-516f4c57-1e47-4c60-baf6-a5f5e3d49bc7 service nova] Lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:46 user nova-compute[73056]: DEBUG nova.compute.manager [req-c01f8664-9b29-413f-85f2-81ef805f7f7a req-516f4c57-1e47-4c60-baf6-a5f5e3d49bc7 service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] No waiting events found dispatching network-vif-plugged-1f7ab99b-ea66-43bf-91e2-da6938d28d2f {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:46 user nova-compute[73056]: WARNING nova.compute.manager [req-c01f8664-9b29-413f-85f2-81ef805f7f7a req-516f4c57-1e47-4c60-baf6-a5f5e3d49bc7 service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Received unexpected event network-vif-plugged-1f7ab99b-ea66-43bf-91e2-da6938d28d2f for instance with vm_state active and task_state reboot_started_hard.
Aug 14 16:39:47 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:39:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:47 user nova-compute[73056]: DEBUG nova.compute.manager [req-6b0e3c07-9133-4c72-9d9b-58a636d36b4d req-0021407e-adb0-427b-bb0d-a727af975e8c service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-changed-5240a3a2-cb9a-4df3-a1c1-0c4531c248ac {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:47 user nova-compute[73056]: DEBUG nova.compute.manager [req-6b0e3c07-9133-4c72-9d9b-58a636d36b4d req-0021407e-adb0-427b-bb0d-a727af975e8c service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Refreshing instance network info cache due to event network-changed-5240a3a2-cb9a-4df3-a1c1-0c4531c248ac. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:39:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6b0e3c07-9133-4c72-9d9b-58a636d36b4d req-0021407e-adb0-427b-bb0d-a727af975e8c service nova] Acquiring lock "refresh_cache-10d46e97-4721-49a0-beed-c022e9045b18" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:39:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6b0e3c07-9133-4c72-9d9b-58a636d36b4d req-0021407e-adb0-427b-bb0d-a727af975e8c service nova] Acquired lock "refresh_cache-10d46e97-4721-49a0-beed-c022e9045b18" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:39:47 user nova-compute[73056]: DEBUG nova.network.neutron [req-6b0e3c07-9133-4c72-9d9b-58a636d36b4d req-0021407e-adb0-427b-bb0d-a727af975e8c service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Refreshing network info cache for port 5240a3a2-cb9a-4df3-a1c1-0c4531c248ac {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:39:48 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:39:48 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:39:48 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 16:39:48 user nova-compute[73056]: DEBUG nova.network.neutron [req-6b0e3c07-9133-4c72-9d9b-58a636d36b4d req-0021407e-adb0-427b-bb0d-a727af975e8c service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Updated VIF entry in instance network info cache for port 5240a3a2-cb9a-4df3-a1c1-0c4531c248ac. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:39:48 user nova-compute[73056]: DEBUG nova.network.neutron [req-6b0e3c07-9133-4c72-9d9b-58a636d36b4d req-0021407e-adb0-427b-bb0d-a727af975e8c service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Updating instance_info_cache with network_info: [{"id": "5240a3a2-cb9a-4df3-a1c1-0c4531c248ac", "address": "fa:16:3e:54:5a:4e", "network": {"id": "3a8c7fe6-c1b1-487d-ab15-2b884c3ab575", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1448848437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5240a3a2-cb", "ovs_interfaceid": "5240a3a2-cb9a-4df3-a1c1-0c4531c248ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7fd29069-06c5-41f5-b52c-64fd01fcff42", "address": "fa:16:3e:ec:52:7a", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fd29069-06", "ovs_interfaceid": "7fd29069-06c5-41f5-b52c-64fd01fcff42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b33c5c5b-fdb0-448c-a023-67de9d7f78fc", "address": "fa:16:3e:20:6a:96", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33c5c5b-fd", "ovs_interfaceid": "b33c5c5b-fdb0-448c-a023-67de9d7f78fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586", "address": "fa:16:3e:b3:f7:fb", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c1d6956-ad", "ovs_interfaceid": "2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "087bb06e-10ff-4b89-81e2-59c05c7f658c", "address": "fa:16:3e:dd:8d:1e", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087bb06e-10", "ovs_interfaceid": "087bb06e-10ff-4b89-81e2-59c05c7f658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "16d756dd-e41f-42df-bdba-77a1aa465582", "address": "fa:16:3e:75:1b:3f", "network": {"id": "57310f85-bed6-4991-a4ce-9d6a4ff8d6c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-767952195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d756dd-e4", "ovs_interfaceid": "16d756dd-e41f-42df-bdba-77a1aa465582", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "50d5fcc4-f01a-4f51-81a3-47410ef0bbdc", "address": "fa:16:3e:26:4f:f4", "network": {"id": "57310f85-bed6-4991-a4ce-9d6a4ff8d6c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-767952195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d5fcc4-f0", "ovs_interfaceid": "50d5fcc4-f01a-4f51-81a3-47410ef0bbdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:39:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6b0e3c07-9133-4c72-9d9b-58a636d36b4d req-0021407e-adb0-427b-bb0d-a727af975e8c service nova] Releasing lock "refresh_cache-10d46e97-4721-49a0-beed-c022e9045b18" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:39:48 user nova-compute[73056]: DEBUG nova.compute.manager [req-b494779c-b371-41f0-afac-89f2035351c8 req-3be4a9a8-9dde-4248-bd4c-8b7d5815eeb3 service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Received event network-vif-plugged-1f7ab99b-ea66-43bf-91e2-da6938d28d2f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-b494779c-b371-41f0-afac-89f2035351c8 req-3be4a9a8-9dde-4248-bd4c-8b7d5815eeb3 service nova] Acquiring lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-b494779c-b371-41f0-afac-89f2035351c8 req-3be4a9a8-9dde-4248-bd4c-8b7d5815eeb3 service nova] Lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-b494779c-b371-41f0-afac-89f2035351c8 req-3be4a9a8-9dde-4248-bd4c-8b7d5815eeb3 service nova] Lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:48 user nova-compute[73056]: DEBUG nova.compute.manager [req-b494779c-b371-41f0-afac-89f2035351c8 req-3be4a9a8-9dde-4248-bd4c-8b7d5815eeb3 service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] No waiting events found dispatching network-vif-plugged-1f7ab99b-ea66-43bf-91e2-da6938d28d2f {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:48 user nova-compute[73056]: WARNING nova.compute.manager [req-b494779c-b371-41f0-afac-89f2035351c8 req-3be4a9a8-9dde-4248-bd4c-8b7d5815eeb3 service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Received unexpected event network-vif-plugged-1f7ab99b-ea66-43bf-91e2-da6938d28d2f for instance with vm_state active and task_state reboot_started_hard.
Aug 14 16:39:49 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Removed pending event for 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf due to event {{(pid=73056) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 16:39:49 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031189.0300896, 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:39:49 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] VM Resumed (Lifecycle Event)
Aug 14 16:39:49 user nova-compute[73056]: DEBUG nova.compute.manager [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:39:49 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Instance rebooted successfully.
Aug 14 16:39:49 user nova-compute[73056]: DEBUG nova.compute.manager [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:39:49 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:39:49 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:39:49 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 14 16:39:49 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031189.031404, 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:39:49 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] VM Started (Lifecycle Event)
Aug 14 16:39:49 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:39:49 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:39:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-821af004-ae04-4f8e-a04e-55924ae6d062 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.229s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:50 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:39:50 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:39:50 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:39:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:50 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 16:39:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Acquiring lock "10d46e97-4721-49a0-beed-c022e9045b18" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Lock "10d46e97-4721-49a0-beed-c022e9045b18" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Acquiring lock "10d46e97-4721-49a0-beed-c022e9045b18-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:50 user nova-compute[73056]: INFO nova.compute.manager [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Terminating instance
Aug 14 16:39:50 user nova-compute[73056]: DEBUG nova.compute.manager [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 16:39:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-4cfe0813-e59b-4046-807e-e66179aafc8e req-03800471-8859-408d-8413-56f818323657 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-vif-unplugged-7fd29069-06c5-41f5-b52c-64fd01fcff42 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4cfe0813-e59b-4046-807e-e66179aafc8e req-03800471-8859-408d-8413-56f818323657 service nova] Acquiring lock "10d46e97-4721-49a0-beed-c022e9045b18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4cfe0813-e59b-4046-807e-e66179aafc8e req-03800471-8859-408d-8413-56f818323657 service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4cfe0813-e59b-4046-807e-e66179aafc8e req-03800471-8859-408d-8413-56f818323657 service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-4cfe0813-e59b-4046-807e-e66179aafc8e req-03800471-8859-408d-8413-56f818323657 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] No waiting events found dispatching network-vif-unplugged-7fd29069-06c5-41f5-b52c-64fd01fcff42 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-4cfe0813-e59b-4046-807e-e66179aafc8e req-03800471-8859-408d-8413-56f818323657 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-vif-unplugged-7fd29069-06c5-41f5-b52c-64fd01fcff42 for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:39:51 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:51 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9cee38-2588-49e4-bda6-31661f7a9cd5/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-94902790-2bc7-41d1-a2c3-5e94229441e8 req-74a98362-c5e6-45a8-852d-28009d6c5dc1 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-vif-unplugged-5240a3a2-cb9a-4df3-a1c1-0c4531c248ac {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-94902790-2bc7-41d1-a2c3-5e94229441e8 req-74a98362-c5e6-45a8-852d-28009d6c5dc1 service nova] Acquiring lock "10d46e97-4721-49a0-beed-c022e9045b18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-94902790-2bc7-41d1-a2c3-5e94229441e8 req-74a98362-c5e6-45a8-852d-28009d6c5dc1 service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-94902790-2bc7-41d1-a2c3-5e94229441e8 req-74a98362-c5e6-45a8-852d-28009d6c5dc1 service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-94902790-2bc7-41d1-a2c3-5e94229441e8 req-74a98362-c5e6-45a8-852d-28009d6c5dc1 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] No waiting events found dispatching network-vif-unplugged-5240a3a2-cb9a-4df3-a1c1-0c4531c248ac {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-94902790-2bc7-41d1-a2c3-5e94229441e8 req-74a98362-c5e6-45a8-852d-28009d6c5dc1 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-vif-unplugged-5240a3a2-cb9a-4df3-a1c1-0c4531c248ac for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:39:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:51 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9cee38-2588-49e4-bda6-31661f7a9cd5/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:51 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9cee38-2588-49e4-bda6-31661f7a9cd5/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-9022dc87-b19f-4e2c-bbf0-39956b804792 req-2b0bac7d-df49-4a92-8545-9f95fb8b2069 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-vif-unplugged-b33c5c5b-fdb0-448c-a023-67de9d7f78fc {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9022dc87-b19f-4e2c-bbf0-39956b804792 req-2b0bac7d-df49-4a92-8545-9f95fb8b2069 service nova] Acquiring lock "10d46e97-4721-49a0-beed-c022e9045b18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9022dc87-b19f-4e2c-bbf0-39956b804792 req-2b0bac7d-df49-4a92-8545-9f95fb8b2069 service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9022dc87-b19f-4e2c-bbf0-39956b804792 req-2b0bac7d-df49-4a92-8545-9f95fb8b2069 service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-9022dc87-b19f-4e2c-bbf0-39956b804792 req-2b0bac7d-df49-4a92-8545-9f95fb8b2069 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] No waiting events found dispatching network-vif-unplugged-b33c5c5b-fdb0-448c-a023-67de9d7f78fc {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-9022dc87-b19f-4e2c-bbf0-39956b804792 req-2b0bac7d-df49-4a92-8545-9f95fb8b2069 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-vif-unplugged-b33c5c5b-fdb0-448c-a023-67de9d7f78fc for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:39:51 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9cee38-2588-49e4-bda6-31661f7a9cd5/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:39:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:51 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9927d1d6-6e26-4408-b509-c96df5f314d6/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:51 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9927d1d6-6e26-4408-b509-c96df5f314d6/disk --force-share --output=json" returned: 0 in 0.301s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:51 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9927d1d6-6e26-4408-b509-c96df5f314d6/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9927d1d6-6e26-4408-b509-c96df5f314d6/disk --force-share --output=json" returned: 0 in 0.300s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:52 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Instance destroyed successfully.
Aug 14 16:39:52 user nova-compute[73056]: DEBUG nova.objects.instance [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Lazy-loading 'resources' on Instance uuid 10d46e97-4721-49a0-beed-c022e9045b18 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:39:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2116935830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2116935830',id=9,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeSoDv2TQexH2hIZXYvaRsxuQs6Zc8EWqydJgoNhPuHBGabH3RHqRM+U3UYgbgd6j381DicAH/8RDBw/VJ5DK/ePZK9udxDMfWuym/I2CUyfltUmi+Hx5bU4f3hL4nWaA==',key_name='tempest-keypair-405318954',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:38:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='735e2905caf34b2fb25a17e674daca9c',ramdisk_id='',reservation_id='r-w8eow957',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746076092',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746076092-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:38:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73371a938fc04253bcd7aaf2a86983ea',uuid=10d46e97-4721-49a0-beed-c022e9045b18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5240a3a2-cb9a-4df3-a1c1-0c4531c248ac", "address": "fa:16:3e:54:5a:4e", "network": {"id": "3a8c7fe6-c1b1-487d-ab15-2b884c3ab575", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1448848437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5240a3a2-cb", "ovs_interfaceid": "5240a3a2-cb9a-4df3-a1c1-0c4531c248ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:39:52 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converting VIF {"id": "5240a3a2-cb9a-4df3-a1c1-0c4531c248ac", "address": "fa:16:3e:54:5a:4e", "network": {"id": "3a8c7fe6-c1b1-487d-ab15-2b884c3ab575", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1448848437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5240a3a2-cb", "ovs_interfaceid": "5240a3a2-cb9a-4df3-a1c1-0c4531c248ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:39:52 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:5a:4e,bridge_name='br-int',has_traffic_filtering=True,id=5240a3a2-cb9a-4df3-a1c1-0c4531c248ac,network=Network(3a8c7fe6-c1b1-487d-ab15-2b884c3ab575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5240a3a2-cb') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:39:52 user nova-compute[73056]: DEBUG os_vif [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:5a:4e,bridge_name='br-int',has_traffic_filtering=True,id=5240a3a2-cb9a-4df3-a1c1-0c4531c248ac,network=Network(3a8c7fe6-c1b1-487d-ab15-2b884c3ab575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5240a3a2-cb') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:39:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5240a3a2-cb, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:39:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:39:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:52 user nova-compute[73056]: INFO os_vif [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:5a:4e,bridge_name='br-int',has_traffic_filtering=True,id=5240a3a2-cb9a-4df3-a1c1-0c4531c248ac,network=Network(3a8c7fe6-c1b1-487d-ab15-2b884c3ab575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5240a3a2-cb')
Aug 14 16:39:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2116935830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2116935830',id=9,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeSoDv2TQexH2hIZXYvaRsxuQs6Zc8EWqydJgoNhPuHBGabH3RHqRM+U3UYgbgd6j381DicAH/8RDBw/VJ5DK/ePZK9udxDMfWuym/I2CUyfltUmi+Hx5bU4f3hL4nWaA==',key_name='tempest-keypair-405318954',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:38:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='735e2905caf34b2fb25a17e674daca9c',ramdisk_id='',reservation_id='r-w8eow957',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746076092',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746076092-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:38:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73371a938fc04253bcd7aaf2a86983ea',uuid=10d46e97-4721-49a0-beed-c022e9045b18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7fd29069-06c5-41f5-b52c-64fd01fcff42", "address": "fa:16:3e:ec:52:7a", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fd29069-06", "ovs_interfaceid": "7fd29069-06c5-41f5-b52c-64fd01fcff42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:39:52 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converting VIF {"id": "7fd29069-06c5-41f5-b52c-64fd01fcff42", "address": "fa:16:3e:ec:52:7a", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fd29069-06", "ovs_interfaceid": "7fd29069-06c5-41f5-b52c-64fd01fcff42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:39:52 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:52:7a,bridge_name='br-int',has_traffic_filtering=True,id=7fd29069-06c5-41f5-b52c-64fd01fcff42,network=Network(24aecbb2-24c8-4f51-8728-700b1aeb9e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7fd29069-06') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:39:52 user nova-compute[73056]: DEBUG os_vif [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:52:7a,bridge_name='br-int',has_traffic_filtering=True,id=7fd29069-06c5-41f5-b52c-64fd01fcff42,network=Network(24aecbb2-24c8-4f51-8728-700b1aeb9e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7fd29069-06') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:39:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7fd29069-06, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:39:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:39:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:52 user nova-compute[73056]: INFO os_vif [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:52:7a,bridge_name='br-int',has_traffic_filtering=True,id=7fd29069-06c5-41f5-b52c-64fd01fcff42,network=Network(24aecbb2-24c8-4f51-8728-700b1aeb9e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7fd29069-06')
Aug 14 16:39:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2116935830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2116935830',id=9,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeSoDv2TQexH2hIZXYvaRsxuQs6Zc8EWqydJgoNhPuHBGabH3RHqRM+U3UYgbgd6j381DicAH/8RDBw/VJ5DK/ePZK9udxDMfWuym/I2CUyfltUmi+Hx5bU4f3hL4nWaA==',key_name='tempest-keypair-405318954',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:38:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='735e2905caf34b2fb25a17e674daca9c',ramdisk_id='',reservation_id='r-w8eow957',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746076092',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746076092-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:38:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73371a938fc04253bcd7aaf2a86983ea',uuid=10d46e97-4721-49a0-beed-c022e9045b18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b33c5c5b-fdb0-448c-a023-67de9d7f78fc", "address": "fa:16:3e:20:6a:96", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33c5c5b-fd", "ovs_interfaceid": "b33c5c5b-fdb0-448c-a023-67de9d7f78fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:39:52 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converting VIF {"id": "b33c5c5b-fdb0-448c-a023-67de9d7f78fc", "address": "fa:16:3e:20:6a:96", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33c5c5b-fd", "ovs_interfaceid": "b33c5c5b-fdb0-448c-a023-67de9d7f78fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:39:52 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:6a:96,bridge_name='br-int',has_traffic_filtering=True,id=b33c5c5b-fdb0-448c-a023-67de9d7f78fc,network=Network(24aecbb2-24c8-4f51-8728-700b1aeb9e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb33c5c5b-fd') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:39:52 user nova-compute[73056]: DEBUG os_vif [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:6a:96,bridge_name='br-int',has_traffic_filtering=True,id=b33c5c5b-fdb0-448c-a023-67de9d7f78fc,network=Network(24aecbb2-24c8-4f51-8728-700b1aeb9e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb33c5c5b-fd') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:39:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb33c5c5b-fd, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:39:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:39:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:52 user nova-compute[73056]: INFO os_vif [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:6a:96,bridge_name='br-int',has_traffic_filtering=True,id=b33c5c5b-fdb0-448c-a023-67de9d7f78fc,network=Network(24aecbb2-24c8-4f51-8728-700b1aeb9e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb33c5c5b-fd')
Aug 14 16:39:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2116935830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2116935830',id=9,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeSoDv2TQexH2hIZXYvaRsxuQs6Zc8EWqydJgoNhPuHBGabH3RHqRM+U3UYgbgd6j381DicAH/8RDBw/VJ5DK/ePZK9udxDMfWuym/I2CUyfltUmi+Hx5bU4f3hL4nWaA==',key_name='tempest-keypair-405318954',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:38:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='735e2905caf34b2fb25a17e674daca9c',ramdisk_id='',reservation_id='r-w8eow957',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746076092',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746076092-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:38:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73371a938fc04253bcd7aaf2a86983ea',uuid=10d46e97-4721-49a0-beed-c022e9045b18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586", "address": "fa:16:3e:b3:f7:fb", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c1d6956-ad", "ovs_interfaceid": "2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:39:52 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converting VIF {"id": "2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586", "address": "fa:16:3e:b3:f7:fb", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c1d6956-ad", "ovs_interfaceid": "2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:39:52 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:f7:fb,bridge_name='br-int',has_traffic_filtering=True,id=2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586,network=Network(24aecbb2-24c8-4f51-8728-700b1aeb9e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c1d6956-ad') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:39:52 user nova-compute[73056]: DEBUG os_vif [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:f7:fb,bridge_name='br-int',has_traffic_filtering=True,id=2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586,network=Network(24aecbb2-24c8-4f51-8728-700b1aeb9e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c1d6956-ad') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c1d6956-ad, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:53 user nova-compute[73056]: INFO os_vif [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:f7:fb,bridge_name='br-int',has_traffic_filtering=True,id=2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586,network=Network(24aecbb2-24c8-4f51-8728-700b1aeb9e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c1d6956-ad')
Aug 14 16:39:53 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2116935830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2116935830',id=9,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeSoDv2TQexH2hIZXYvaRsxuQs6Zc8EWqydJgoNhPuHBGabH3RHqRM+U3UYgbgd6j381DicAH/8RDBw/VJ5DK/ePZK9udxDMfWuym/I2CUyfltUmi+Hx5bU4f3hL4nWaA==',key_name='tempest-keypair-405318954',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:38:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='735e2905caf34b2fb25a17e674daca9c',ramdisk_id='',reservation_id='r-w8eow957',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746076092',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746076092-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:38:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73371a938fc04253bcd7aaf2a86983ea',uuid=10d46e97-4721-49a0-beed-c022e9045b18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "087bb06e-10ff-4b89-81e2-59c05c7f658c", "address": "fa:16:3e:dd:8d:1e", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087bb06e-10", "ovs_interfaceid": "087bb06e-10ff-4b89-81e2-59c05c7f658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converting VIF {"id": "087bb06e-10ff-4b89-81e2-59c05c7f658c", "address": "fa:16:3e:dd:8d:1e", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087bb06e-10", "ovs_interfaceid": "087bb06e-10ff-4b89-81e2-59c05c7f658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:8d:1e,bridge_name='br-int',has_traffic_filtering=True,id=087bb06e-10ff-4b89-81e2-59c05c7f658c,network=Network(24aecbb2-24c8-4f51-8728-700b1aeb9e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap087bb06e-10') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG os_vif [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:8d:1e,bridge_name='br-int',has_traffic_filtering=True,id=087bb06e-10ff-4b89-81e2-59c05c7f658c,network=Network(24aecbb2-24c8-4f51-8728-700b1aeb9e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap087bb06e-10') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap087bb06e-10, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:53 user nova-compute[73056]: INFO os_vif [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:8d:1e,bridge_name='br-int',has_traffic_filtering=True,id=087bb06e-10ff-4b89-81e2-59c05c7f658c,network=Network(24aecbb2-24c8-4f51-8728-700b1aeb9e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap087bb06e-10')
Aug 14 16:39:53 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2116935830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2116935830',id=9,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeSoDv2TQexH2hIZXYvaRsxuQs6Zc8EWqydJgoNhPuHBGabH3RHqRM+U3UYgbgd6j381DicAH/8RDBw/VJ5DK/ePZK9udxDMfWuym/I2CUyfltUmi+Hx5bU4f3hL4nWaA==',key_name='tempest-keypair-405318954',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:38:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='735e2905caf34b2fb25a17e674daca9c',ramdisk_id='',reservation_id='r-w8eow957',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746076092',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746076092-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:38:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73371a938fc04253bcd7aaf2a86983ea',uuid=10d46e97-4721-49a0-beed-c022e9045b18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16d756dd-e41f-42df-bdba-77a1aa465582", "address": "fa:16:3e:75:1b:3f", "network": {"id": "57310f85-bed6-4991-a4ce-9d6a4ff8d6c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-767952195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d756dd-e4", "ovs_interfaceid": "16d756dd-e41f-42df-bdba-77a1aa465582", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converting VIF {"id": "16d756dd-e41f-42df-bdba-77a1aa465582", "address": "fa:16:3e:75:1b:3f", "network": {"id": "57310f85-bed6-4991-a4ce-9d6a4ff8d6c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-767952195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d756dd-e4", "ovs_interfaceid": "16d756dd-e41f-42df-bdba-77a1aa465582", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:1b:3f,bridge_name='br-int',has_traffic_filtering=True,id=16d756dd-e41f-42df-bdba-77a1aa465582,network=Network(57310f85-bed6-4991-a4ce-9d6a4ff8d6c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d756dd-e4') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG os_vif [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:1b:3f,bridge_name='br-int',has_traffic_filtering=True,id=16d756dd-e41f-42df-bdba-77a1aa465582,network=Network(57310f85-bed6-4991-a4ce-9d6a4ff8d6c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d756dd-e4') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-67ff5922-b7fc-4ea4-9284-261569097cf8 req-d83244ac-10ce-4431-8e6b-307d70a24045 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-vif-plugged-7fd29069-06c5-41f5-b52c-64fd01fcff42 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-67ff5922-b7fc-4ea4-9284-261569097cf8 req-d83244ac-10ce-4431-8e6b-307d70a24045 service nova] Acquiring lock "10d46e97-4721-49a0-beed-c022e9045b18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-67ff5922-b7fc-4ea4-9284-261569097cf8 req-d83244ac-10ce-4431-8e6b-307d70a24045 service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-67ff5922-b7fc-4ea4-9284-261569097cf8 req-d83244ac-10ce-4431-8e6b-307d70a24045 service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-67ff5922-b7fc-4ea4-9284-261569097cf8 req-d83244ac-10ce-4431-8e6b-307d70a24045 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] No waiting events found dispatching network-vif-plugged-7fd29069-06c5-41f5-b52c-64fd01fcff42 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:53 user nova-compute[73056]: WARNING nova.compute.manager [req-67ff5922-b7fc-4ea4-9284-261569097cf8 req-d83244ac-10ce-4431-8e6b-307d70a24045 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received unexpected event network-vif-plugged-7fd29069-06c5-41f5-b52c-64fd01fcff42 for instance with vm_state active and task_state deleting.
Aug 14 16:39:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-67ff5922-b7fc-4ea4-9284-261569097cf8 req-d83244ac-10ce-4431-8e6b-307d70a24045 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-vif-unplugged-087bb06e-10ff-4b89-81e2-59c05c7f658c {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-67ff5922-b7fc-4ea4-9284-261569097cf8 req-d83244ac-10ce-4431-8e6b-307d70a24045 service nova] Acquiring lock "10d46e97-4721-49a0-beed-c022e9045b18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-67ff5922-b7fc-4ea4-9284-261569097cf8 req-d83244ac-10ce-4431-8e6b-307d70a24045 service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-67ff5922-b7fc-4ea4-9284-261569097cf8 req-d83244ac-10ce-4431-8e6b-307d70a24045 service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-67ff5922-b7fc-4ea4-9284-261569097cf8 req-d83244ac-10ce-4431-8e6b-307d70a24045 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] No waiting events found dispatching network-vif-unplugged-087bb06e-10ff-4b89-81e2-59c05c7f658c {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-67ff5922-b7fc-4ea4-9284-261569097cf8 req-d83244ac-10ce-4431-8e6b-307d70a24045 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-vif-unplugged-087bb06e-10ff-4b89-81e2-59c05c7f658c for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-67ff5922-b7fc-4ea4-9284-261569097cf8 req-d83244ac-10ce-4431-8e6b-307d70a24045 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-vif-plugged-087bb06e-10ff-4b89-81e2-59c05c7f658c {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-67ff5922-b7fc-4ea4-9284-261569097cf8 req-d83244ac-10ce-4431-8e6b-307d70a24045 service nova] Acquiring lock "10d46e97-4721-49a0-beed-c022e9045b18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-67ff5922-b7fc-4ea4-9284-261569097cf8 req-d83244ac-10ce-4431-8e6b-307d70a24045 service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-67ff5922-b7fc-4ea4-9284-261569097cf8 req-d83244ac-10ce-4431-8e6b-307d70a24045 service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-67ff5922-b7fc-4ea4-9284-261569097cf8 req-d83244ac-10ce-4431-8e6b-307d70a24045 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] No waiting events found dispatching network-vif-plugged-087bb06e-10ff-4b89-81e2-59c05c7f658c {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:53 user nova-compute[73056]: WARNING nova.compute.manager [req-67ff5922-b7fc-4ea4-9284-261569097cf8 req-d83244ac-10ce-4431-8e6b-307d70a24045 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received unexpected event network-vif-plugged-087bb06e-10ff-4b89-81e2-59c05c7f658c for instance with vm_state active and task_state deleting.
Aug 14 16:39:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-67ff5922-b7fc-4ea4-9284-261569097cf8 req-d83244ac-10ce-4431-8e6b-307d70a24045 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-vif-unplugged-16d756dd-e41f-42df-bdba-77a1aa465582 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-67ff5922-b7fc-4ea4-9284-261569097cf8 req-d83244ac-10ce-4431-8e6b-307d70a24045 service nova] Acquiring lock "10d46e97-4721-49a0-beed-c022e9045b18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-67ff5922-b7fc-4ea4-9284-261569097cf8 req-d83244ac-10ce-4431-8e6b-307d70a24045 service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-67ff5922-b7fc-4ea4-9284-261569097cf8 req-d83244ac-10ce-4431-8e6b-307d70a24045 service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-67ff5922-b7fc-4ea4-9284-261569097cf8 req-d83244ac-10ce-4431-8e6b-307d70a24045 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] No waiting events found dispatching network-vif-unplugged-16d756dd-e41f-42df-bdba-77a1aa465582 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-67ff5922-b7fc-4ea4-9284-261569097cf8 req-d83244ac-10ce-4431-8e6b-307d70a24045 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-vif-unplugged-16d756dd-e41f-42df-bdba-77a1aa465582 for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16d756dd-e4, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:53 user nova-compute[73056]: INFO os_vif [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:1b:3f,bridge_name='br-int',has_traffic_filtering=True,id=16d756dd-e41f-42df-bdba-77a1aa465582,network=Network(57310f85-bed6-4991-a4ce-9d6a4ff8d6c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d756dd-e4')
Aug 14 16:39:53 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:37:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2116935830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2116935830',id=9,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeSoDv2TQexH2hIZXYvaRsxuQs6Zc8EWqydJgoNhPuHBGabH3RHqRM+U3UYgbgd6j381DicAH/8RDBw/VJ5DK/ePZK9udxDMfWuym/I2CUyfltUmi+Hx5bU4f3hL4nWaA==',key_name='tempest-keypair-405318954',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:38:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='735e2905caf34b2fb25a17e674daca9c',ramdisk_id='',reservation_id='r-w8eow957',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1746076092',owner_user_name='tempest-TaggedBootDevicesTest_v242-1746076092-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:38:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73371a938fc04253bcd7aaf2a86983ea',uuid=10d46e97-4721-49a0-beed-c022e9045b18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50d5fcc4-f01a-4f51-81a3-47410ef0bbdc", "address": "fa:16:3e:26:4f:f4", "network": {"id": "57310f85-bed6-4991-a4ce-9d6a4ff8d6c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-767952195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d5fcc4-f0", "ovs_interfaceid": "50d5fcc4-f01a-4f51-81a3-47410ef0bbdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converting VIF {"id": "50d5fcc4-f01a-4f51-81a3-47410ef0bbdc", "address": "fa:16:3e:26:4f:f4", "network": {"id": "57310f85-bed6-4991-a4ce-9d6a4ff8d6c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-767952195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d5fcc4-f0", "ovs_interfaceid": "50d5fcc4-f01a-4f51-81a3-47410ef0bbdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:4f:f4,bridge_name='br-int',has_traffic_filtering=True,id=50d5fcc4-f01a-4f51-81a3-47410ef0bbdc,network=Network(57310f85-bed6-4991-a4ce-9d6a4ff8d6c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50d5fcc4-f0') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG os_vif [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:4f:f4,bridge_name='br-int',has_traffic_filtering=True,id=50d5fcc4-f01a-4f51-81a3-47410ef0bbdc,network=Network(57310f85-bed6-4991-a4ce-9d6a4ff8d6c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50d5fcc4-f0') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50d5fcc4-f0, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:39:53 user nova-compute[73056]: INFO os_vif [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:4f:f4,bridge_name='br-int',has_traffic_filtering=True,id=50d5fcc4-f01a-4f51-81a3-47410ef0bbdc,network=Network(57310f85-bed6-4991-a4ce-9d6a4ff8d6c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50d5fcc4-f0')
Aug 14 16:39:53 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wyvfdVYm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:39:53 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:39:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-9dad5f14-28ad-4ce0-8404-aa0728120b4e req-9827fca5-6a5d-46d3-8d94-3708d89033bc service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-vif-plugged-5240a3a2-cb9a-4df3-a1c1-0c4531c248ac {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9dad5f14-28ad-4ce0-8404-aa0728120b4e req-9827fca5-6a5d-46d3-8d94-3708d89033bc service nova] Acquiring lock "10d46e97-4721-49a0-beed-c022e9045b18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9dad5f14-28ad-4ce0-8404-aa0728120b4e req-9827fca5-6a5d-46d3-8d94-3708d89033bc service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9dad5f14-28ad-4ce0-8404-aa0728120b4e req-9827fca5-6a5d-46d3-8d94-3708d89033bc service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-9dad5f14-28ad-4ce0-8404-aa0728120b4e req-9827fca5-6a5d-46d3-8d94-3708d89033bc service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] No waiting events found dispatching network-vif-plugged-5240a3a2-cb9a-4df3-a1c1-0c4531c248ac {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:53 user nova-compute[73056]: WARNING nova.compute.manager [req-9dad5f14-28ad-4ce0-8404-aa0728120b4e req-9827fca5-6a5d-46d3-8d94-3708d89033bc service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received unexpected event network-vif-plugged-5240a3a2-cb9a-4df3-a1c1-0c4531c248ac for instance with vm_state active and task_state deleting.
Aug 14 16:39:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-9dad5f14-28ad-4ce0-8404-aa0728120b4e req-9827fca5-6a5d-46d3-8d94-3708d89033bc service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-vif-unplugged-2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9dad5f14-28ad-4ce0-8404-aa0728120b4e req-9827fca5-6a5d-46d3-8d94-3708d89033bc service nova] Acquiring lock "10d46e97-4721-49a0-beed-c022e9045b18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9dad5f14-28ad-4ce0-8404-aa0728120b4e req-9827fca5-6a5d-46d3-8d94-3708d89033bc service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9dad5f14-28ad-4ce0-8404-aa0728120b4e req-9827fca5-6a5d-46d3-8d94-3708d89033bc service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-9dad5f14-28ad-4ce0-8404-aa0728120b4e req-9827fca5-6a5d-46d3-8d94-3708d89033bc service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] No waiting events found dispatching network-vif-unplugged-2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-9dad5f14-28ad-4ce0-8404-aa0728120b4e req-9827fca5-6a5d-46d3-8d94-3708d89033bc service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-vif-unplugged-2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586 for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-9dad5f14-28ad-4ce0-8404-aa0728120b4e req-9827fca5-6a5d-46d3-8d94-3708d89033bc service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-vif-plugged-2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9dad5f14-28ad-4ce0-8404-aa0728120b4e req-9827fca5-6a5d-46d3-8d94-3708d89033bc service nova] Acquiring lock "10d46e97-4721-49a0-beed-c022e9045b18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9dad5f14-28ad-4ce0-8404-aa0728120b4e req-9827fca5-6a5d-46d3-8d94-3708d89033bc service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9dad5f14-28ad-4ce0-8404-aa0728120b4e req-9827fca5-6a5d-46d3-8d94-3708d89033bc service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-9dad5f14-28ad-4ce0-8404-aa0728120b4e req-9827fca5-6a5d-46d3-8d94-3708d89033bc service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] No waiting events found dispatching network-vif-plugged-2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:53 user nova-compute[73056]: WARNING nova.compute.manager [req-9dad5f14-28ad-4ce0-8404-aa0728120b4e req-9827fca5-6a5d-46d3-8d94-3708d89033bc service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received unexpected event network-vif-plugged-2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586 for instance with vm_state active and task_state deleting.
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2875ce-b4c5-4c14-a5d9-b85ba74dec4f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5ba83-0612-4ce2-bd44-3ab55820022f/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c34793-d522-471d-96b2-45b59c3d57fe]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:39:53 user nova-compute[73056]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)
Aug 14 16:39:53 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:39:53 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:39:53 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:39:53 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:39:53 user nova-compute[73056]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)
Aug 14 16:39:53 user nova-compute[73056]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 (non-flash)
Aug 14 16:39:53 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:39:53 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:39:53 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff2dcedd480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18'): ({'sdf'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Removing single pathed devices sdf {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f059af-ff1e-4199-9056-0c89eaddfe29]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[720e5132-65f6-40e7-9277-510fb2b3177d]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Flushing IO for device /dev/sdf {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c20e8b-716f-417e-910d-38b4390c7e04]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5ba83-0612-4ce2-bd44-3ab55820022f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5ba83-0612-4ce2-bd44-3ab55820022f/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.061s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8dd080-f7e8-407d-bdcb-87fc96c9bd07]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] SCSI volumes sdf have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccaa86b-9d36-4df7-b44a-94d7eb40972d]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-b7e013b7-3301-4036-bb2c-1b0940ff7431 req-fcc7ac84-f2b0-40dc-8111-ea573a18af2c service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-vif-plugged-b33c5c5b-fdb0-448c-a023-67de9d7f78fc {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-b7e013b7-3301-4036-bb2c-1b0940ff7431 req-fcc7ac84-f2b0-40dc-8111-ea573a18af2c service nova] Acquiring lock "10d46e97-4721-49a0-beed-c022e9045b18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-b7e013b7-3301-4036-bb2c-1b0940ff7431 req-fcc7ac84-f2b0-40dc-8111-ea573a18af2c service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-b7e013b7-3301-4036-bb2c-1b0940ff7431 req-fcc7ac84-f2b0-40dc-8111-ea573a18af2c service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-b7e013b7-3301-4036-bb2c-1b0940ff7431 req-fcc7ac84-f2b0-40dc-8111-ea573a18af2c service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] No waiting events found dispatching network-vif-plugged-b33c5c5b-fdb0-448c-a023-67de9d7f78fc {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:53 user nova-compute[73056]: WARNING nova.compute.manager [req-b7e013b7-3301-4036-bb2c-1b0940ff7431 req-fcc7ac84-f2b0-40dc-8111-ea573a18af2c service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received unexpected event network-vif-plugged-b33c5c5b-fdb0-448c-a023-67de9d7f78fc for instance with vm_state active and task_state deleting.
Aug 14 16:39:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-b7e013b7-3301-4036-bb2c-1b0940ff7431 req-fcc7ac84-f2b0-40dc-8111-ea573a18af2c service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-vif-unplugged-50d5fcc4-f01a-4f51-81a3-47410ef0bbdc {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-b7e013b7-3301-4036-bb2c-1b0940ff7431 req-fcc7ac84-f2b0-40dc-8111-ea573a18af2c service nova] Acquiring lock "10d46e97-4721-49a0-beed-c022e9045b18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-b7e013b7-3301-4036-bb2c-1b0940ff7431 req-fcc7ac84-f2b0-40dc-8111-ea573a18af2c service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-b7e013b7-3301-4036-bb2c-1b0940ff7431 req-fcc7ac84-f2b0-40dc-8111-ea573a18af2c service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-b7e013b7-3301-4036-bb2c-1b0940ff7431 req-fcc7ac84-f2b0-40dc-8111-ea573a18af2c service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] No waiting events found dispatching network-vif-unplugged-50d5fcc4-f01a-4f51-81a3-47410ef0bbdc {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-b7e013b7-3301-4036-bb2c-1b0940ff7431 req-fcc7ac84-f2b0-40dc-8111-ea573a18af2c service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-vif-unplugged-50d5fcc4-f01a-4f51-81a3-47410ef0bbdc for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-b7e013b7-3301-4036-bb2c-1b0940ff7431 req-fcc7ac84-f2b0-40dc-8111-ea573a18af2c service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-vif-plugged-50d5fcc4-f01a-4f51-81a3-47410ef0bbdc {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-b7e013b7-3301-4036-bb2c-1b0940ff7431 req-fcc7ac84-f2b0-40dc-8111-ea573a18af2c service nova] Acquiring lock "10d46e97-4721-49a0-beed-c022e9045b18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-b7e013b7-3301-4036-bb2c-1b0940ff7431 req-fcc7ac84-f2b0-40dc-8111-ea573a18af2c service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-b7e013b7-3301-4036-bb2c-1b0940ff7431 req-fcc7ac84-f2b0-40dc-8111-ea573a18af2c service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-b7e013b7-3301-4036-bb2c-1b0940ff7431 req-fcc7ac84-f2b0-40dc-8111-ea573a18af2c service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] No waiting events found dispatching network-vif-plugged-50d5fcc4-f01a-4f51-81a3-47410ef0bbdc {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:53 user nova-compute[73056]: WARNING nova.compute.manager [req-b7e013b7-3301-4036-bb2c-1b0940ff7431 req-fcc7ac84-f2b0-40dc-8111-ea573a18af2c service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received unexpected event network-vif-plugged-50d5fcc4-f01a-4f51-81a3-47410ef0bbdc for instance with vm_state active and task_state deleting.
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b39aeb8-8444-412a-9969-ed4d56c12f92]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18, portal: 172.16.0.220,3260]
Aug 14 16:39:53 user nova-compute[73056]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18, portal: 172.16.0.220,3260] successful.
Aug 14 16:39:53 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7667d00d-8180-4d28-a276-7ac9edddae18 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[40064397-fee4-4d75-b3e4-290eaf6c7e5a]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.452s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] <== disconnect_volume: return (453ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pviDKyPt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:39:53 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:39:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5ba83-0612-4ce2-bd44-3ab55820022f/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1954799-9f6c-4dac-ac54-6bd34006ca8e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7078cf-2f2c-46fc-ab46-49ec6feeac7c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:39:53 user nova-compute[73056]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)
Aug 14 16:39:53 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:39:53 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:39:53 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:39:53 user nova-compute[73056]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)
Aug 14 16:39:53 user nova-compute[73056]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 (non-flash)
Aug 14 16:39:53 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:39:53 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff2dce5e7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02'): ({'sdg'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Removing single pathed devices sdg {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:39:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe92e5e4-b1ea-4fde-a5be-8b0ef09168ed]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:54 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:39:54 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:39:54 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=7454MB free_disk=25.648143768310547GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e9e942-97cd-45b0-aabb-fcd786b3c6c9]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Flushing IO for device /dev/sdg {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c268b634-ab26-409f-a8f0-335cbd6869e6]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.078s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e88e79-7c4f-4492-93f3-715028951ef2]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] SCSI volumes sdg have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8628194-a529-470d-95f9-13bd5e1791a1]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 9f3a7f8a-e3b9-4918-9663-968677fe5c90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 0fd5ba83-0612-4ce2-bd44-3ab55820022f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 9927d1d6-6e26-4408-b509-c96df5f314d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance a329b987-231e-47a8-9f2d-71c15573f9f0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 10d46e97-4721-49a0-beed-c022e9045b18 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 2c9cee38-2588-49e4-bda6-31661f7a9cd5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7f6b8c-18c8-4153-ad02-a58d9dbee3d1]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02, portal: 172.16.0.220,3260]
Aug 14 16:39:54 user nova-compute[73056]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02, portal: 172.16.0.220,3260] successful.
Aug 14 16:39:54 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a4de72-a5b0-4242-b22b-3f5ac30e8b02 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[56da2e21-a115-4fda-a436-253f2c7e1b93]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.930s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] <== disconnect_volume: return (933ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JZnIxSkr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:39:54 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:39:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f57ed5f-6e36-445e-9d7d-26b57cc87b87]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6738e6-6a1c-4425-9136-1ab2d714ec06]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:39:54 user nova-compute[73056]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)
Aug 14 16:39:54 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:39:54 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:39:54 user nova-compute[73056]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)
Aug 14 16:39:54 user nova-compute[73056]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f (non-flash)
Aug 14 16:39:54 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff2dce46ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f'): ({'sdh'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Removing single pathed devices sdh {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[befd1cbf-5f5c-4591-9b1b-a52ab572837a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[98470260-6611-46db-9314-a7e716e8f593]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Flushing IO for device /dev/sdh {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcba2d5c-89c9-431e-9ca2-5ed0d97d7238]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.065s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3cad17-e366-47e4-9f5e-650001bfd893]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] SCSI volumes sdh have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[464f87ea-a6c7-4475-8e13-6eba1be9d7a5]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[4914701d-7bc2-46c6-b1d3-ac9c48a91144]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f, portal: 172.16.0.220,3260]
Aug 14 16:39:54 user nova-compute[73056]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f, portal: 172.16.0.220,3260] successful.
Aug 14 16:39:54 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.650s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab4afa3-aa80-4d48-aced-b74ce8af207f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[723c0ca1-c78e-4304-be57-0b347ccf046d]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] <== disconnect_volume: return (351ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:39:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:39:54 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Deleting instance files /opt/stack/data/nova/instances/10d46e97-4721-49a0-beed-c022e9045b18_del
Aug 14 16:39:54 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Deletion of /opt/stack/data/nova/instances/10d46e97-4721-49a0-beed-c022e9045b18_del complete
Aug 14 16:39:55 user nova-compute[73056]: INFO nova.compute.manager [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Took 4.63 seconds to destroy the instance on the hypervisor.
Aug 14 16:39:55 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 16:39:55 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 16:39:55 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 16:39:55 user nova-compute[73056]: DEBUG nova.compute.manager [req-89be2926-0ca8-4e3f-9ac5-59432699a8f1 req-932a675e-485c-48dd-837f-d8386f4de90b service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-vif-plugged-16d756dd-e41f-42df-bdba-77a1aa465582 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-89be2926-0ca8-4e3f-9ac5-59432699a8f1 req-932a675e-485c-48dd-837f-d8386f4de90b service nova] Acquiring lock "10d46e97-4721-49a0-beed-c022e9045b18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:39:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-89be2926-0ca8-4e3f-9ac5-59432699a8f1 req-932a675e-485c-48dd-837f-d8386f4de90b service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:39:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-89be2926-0ca8-4e3f-9ac5-59432699a8f1 req-932a675e-485c-48dd-837f-d8386f4de90b service nova] Lock "10d46e97-4721-49a0-beed-c022e9045b18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:39:55 user nova-compute[73056]: DEBUG nova.compute.manager [req-89be2926-0ca8-4e3f-9ac5-59432699a8f1 req-932a675e-485c-48dd-837f-d8386f4de90b service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] No waiting events found dispatching network-vif-plugged-16d756dd-e41f-42df-bdba-77a1aa465582 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:39:55 user nova-compute[73056]: WARNING nova.compute.manager [req-89be2926-0ca8-4e3f-9ac5-59432699a8f1 req-932a675e-485c-48dd-837f-d8386f4de90b service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received unexpected event network-vif-plugged-16d756dd-e41f-42df-bdba-77a1aa465582 for instance with vm_state active and task_state deleting.
Aug 14 16:39:55 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:39:55 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:39:55 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 16:39:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-9927d1d6-6e26-4408-b509-c96df5f314d6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:39:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-9927d1d6-6e26-4408-b509-c96df5f314d6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:39:56 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 16:39:57 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Updating instance_info_cache with network_info: [{"id": "f706d56a-af89-4224-ad47-4fc43bbebbfb", "address": "fa:16:3e:b2:34:a0", "network": {"id": "bf1db71c-8d0e-447f-bf4a-90a8bb7751e4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-592839111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b35b1eb775b143e19a9d2fa193d946b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf706d56a-af", "ovs_interfaceid": "f706d56a-af89-4224-ad47-4fc43bbebbfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:39:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-9927d1d6-6e26-4408-b509-c96df5f314d6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:39:57 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 16:39:57 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:39:57 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:39:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:39:59 user nova-compute[73056]: DEBUG nova.compute.manager [req-a0da6ee7-8338-4821-bc47-8531ccd81955 req-ab6e10da-e410-4b9b-b782-f9e2adaf91a3 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-vif-deleted-2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:39:59 user nova-compute[73056]: INFO nova.compute.manager [req-a0da6ee7-8338-4821-bc47-8531ccd81955 req-ab6e10da-e410-4b9b-b782-f9e2adaf91a3 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Neutron deleted interface 2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586; detaching it from the instance and deleting it from the info cache
Aug 14 16:39:59 user nova-compute[73056]: DEBUG nova.network.neutron [req-a0da6ee7-8338-4821-bc47-8531ccd81955 req-ab6e10da-e410-4b9b-b782-f9e2adaf91a3 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Updating instance_info_cache with network_info: [{"id": "5240a3a2-cb9a-4df3-a1c1-0c4531c248ac", "address": "fa:16:3e:54:5a:4e", "network": {"id": "3a8c7fe6-c1b1-487d-ab15-2b884c3ab575", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1448848437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5240a3a2-cb", "ovs_interfaceid": "5240a3a2-cb9a-4df3-a1c1-0c4531c248ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7fd29069-06c5-41f5-b52c-64fd01fcff42", "address": "fa:16:3e:ec:52:7a", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fd29069-06", "ovs_interfaceid": "7fd29069-06c5-41f5-b52c-64fd01fcff42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b33c5c5b-fdb0-448c-a023-67de9d7f78fc", "address": "fa:16:3e:20:6a:96", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33c5c5b-fd", "ovs_interfaceid": "b33c5c5b-fdb0-448c-a023-67de9d7f78fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "087bb06e-10ff-4b89-81e2-59c05c7f658c", "address": "fa:16:3e:dd:8d:1e", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087bb06e-10", "ovs_interfaceid": "087bb06e-10ff-4b89-81e2-59c05c7f658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "16d756dd-e41f-42df-bdba-77a1aa465582", "address": "fa:16:3e:75:1b:3f", "network": {"id": "57310f85-bed6-4991-a4ce-9d6a4ff8d6c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-767952195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d756dd-e4", "ovs_interfaceid": "16d756dd-e41f-42df-bdba-77a1aa465582", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "50d5fcc4-f01a-4f51-81a3-47410ef0bbdc", "address": "fa:16:3e:26:4f:f4", "network": {"id": "57310f85-bed6-4991-a4ce-9d6a4ff8d6c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-767952195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d5fcc4-f0", "ovs_interfaceid": "50d5fcc4-f01a-4f51-81a3-47410ef0bbdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:39:59 user nova-compute[73056]: DEBUG nova.compute.manager [req-a0da6ee7-8338-4821-bc47-8531ccd81955 req-ab6e10da-e410-4b9b-b782-f9e2adaf91a3 service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Detach interface failed, port_id=2c1d6956-ad9d-4a6f-86b6-c5e7a64f2586, reason: Instance 10d46e97-4721-49a0-beed-c022e9045b18 could not be found. {{(pid=73056) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 16:40:01 user nova-compute[73056]: DEBUG nova.compute.manager [req-90bfc146-a412-4033-8906-df35e7738e36 req-20abf8cb-cdfd-4a27-bbd2-132a5b09992b service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-vif-deleted-087bb06e-10ff-4b89-81e2-59c05c7f658c {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:40:01 user nova-compute[73056]: INFO nova.compute.manager [req-90bfc146-a412-4033-8906-df35e7738e36 req-20abf8cb-cdfd-4a27-bbd2-132a5b09992b service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Neutron deleted interface 087bb06e-10ff-4b89-81e2-59c05c7f658c; detaching it from the instance and deleting it from the info cache
Aug 14 16:40:01 user nova-compute[73056]: DEBUG nova.network.neutron [req-90bfc146-a412-4033-8906-df35e7738e36 req-20abf8cb-cdfd-4a27-bbd2-132a5b09992b service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Updating instance_info_cache with network_info: [{"id": "5240a3a2-cb9a-4df3-a1c1-0c4531c248ac", "address": "fa:16:3e:54:5a:4e", "network": {"id": "3a8c7fe6-c1b1-487d-ab15-2b884c3ab575", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1448848437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5240a3a2-cb", "ovs_interfaceid": "5240a3a2-cb9a-4df3-a1c1-0c4531c248ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7fd29069-06c5-41f5-b52c-64fd01fcff42", "address": "fa:16:3e:ec:52:7a", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fd29069-06", "ovs_interfaceid": "7fd29069-06c5-41f5-b52c-64fd01fcff42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b33c5c5b-fdb0-448c-a023-67de9d7f78fc", "address": "fa:16:3e:20:6a:96", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33c5c5b-fd", "ovs_interfaceid": "b33c5c5b-fdb0-448c-a023-67de9d7f78fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "16d756dd-e41f-42df-bdba-77a1aa465582", "address": "fa:16:3e:75:1b:3f", "network": {"id": "57310f85-bed6-4991-a4ce-9d6a4ff8d6c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-767952195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d756dd-e4", "ovs_interfaceid": "16d756dd-e41f-42df-bdba-77a1aa465582", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "50d5fcc4-f01a-4f51-81a3-47410ef0bbdc", "address": "fa:16:3e:26:4f:f4", "network": {"id": "57310f85-bed6-4991-a4ce-9d6a4ff8d6c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-767952195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d5fcc4-f0", "ovs_interfaceid": "50d5fcc4-f01a-4f51-81a3-47410ef0bbdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:40:01 user nova-compute[73056]: DEBUG nova.compute.manager [req-90bfc146-a412-4033-8906-df35e7738e36 req-20abf8cb-cdfd-4a27-bbd2-132a5b09992b service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Detach interface failed, port_id=087bb06e-10ff-4b89-81e2-59c05c7f658c, reason: Instance 10d46e97-4721-49a0-beed-c022e9045b18 could not be found. {{(pid=73056) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 16:40:01 user nova-compute[73056]: DEBUG nova.compute.manager [req-90bfc146-a412-4033-8906-df35e7738e36 req-20abf8cb-cdfd-4a27-bbd2-132a5b09992b service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-vif-deleted-16d756dd-e41f-42df-bdba-77a1aa465582 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:40:01 user nova-compute[73056]: INFO nova.compute.manager [req-90bfc146-a412-4033-8906-df35e7738e36 req-20abf8cb-cdfd-4a27-bbd2-132a5b09992b service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Neutron deleted interface 16d756dd-e41f-42df-bdba-77a1aa465582; detaching it from the instance and deleting it from the info cache
Aug 14 16:40:01 user nova-compute[73056]: DEBUG nova.network.neutron [req-90bfc146-a412-4033-8906-df35e7738e36 req-20abf8cb-cdfd-4a27-bbd2-132a5b09992b service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Updating instance_info_cache with network_info: [{"id": "5240a3a2-cb9a-4df3-a1c1-0c4531c248ac", "address": "fa:16:3e:54:5a:4e", "network": {"id": "3a8c7fe6-c1b1-487d-ab15-2b884c3ab575", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1448848437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5240a3a2-cb", "ovs_interfaceid": "5240a3a2-cb9a-4df3-a1c1-0c4531c248ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7fd29069-06c5-41f5-b52c-64fd01fcff42", "address": "fa:16:3e:ec:52:7a", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fd29069-06", "ovs_interfaceid": "7fd29069-06c5-41f5-b52c-64fd01fcff42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b33c5c5b-fdb0-448c-a023-67de9d7f78fc", "address": "fa:16:3e:20:6a:96", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33c5c5b-fd", "ovs_interfaceid": "b33c5c5b-fdb0-448c-a023-67de9d7f78fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "50d5fcc4-f01a-4f51-81a3-47410ef0bbdc", "address": "fa:16:3e:26:4f:f4", "network": {"id": "57310f85-bed6-4991-a4ce-9d6a4ff8d6c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-767952195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50d5fcc4-f0", "ovs_interfaceid": "50d5fcc4-f01a-4f51-81a3-47410ef0bbdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:40:01 user nova-compute[73056]: DEBUG nova.compute.manager [req-90bfc146-a412-4033-8906-df35e7738e36 req-20abf8cb-cdfd-4a27-bbd2-132a5b09992b service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Detach interface failed, port_id=16d756dd-e41f-42df-bdba-77a1aa465582, reason: Instance 10d46e97-4721-49a0-beed-c022e9045b18 could not be found. {{(pid=73056) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 16:40:01 user nova-compute[73056]: DEBUG nova.compute.manager [req-90bfc146-a412-4033-8906-df35e7738e36 req-20abf8cb-cdfd-4a27-bbd2-132a5b09992b service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-vif-deleted-50d5fcc4-f01a-4f51-81a3-47410ef0bbdc {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:40:01 user nova-compute[73056]: INFO nova.compute.manager [req-90bfc146-a412-4033-8906-df35e7738e36 req-20abf8cb-cdfd-4a27-bbd2-132a5b09992b service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Neutron deleted interface 50d5fcc4-f01a-4f51-81a3-47410ef0bbdc; detaching it from the instance and deleting it from the info cache
Aug 14 16:40:01 user nova-compute[73056]: DEBUG nova.network.neutron [req-90bfc146-a412-4033-8906-df35e7738e36 req-20abf8cb-cdfd-4a27-bbd2-132a5b09992b service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Updating instance_info_cache with network_info: [{"id": "5240a3a2-cb9a-4df3-a1c1-0c4531c248ac", "address": "fa:16:3e:54:5a:4e", "network": {"id": "3a8c7fe6-c1b1-487d-ab15-2b884c3ab575", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1448848437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5240a3a2-cb", "ovs_interfaceid": "5240a3a2-cb9a-4df3-a1c1-0c4531c248ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7fd29069-06c5-41f5-b52c-64fd01fcff42", "address": "fa:16:3e:ec:52:7a", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fd29069-06", "ovs_interfaceid": "7fd29069-06c5-41f5-b52c-64fd01fcff42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b33c5c5b-fdb0-448c-a023-67de9d7f78fc", "address": "fa:16:3e:20:6a:96", "network": {"id": "24aecbb2-24c8-4f51-8728-700b1aeb9e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-1533703868", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "735e2905caf34b2fb25a17e674daca9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33c5c5b-fd", "ovs_interfaceid": "b33c5c5b-fdb0-448c-a023-67de9d7f78fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:40:01 user nova-compute[73056]: DEBUG nova.compute.manager [req-90bfc146-a412-4033-8906-df35e7738e36 req-20abf8cb-cdfd-4a27-bbd2-132a5b09992b service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Detach interface failed, port_id=50d5fcc4-f01a-4f51-81a3-47410ef0bbdc, reason: Instance 10d46e97-4721-49a0-beed-c022e9045b18 could not be found. {{(pid=73056) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 16:40:02 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:40:02 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Took 6.98 seconds to deallocate network for instance.
Aug 14 16:40:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:03 user nova-compute[73056]: DEBUG nova.compute.manager [req-c543ea76-5683-4177-8867-65a2403df248 req-4e0ef4b4-d3d9-4838-b13a-c631ac78450e service nova] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Received event network-vif-deleted-5240a3a2-cb9a-4df3-a1c1-0c4531c248ac {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:40:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:07 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692031192.6044166, 10d46e97-4721-49a0-beed-c022e9045b18 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:40:07 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] VM Stopped (Lifecycle Event)
Aug 14 16:40:07 user nova-compute[73056]: DEBUG nova.compute.manager [None req-335237fd-8f01-4f28-bf0a-7104b15cf039 None None] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:40:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:12 user nova-compute[73056]: INFO nova.compute.manager [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] [instance: 10d46e97-4721-49a0-beed-c022e9045b18] Took 10.60 seconds to detach 3 volumes for instance.
Aug 14 16:40:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:40:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:40:13 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:40:13 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:40:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.375s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:40:13 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Deleted allocations for instance 10d46e97-4721-49a0-beed-c022e9045b18
Aug 14 16:40:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-19c81526-452d-447a-b742-9b5e62140ce1 tempest-TaggedBootDevicesTest_v242-1746076092 tempest-TaggedBootDevicesTest_v242-1746076092-project-member] Lock "10d46e97-4721-49a0-beed-c022e9045b18" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 22.812s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:40:14 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-443775ee-66eb-4396-84b0-8d5582665a52 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Acquiring lock "9927d1d6-6e26-4408-b509-c96df5f314d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:40:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-443775ee-66eb-4396-84b0-8d5582665a52 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Lock "9927d1d6-6e26-4408-b509-c96df5f314d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:40:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-443775ee-66eb-4396-84b0-8d5582665a52 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Acquiring lock "9927d1d6-6e26-4408-b509-c96df5f314d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:40:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-443775ee-66eb-4396-84b0-8d5582665a52 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Lock "9927d1d6-6e26-4408-b509-c96df5f314d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:40:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-443775ee-66eb-4396-84b0-8d5582665a52 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Lock "9927d1d6-6e26-4408-b509-c96df5f314d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:40:16 user nova-compute[73056]: INFO nova.compute.manager [None req-443775ee-66eb-4396-84b0-8d5582665a52 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Terminating instance
Aug 14 16:40:16 user nova-compute[73056]: DEBUG nova.compute.manager [None req-443775ee-66eb-4396-84b0-8d5582665a52 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 16:40:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:16 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Instance destroyed successfully.
Aug 14 16:40:16 user nova-compute[73056]: DEBUG nova.objects.instance [None req-443775ee-66eb-4396-84b0-8d5582665a52 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Lazy-loading 'resources' on Instance uuid 9927d1d6-6e26-4408-b509-c96df5f314d6 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:40:16 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-443775ee-66eb-4396-84b0-8d5582665a52 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:36:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-754208431',display_name='tempest-TestVolumeSwap-server-754208431',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-754208431',id=6,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBQX4Xd7SD2D6XANTCY7NSXMHZmL+GTjGneCvhm/fPXDzcd9BFU1gT/lJt8cmLBBK0q/H7Lorr6sntdIrk2gATSxa6mmtEMEoe9aPeeyRKQxEwRFbFSpsFrWMlUsnU6HQ==',key_name='tempest-keypair-1513784064',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:36:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b35b1eb775b143e19a9d2fa193d946b9',ramdisk_id='',reservation_id='r-2qox5df2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1906153172',owner_user_name='tempest-TestVolumeSwap-1906153172-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:36:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05b6713fd6a7426a9cf2960272a30cd3',uuid=9927d1d6-6e26-4408-b509-c96df5f314d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f706d56a-af89-4224-ad47-4fc43bbebbfb", "address": "fa:16:3e:b2:34:a0", "network": {"id": "bf1db71c-8d0e-447f-bf4a-90a8bb7751e4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-592839111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b35b1eb775b143e19a9d2fa193d946b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf706d56a-af", "ovs_interfaceid": "f706d56a-af89-4224-ad47-4fc43bbebbfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:40:16 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-443775ee-66eb-4396-84b0-8d5582665a52 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Converting VIF {"id": "f706d56a-af89-4224-ad47-4fc43bbebbfb", "address": "fa:16:3e:b2:34:a0", "network": {"id": "bf1db71c-8d0e-447f-bf4a-90a8bb7751e4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-592839111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b35b1eb775b143e19a9d2fa193d946b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf706d56a-af", "ovs_interfaceid": "f706d56a-af89-4224-ad47-4fc43bbebbfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:40:16 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-443775ee-66eb-4396-84b0-8d5582665a52 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:34:a0,bridge_name='br-int',has_traffic_filtering=True,id=f706d56a-af89-4224-ad47-4fc43bbebbfb,network=Network(bf1db71c-8d0e-447f-bf4a-90a8bb7751e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf706d56a-af') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:40:16 user nova-compute[73056]: DEBUG os_vif [None req-443775ee-66eb-4396-84b0-8d5582665a52 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:34:a0,bridge_name='br-int',has_traffic_filtering=True,id=f706d56a-af89-4224-ad47-4fc43bbebbfb,network=Network(bf1db71c-8d0e-447f-bf4a-90a8bb7751e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf706d56a-af') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:40:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf706d56a-af, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:40:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:40:16 user nova-compute[73056]: INFO os_vif [None req-443775ee-66eb-4396-84b0-8d5582665a52 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:34:a0,bridge_name='br-int',has_traffic_filtering=True,id=f706d56a-af89-4224-ad47-4fc43bbebbfb,network=Network(bf1db71c-8d0e-447f-bf4a-90a8bb7751e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf706d56a-af')
Aug 14 16:40:16 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-443775ee-66eb-4396-84b0-8d5582665a52 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Deleting instance files /opt/stack/data/nova/instances/9927d1d6-6e26-4408-b509-c96df5f314d6_del
Aug 14 16:40:16 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-443775ee-66eb-4396-84b0-8d5582665a52 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Deletion of /opt/stack/data/nova/instances/9927d1d6-6e26-4408-b509-c96df5f314d6_del complete
Aug 14 16:40:16 user nova-compute[73056]: INFO nova.compute.manager [None req-443775ee-66eb-4396-84b0-8d5582665a52 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 14 16:40:16 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-443775ee-66eb-4396-84b0-8d5582665a52 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 16:40:16 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 16:40:16 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 16:40:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:18 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:40:18 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Took 1.47 seconds to deallocate network for instance.
Aug 14 16:40:18 user nova-compute[73056]: DEBUG nova.compute.manager [req-dfe87dc2-db6b-4acd-83a5-567715bb99c3 req-23e8a34b-f510-4048-88ae-2f9f673ef162 service nova] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Received event network-vif-deleted-f706d56a-af89-4224-ad47-4fc43bbebbfb {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:40:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-443775ee-66eb-4396-84b0-8d5582665a52 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:40:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-443775ee-66eb-4396-84b0-8d5582665a52 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:40:18 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-443775ee-66eb-4396-84b0-8d5582665a52 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:40:18 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-443775ee-66eb-4396-84b0-8d5582665a52 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:40:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-443775ee-66eb-4396-84b0-8d5582665a52 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.251s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:40:18 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-443775ee-66eb-4396-84b0-8d5582665a52 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Deleted allocations for instance 9927d1d6-6e26-4408-b509-c96df5f314d6
Aug 14 16:40:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-443775ee-66eb-4396-84b0-8d5582665a52 tempest-TestVolumeSwap-1906153172 tempest-TestVolumeSwap-1906153172-project-member] Lock "9927d1d6-6e26-4408-b509-c96df5f314d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.863s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:40:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:21 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:22 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:22 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:26 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Acquiring lock "a329b987-231e-47a8-9f2d-71c15573f9f0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:40:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lock "a329b987-231e-47a8-9f2d-71c15573f9f0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:40:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Acquiring lock "a329b987-231e-47a8-9f2d-71c15573f9f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:40:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lock "a329b987-231e-47a8-9f2d-71c15573f9f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:40:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lock "a329b987-231e-47a8-9f2d-71c15573f9f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:40:27 user nova-compute[73056]: INFO nova.compute.manager [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Terminating instance
Aug 14 16:40:27 user nova-compute[73056]: DEBUG nova.compute.manager [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 16:40:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG nova.compute.manager [req-db3e1fcb-48ea-455a-8465-69f44ac4d3fb req-8c4f41a9-8ad0-4f2d-b73a-096c51b38883 service nova] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Received event network-vif-unplugged-17d6adb4-b6f5-4c34-936d-35d1a4920106 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-db3e1fcb-48ea-455a-8465-69f44ac4d3fb req-8c4f41a9-8ad0-4f2d-b73a-096c51b38883 service nova] Acquiring lock "a329b987-231e-47a8-9f2d-71c15573f9f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-db3e1fcb-48ea-455a-8465-69f44ac4d3fb req-8c4f41a9-8ad0-4f2d-b73a-096c51b38883 service nova] Lock "a329b987-231e-47a8-9f2d-71c15573f9f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-db3e1fcb-48ea-455a-8465-69f44ac4d3fb req-8c4f41a9-8ad0-4f2d-b73a-096c51b38883 service nova] Lock "a329b987-231e-47a8-9f2d-71c15573f9f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG nova.compute.manager [req-db3e1fcb-48ea-455a-8465-69f44ac4d3fb req-8c4f41a9-8ad0-4f2d-b73a-096c51b38883 service nova] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] No waiting events found dispatching network-vif-unplugged-17d6adb4-b6f5-4c34-936d-35d1a4920106 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG nova.compute.manager [req-db3e1fcb-48ea-455a-8465-69f44ac4d3fb req-8c4f41a9-8ad0-4f2d-b73a-096c51b38883 service nova] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Received event network-vif-unplugged-17d6adb4-b6f5-4c34-936d-35d1a4920106 for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:40:28 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Instance destroyed successfully.
Aug 14 16:40:28 user nova-compute[73056]: DEBUG nova.objects.instance [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lazy-loading 'resources' on Instance uuid a329b987-231e-47a8-9f2d-71c15573f9f0 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T16:36:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2031154332',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-816611793',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrF6zQFCvY9I3Tx9Li4l8oLTxmzYxKp1UXPWnmTcCEWQmNrSST0nsa4EPNdzwiM8Sv72y8YAykbLtymkPXgs3ARLo+xvw/dSjjcHO5qsCxzDKWOJT1CHZ5oKqFnSSvojQ==',key_name='tempest-keypair-1364462886',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:39:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='858651f51ffd49a48f3e98e7de4d87e3',ramdisk_id='',reservation_id='r-2hejxwxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-153336784',owner_user_name='tempest-ServerActionsV293TestJSON-153336784-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:39:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da42a829953a49519d1e52647597e48a',uuid=a329b987-231e-47a8-9f2d-71c15573f9f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "17d6adb4-b6f5-4c34-936d-35d1a4920106", "address": "fa:16:3e:b5:bf:bb", "network": {"id": "e6b5cbb1-4f9c-4d4e-9a5a-c6b9fb6f2c0a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-787940559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "858651f51ffd49a48f3e98e7de4d87e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d6adb4-b6", "ovs_interfaceid": "17d6adb4-b6f5-4c34-936d-35d1a4920106", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Converting VIF {"id": "17d6adb4-b6f5-4c34-936d-35d1a4920106", "address": "fa:16:3e:b5:bf:bb", "network": {"id": "e6b5cbb1-4f9c-4d4e-9a5a-c6b9fb6f2c0a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-787940559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "858651f51ffd49a48f3e98e7de4d87e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d6adb4-b6", "ovs_interfaceid": "17d6adb4-b6f5-4c34-936d-35d1a4920106", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:bf:bb,bridge_name='br-int',has_traffic_filtering=True,id=17d6adb4-b6f5-4c34-936d-35d1a4920106,network=Network(e6b5cbb1-4f9c-4d4e-9a5a-c6b9fb6f2c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17d6adb4-b6') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG os_vif [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:bf:bb,bridge_name='br-int',has_traffic_filtering=True,id=17d6adb4-b6f5-4c34-936d-35d1a4920106,network=Network(e6b5cbb1-4f9c-4d4e-9a5a-c6b9fb6f2c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17d6adb4-b6') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap17d6adb4-b6, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:40:28 user nova-compute[73056]: INFO os_vif [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:bf:bb,bridge_name='br-int',has_traffic_filtering=True,id=17d6adb4-b6f5-4c34-936d-35d1a4920106,network=Network(e6b5cbb1-4f9c-4d4e-9a5a-c6b9fb6f2c0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17d6adb4-b6')
Aug 14 16:40:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mCfQgvrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:40:28 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:40:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5e7a08-4476-4d55-932a-cdf021c01cf0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b2b7ba-8a5a-4edf-8cc5-b59af978c5a5]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:40:28 user nova-compute[73056]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)
Aug 14 16:40:28 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 (non-flash)
Aug 14 16:40:28 user nova-compute[73056]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)
Aug 14 16:40:28 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff2dcfb3e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4'): ({'sdd'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Removing single pathed devices sdd {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f383f3-92c2-40af-9a05-478ea2b65bd7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9f6a5b-d16e-4d28-833c-ef952a296508]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Flushing IO for device /dev/sdd {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fd9511-5af8-4243-87da-25d2c0f42f73]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcada6c-e366-42f4-a46a-b49d1b7c3319]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] SCSI volumes sdd have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe5d26d28-d658bbc55343c56a', '/dev/disk/by-id/scsi-26436353862626335', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e5d26d28') {{(pid=83519) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2d410b-54de-40a1-82b2-a4b50541f7c6]: (4, None) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af68239-5be6-4265-b0ee-bc959bf01973]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e0923b-11b3-40a6-b61f-0397fb16ee29]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4, portal: 172.16.0.220,3260]
Aug 14 16:40:28 user nova-compute[73056]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4, portal: 172.16.0.220,3260] successful.
Aug 14 16:40:28 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:663decc6-865c-4b8c-90f2-d6c4918e27d4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[36546cc4-3ec0-429b-9935-cfc3e9f0f4d0]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] <== disconnect_volume: return (330ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:40:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:40:28 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Deleting instance files /opt/stack/data/nova/instances/a329b987-231e-47a8-9f2d-71c15573f9f0_del
Aug 14 16:40:28 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Deletion of /opt/stack/data/nova/instances/a329b987-231e-47a8-9f2d-71c15573f9f0_del complete
Aug 14 16:40:29 user nova-compute[73056]: INFO nova.compute.manager [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Took 1.25 seconds to destroy the instance on the hypervisor.
Aug 14 16:40:29 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 16:40:29 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 16:40:29 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 16:40:30 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:40:30 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Took 1.20 seconds to deallocate network for instance.
Aug 14 16:40:30 user nova-compute[73056]: DEBUG nova.compute.manager [req-e651aefa-d550-4d60-a0d1-639574b86dde req-1cc63287-9e23-42e5-b5bd-9e0e1ff66a8f service nova] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Received event network-vif-plugged-17d6adb4-b6f5-4c34-936d-35d1a4920106 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:40:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e651aefa-d550-4d60-a0d1-639574b86dde req-1cc63287-9e23-42e5-b5bd-9e0e1ff66a8f service nova] Acquiring lock "a329b987-231e-47a8-9f2d-71c15573f9f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:40:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e651aefa-d550-4d60-a0d1-639574b86dde req-1cc63287-9e23-42e5-b5bd-9e0e1ff66a8f service nova] Lock "a329b987-231e-47a8-9f2d-71c15573f9f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:40:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e651aefa-d550-4d60-a0d1-639574b86dde req-1cc63287-9e23-42e5-b5bd-9e0e1ff66a8f service nova] Lock "a329b987-231e-47a8-9f2d-71c15573f9f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:40:30 user nova-compute[73056]: DEBUG nova.compute.manager [req-e651aefa-d550-4d60-a0d1-639574b86dde req-1cc63287-9e23-42e5-b5bd-9e0e1ff66a8f service nova] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] No waiting events found dispatching network-vif-plugged-17d6adb4-b6f5-4c34-936d-35d1a4920106 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:40:30 user nova-compute[73056]: WARNING nova.compute.manager [req-e651aefa-d550-4d60-a0d1-639574b86dde req-1cc63287-9e23-42e5-b5bd-9e0e1ff66a8f service nova] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Received unexpected event network-vif-plugged-17d6adb4-b6f5-4c34-936d-35d1a4920106 for instance with vm_state active and task_state deleting.
Aug 14 16:40:30 user nova-compute[73056]: DEBUG nova.compute.manager [req-e651aefa-d550-4d60-a0d1-639574b86dde req-1cc63287-9e23-42e5-b5bd-9e0e1ff66a8f service nova] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Received event network-vif-deleted-17d6adb4-b6f5-4c34-936d-35d1a4920106 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:40:31 user nova-compute[73056]: INFO nova.compute.manager [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Took 0.96 seconds to detach 1 volumes for instance.
Aug 14 16:40:31 user nova-compute[73056]: DEBUG nova.compute.manager [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Deleting volume: 663decc6-865c-4b8c-90f2-d6c4918e27d4 {{(pid=73056) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 16:40:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:40:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:40:31 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:40:31 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:40:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.297s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:40:31 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Deleted allocations for instance a329b987-231e-47a8-9f2d-71c15573f9f0
Aug 14 16:40:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ed1c0f56-d9ca-4228-937b-343dfecd40ce tempest-ServerActionsV293TestJSON-153336784 tempest-ServerActionsV293TestJSON-153336784-project-member] Lock "a329b987-231e-47a8-9f2d-71c15573f9f0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.032s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:40:31 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692031216.845639, 9927d1d6-6e26-4408-b509-c96df5f314d6 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:40:31 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] VM Stopped (Lifecycle Event)
Aug 14 16:40:31 user nova-compute[73056]: DEBUG nova.compute.manager [None req-6769863a-9857-43cd-9939-13b88597ff53 None None] [instance: 9927d1d6-6e26-4408-b509-c96df5f314d6] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:40:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:34 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Acquiring lock "18008990-9ed6-46e5-805c-4475e58855a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:40:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lock "18008990-9ed6-46e5-805c-4475e58855a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:40:37 user nova-compute[73056]: DEBUG nova.compute.manager [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:40:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:40:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:40:37 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:40:37 user nova-compute[73056]: INFO nova.compute.claims [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Claim successful on node user
Aug 14 16:40:37 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:37 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:40:37 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:40:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.368s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:40:37 user nova-compute[73056]: DEBUG nova.compute.manager [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:40:37 user nova-compute[73056]: DEBUG nova.compute.manager [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:40:37 user nova-compute[73056]: DEBUG nova.network.neutron [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:40:37 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:40:37 user nova-compute[73056]: DEBUG nova.compute.manager [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:40:38 user nova-compute[73056]: DEBUG nova.policy [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '333c53f1db334c3aad3b1c7dca862e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc25a4854a194e9283b568768daea226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:40:38 user nova-compute[73056]: DEBUG nova.compute.manager [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:40:38 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:40:38 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Creating image(s)
Aug 14 16:40:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Acquiring lock "/opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:40:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lock "/opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:40:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lock "/opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:40:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.216s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Acquiring lock "c889592ab94cd0b0ce896f27a2af0323771db234" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:40:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:40:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.234s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/disk 1073741824" returned: 0 in 0.060s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:40:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:38 user nova-compute[73056]: DEBUG nova.network.neutron [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Successfully created port: 90cb9090-537a-414e-ac09-1893281186c2 {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:40:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.197s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:38 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Checking if we can resize image /opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 16:40:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:38 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Cannot resize image /opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 16:40:38 user nova-compute[73056]: DEBUG nova.objects.instance [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lazy-loading 'migration_context' on Instance uuid 18008990-9ed6-46e5-805c-4475e58855a6 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:40:39 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 16:40:39 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Ensure instance console log exists: /opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:40:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:40:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:40:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:40:39 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:39 user nova-compute[73056]: DEBUG nova.network.neutron [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Successfully updated port: 90cb9090-537a-414e-ac09-1893281186c2 {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:40:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Acquiring lock "refresh_cache-18008990-9ed6-46e5-805c-4475e58855a6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:40:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Acquired lock "refresh_cache-18008990-9ed6-46e5-805c-4475e58855a6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:40:39 user nova-compute[73056]: DEBUG nova.network.neutron [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:40:39 user nova-compute[73056]: DEBUG nova.compute.manager [req-360616f4-9781-4962-8814-13a7cec9e4f0 req-4b3b4879-685c-4f51-a55c-9d89d7b6a85c service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Received event network-changed-90cb9090-537a-414e-ac09-1893281186c2 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:40:39 user nova-compute[73056]: DEBUG nova.compute.manager [req-360616f4-9781-4962-8814-13a7cec9e4f0 req-4b3b4879-685c-4f51-a55c-9d89d7b6a85c service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Refreshing instance network info cache due to event network-changed-90cb9090-537a-414e-ac09-1893281186c2. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:40:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-360616f4-9781-4962-8814-13a7cec9e4f0 req-4b3b4879-685c-4f51-a55c-9d89d7b6a85c service nova] Acquiring lock "refresh_cache-18008990-9ed6-46e5-805c-4475e58855a6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:40:39 user nova-compute[73056]: DEBUG nova.network.neutron [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG nova.network.neutron [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Updating instance_info_cache with network_info: [{"id": "90cb9090-537a-414e-ac09-1893281186c2", "address": "fa:16:3e:f2:46:30", "network": {"id": "d4aa57ea-03bd-491a-9861-e52c142e083c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1629351750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc25a4854a194e9283b568768daea226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90cb9090-53", "ovs_interfaceid": "90cb9090-537a-414e-ac09-1893281186c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Releasing lock "refresh_cache-18008990-9ed6-46e5-805c-4475e58855a6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG nova.compute.manager [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Instance network_info: |[{"id": "90cb9090-537a-414e-ac09-1893281186c2", "address": "fa:16:3e:f2:46:30", "network": {"id": "d4aa57ea-03bd-491a-9861-e52c142e083c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1629351750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc25a4854a194e9283b568768daea226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90cb9090-53", "ovs_interfaceid": "90cb9090-537a-414e-ac09-1893281186c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-360616f4-9781-4962-8814-13a7cec9e4f0 req-4b3b4879-685c-4f51-a55c-9d89d7b6a85c service nova] Acquired lock "refresh_cache-18008990-9ed6-46e5-805c-4475e58855a6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG nova.network.neutron [req-360616f4-9781-4962-8814-13a7cec9e4f0 req-4b3b4879-685c-4f51-a55c-9d89d7b6a85c service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Refreshing network info cache for port 90cb9090-537a-414e-ac09-1893281186c2 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Start _get_guest_xml network_info=[{"id": "90cb9090-537a-414e-ac09-1893281186c2", "address": "fa:16:3e:f2:46:30", "network": {"id": "d4aa57ea-03bd-491a-9861-e52c142e083c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1629351750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc25a4854a194e9283b568768daea226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90cb9090-53", "ovs_interfaceid": "90cb9090-537a-414e-ac09-1893281186c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:40:40 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:40:40 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:40:40 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:40:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-208719382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-208719382',id=14,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHcJB5Em/BEdrrn+3nBSCQk8RXjQ9vXtMOi9k99zFp25ODkL4n/iUoo0VukLAcCxol9GBK/BdSObNT2aRPP96ToqXFULMlclvIpuOcZpv+502q1tzSo+JKq19K8Nkl5pQ==',key_name='tempest-keypair-370895944',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc25a4854a194e9283b568768daea226',ramdisk_id='',reservation_id='r-pde63aya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1768493659',owner_user_name='tempest-TaggedAttachmentsTest-1768493659-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:40:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='333c53f1db334c3aad3b1c7dca862e74',uuid=18008990-9ed6-46e5-805c-4475e58855a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90cb9090-537a-414e-ac09-1893281186c2", "address": "fa:16:3e:f2:46:30", "network": {"id": "d4aa57ea-03bd-491a-9861-e52c142e083c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1629351750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc25a4854a194e9283b568768daea226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90cb9090-53", "ovs_interfaceid": "90cb9090-537a-414e-ac09-1893281186c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Converting VIF {"id": "90cb9090-537a-414e-ac09-1893281186c2", "address": "fa:16:3e:f2:46:30", "network": {"id": "d4aa57ea-03bd-491a-9861-e52c142e083c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1629351750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc25a4854a194e9283b568768daea226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90cb9090-53", "ovs_interfaceid": "90cb9090-537a-414e-ac09-1893281186c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:46:30,bridge_name='br-int',has_traffic_filtering=True,id=90cb9090-537a-414e-ac09-1893281186c2,network=Network(d4aa57ea-03bd-491a-9861-e52c142e083c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90cb9090-53') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG nova.objects.instance [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lazy-loading 'pci_devices' on Instance uuid 18008990-9ed6-46e5-805c-4475e58855a6 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:40:40 user nova-compute[73056]:   <uuid>18008990-9ed6-46e5-805c-4475e58855a6</uuid>
Aug 14 16:40:40 user nova-compute[73056]:   <name>instance-0000000e</name>
Aug 14 16:40:40 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:40:40 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:40:40 user nova-compute[73056]:   <metadata>
Aug 14 16:40:40 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:40:40 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:40:40 user nova-compute[73056]:       <nova:name>tempest-device-tagging-server-208719382</nova:name>
Aug 14 16:40:40 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:40:40</nova:creationTime>
Aug 14 16:40:40 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:40:40 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:40:40 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:40:40 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:40:40 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:40:40 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:40:40 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:40:40 user nova-compute[73056]:       <nova:owner>
Aug 14 16:40:40 user nova-compute[73056]:         <nova:user uuid="333c53f1db334c3aad3b1c7dca862e74">tempest-TaggedAttachmentsTest-1768493659-project-member</nova:user>
Aug 14 16:40:40 user nova-compute[73056]:         <nova:project uuid="bc25a4854a194e9283b568768daea226">tempest-TaggedAttachmentsTest-1768493659</nova:project>
Aug 14 16:40:40 user nova-compute[73056]:       </nova:owner>
Aug 14 16:40:40 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:40:40 user nova-compute[73056]:       <nova:ports>
Aug 14 16:40:40 user nova-compute[73056]:         <nova:port uuid="90cb9090-537a-414e-ac09-1893281186c2">
Aug 14 16:40:40 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 14 16:40:40 user nova-compute[73056]:         </nova:port>
Aug 14 16:40:40 user nova-compute[73056]:       </nova:ports>
Aug 14 16:40:40 user nova-compute[73056]:     </nova:instance>
Aug 14 16:40:40 user nova-compute[73056]:   </metadata>
Aug 14 16:40:40 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:40:40 user nova-compute[73056]:     <system>
Aug 14 16:40:40 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:40:40 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:40:40 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:40:40 user nova-compute[73056]:       <entry name="serial">18008990-9ed6-46e5-805c-4475e58855a6</entry>
Aug 14 16:40:40 user nova-compute[73056]:       <entry name="uuid">18008990-9ed6-46e5-805c-4475e58855a6</entry>
Aug 14 16:40:40 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:40:40 user nova-compute[73056]:     </system>
Aug 14 16:40:40 user nova-compute[73056]:   </sysinfo>
Aug 14 16:40:40 user nova-compute[73056]:   <os>
Aug 14 16:40:40 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:40:40 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:40:40 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:40:40 user nova-compute[73056]:   </os>
Aug 14 16:40:40 user nova-compute[73056]:   <features>
Aug 14 16:40:40 user nova-compute[73056]:     <acpi/>
Aug 14 16:40:40 user nova-compute[73056]:     <apic/>
Aug 14 16:40:40 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:40:40 user nova-compute[73056]:   </features>
Aug 14 16:40:40 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:40:40 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:40:40 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:40:40 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:40:40 user nova-compute[73056]:   </clock>
Aug 14 16:40:40 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:40:40 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:40:40 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:40:40 user nova-compute[73056]:   </cpu>
Aug 14 16:40:40 user nova-compute[73056]:   <devices>
Aug 14 16:40:40 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:40:40 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:40:40 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/disk"/>
Aug 14 16:40:40 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:40:40 user nova-compute[73056]:     </disk>
Aug 14 16:40:40 user nova-compute[73056]:     <disk type="file" device="cdrom">
Aug 14 16:40:40 user nova-compute[73056]:       <driver name="qemu" type="raw" cache="none"/>
Aug 14 16:40:40 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/disk.config"/>
Aug 14 16:40:40 user nova-compute[73056]:       <target dev="hda" bus="ide"/>
Aug 14 16:40:40 user nova-compute[73056]:     </disk>
Aug 14 16:40:40 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:40:40 user nova-compute[73056]:       <mac address="fa:16:3e:f2:46:30"/>
Aug 14 16:40:40 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:40:40 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:40:40 user nova-compute[73056]:       <target dev="tap90cb9090-53"/>
Aug 14 16:40:40 user nova-compute[73056]:     </interface>
Aug 14 16:40:40 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:40:40 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/console.log" append="off"/>
Aug 14 16:40:40 user nova-compute[73056]:     </serial>
Aug 14 16:40:40 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:40:40 user nova-compute[73056]:     <video>
Aug 14 16:40:40 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:40:40 user nova-compute[73056]:     </video>
Aug 14 16:40:40 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:40:40 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:40:40 user nova-compute[73056]:     </rng>
Aug 14 16:40:40 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:40:40 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:40:40 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:40:40 user nova-compute[73056]:     </memballoon>
Aug 14 16:40:40 user nova-compute[73056]:   </devices>
Aug 14 16:40:40 user nova-compute[73056]: </domain>
Aug 14 16:40:40 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:40:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-208719382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-208719382',id=14,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHcJB5Em/BEdrrn+3nBSCQk8RXjQ9vXtMOi9k99zFp25ODkL4n/iUoo0VukLAcCxol9GBK/BdSObNT2aRPP96ToqXFULMlclvIpuOcZpv+502q1tzSo+JKq19K8Nkl5pQ==',key_name='tempest-keypair-370895944',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc25a4854a194e9283b568768daea226',ramdisk_id='',reservation_id='r-pde63aya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1768493659',owner_user_name='tempest-TaggedAttachmentsTest-1768493659-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:40:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='333c53f1db334c3aad3b1c7dca862e74',uuid=18008990-9ed6-46e5-805c-4475e58855a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90cb9090-537a-414e-ac09-1893281186c2", "address": "fa:16:3e:f2:46:30", "network": {"id": "d4aa57ea-03bd-491a-9861-e52c142e083c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1629351750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc25a4854a194e9283b568768daea226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90cb9090-53", "ovs_interfaceid": "90cb9090-537a-414e-ac09-1893281186c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Converting VIF {"id": "90cb9090-537a-414e-ac09-1893281186c2", "address": "fa:16:3e:f2:46:30", "network": {"id": "d4aa57ea-03bd-491a-9861-e52c142e083c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1629351750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc25a4854a194e9283b568768daea226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90cb9090-53", "ovs_interfaceid": "90cb9090-537a-414e-ac09-1893281186c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:46:30,bridge_name='br-int',has_traffic_filtering=True,id=90cb9090-537a-414e-ac09-1893281186c2,network=Network(d4aa57ea-03bd-491a-9861-e52c142e083c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90cb9090-53') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG os_vif [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:46:30,bridge_name='br-int',has_traffic_filtering=True,id=90cb9090-537a-414e-ac09-1893281186c2,network=Network(d4aa57ea-03bd-491a-9861-e52c142e083c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90cb9090-53') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90cb9090-53, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap90cb9090-53, col_values=(('external_ids', {'iface-id': '90cb9090-537a-414e-ac09-1893281186c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:46:30', 'vm-uuid': '18008990-9ed6-46e5-805c-4475e58855a6'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:40 user nova-compute[73056]: INFO os_vif [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:46:30,bridge_name='br-int',has_traffic_filtering=True,id=90cb9090-537a-414e-ac09-1893281186c2,network=Network(d4aa57ea-03bd-491a-9861-e52c142e083c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90cb9090-53')
Aug 14 16:40:40 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] No BDM found with device name hda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] No VIF found with MAC fa:16:3e:f2:46:30, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:40:40 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Using config drive
Aug 14 16:40:40 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Creating config drive at /opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/disk.config
Aug 14 16:40:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpgrj2_b7q {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpgrj2_b7q" returned: 0 in 0.052s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:41 user nova-compute[73056]: DEBUG nova.network.neutron [req-360616f4-9781-4962-8814-13a7cec9e4f0 req-4b3b4879-685c-4f51-a55c-9d89d7b6a85c service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Updated VIF entry in instance network info cache for port 90cb9090-537a-414e-ac09-1893281186c2. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:40:41 user nova-compute[73056]: DEBUG nova.network.neutron [req-360616f4-9781-4962-8814-13a7cec9e4f0 req-4b3b4879-685c-4f51-a55c-9d89d7b6a85c service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Updating instance_info_cache with network_info: [{"id": "90cb9090-537a-414e-ac09-1893281186c2", "address": "fa:16:3e:f2:46:30", "network": {"id": "d4aa57ea-03bd-491a-9861-e52c142e083c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1629351750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc25a4854a194e9283b568768daea226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90cb9090-53", "ovs_interfaceid": "90cb9090-537a-414e-ac09-1893281186c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:40:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-360616f4-9781-4962-8814-13a7cec9e4f0 req-4b3b4879-685c-4f51-a55c-9d89d7b6a85c service nova] Releasing lock "refresh_cache-18008990-9ed6-46e5-805c-4475e58855a6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:40:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:42 user nova-compute[73056]: DEBUG nova.compute.manager [req-5075552f-0727-42f6-928f-0e831b9b16d1 req-47db02ab-c36e-4281-bc24-c64196127a45 service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Received event network-vif-plugged-90cb9090-537a-414e-ac09-1893281186c2 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:40:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-5075552f-0727-42f6-928f-0e831b9b16d1 req-47db02ab-c36e-4281-bc24-c64196127a45 service nova] Acquiring lock "18008990-9ed6-46e5-805c-4475e58855a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:40:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-5075552f-0727-42f6-928f-0e831b9b16d1 req-47db02ab-c36e-4281-bc24-c64196127a45 service nova] Lock "18008990-9ed6-46e5-805c-4475e58855a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:40:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-5075552f-0727-42f6-928f-0e831b9b16d1 req-47db02ab-c36e-4281-bc24-c64196127a45 service nova] Lock "18008990-9ed6-46e5-805c-4475e58855a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:40:42 user nova-compute[73056]: DEBUG nova.compute.manager [req-5075552f-0727-42f6-928f-0e831b9b16d1 req-47db02ab-c36e-4281-bc24-c64196127a45 service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] No waiting events found dispatching network-vif-plugged-90cb9090-537a-414e-ac09-1893281186c2 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:40:42 user nova-compute[73056]: WARNING nova.compute.manager [req-5075552f-0727-42f6-928f-0e831b9b16d1 req-47db02ab-c36e-4281-bc24-c64196127a45 service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Received unexpected event network-vif-plugged-90cb9090-537a-414e-ac09-1893281186c2 for instance with vm_state building and task_state spawning.
Aug 14 16:40:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:43 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692031228.584041, a329b987-231e-47a8-9f2d-71c15573f9f0 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:40:43 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] VM Stopped (Lifecycle Event)
Aug 14 16:40:43 user nova-compute[73056]: DEBUG nova.compute.manager [None req-6e6e874c-efdf-4c76-8269-06527ae9088f None None] [instance: a329b987-231e-47a8-9f2d-71c15573f9f0] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:40:44 user nova-compute[73056]: DEBUG nova.compute.manager [req-de82f0d5-8d97-41f0-a0d2-3263e9bd7dff req-69c5fceb-e02c-4921-9e92-793ebc12335a service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Received event network-vif-plugged-90cb9090-537a-414e-ac09-1893281186c2 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:40:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-de82f0d5-8d97-41f0-a0d2-3263e9bd7dff req-69c5fceb-e02c-4921-9e92-793ebc12335a service nova] Acquiring lock "18008990-9ed6-46e5-805c-4475e58855a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:40:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-de82f0d5-8d97-41f0-a0d2-3263e9bd7dff req-69c5fceb-e02c-4921-9e92-793ebc12335a service nova] Lock "18008990-9ed6-46e5-805c-4475e58855a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:40:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-de82f0d5-8d97-41f0-a0d2-3263e9bd7dff req-69c5fceb-e02c-4921-9e92-793ebc12335a service nova] Lock "18008990-9ed6-46e5-805c-4475e58855a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:40:44 user nova-compute[73056]: DEBUG nova.compute.manager [req-de82f0d5-8d97-41f0-a0d2-3263e9bd7dff req-69c5fceb-e02c-4921-9e92-793ebc12335a service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] No waiting events found dispatching network-vif-plugged-90cb9090-537a-414e-ac09-1893281186c2 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:40:44 user nova-compute[73056]: WARNING nova.compute.manager [req-de82f0d5-8d97-41f0-a0d2-3263e9bd7dff req-69c5fceb-e02c-4921-9e92-793ebc12335a service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Received unexpected event network-vif-plugged-90cb9090-537a-414e-ac09-1893281186c2 for instance with vm_state building and task_state spawning.
Aug 14 16:40:44 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031244.8427608, 18008990-9ed6-46e5-805c-4475e58855a6 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:40:44 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] VM Resumed (Lifecycle Event)
Aug 14 16:40:44 user nova-compute[73056]: DEBUG nova.compute.manager [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:40:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:40:44 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:40:44 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Instance spawned successfully.
Aug 14 16:40:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:40:44 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:40:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:40:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:40:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:40:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:40:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:40:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:40:44 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:40:44 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031244.8539605, 18008990-9ed6-46e5-805c-4475e58855a6 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:40:44 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] VM Started (Lifecycle Event)
Aug 14 16:40:44 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:40:44 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:40:44 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:40:45 user nova-compute[73056]: INFO nova.compute.manager [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Took 7.08 seconds to spawn the instance on the hypervisor.
Aug 14 16:40:45 user nova-compute[73056]: DEBUG nova.compute.manager [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:40:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Acquiring lock "4731f355-9307-4176-910b-cf35beb85e75" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:40:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lock "4731f355-9307-4176-910b-cf35beb85e75" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:40:45 user nova-compute[73056]: INFO nova.compute.manager [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Took 7.85 seconds to build instance.
Aug 14 16:40:45 user nova-compute[73056]: DEBUG nova.compute.manager [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:40:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a5d0bd33-ec92-4076-aeec-edfc828d496c tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lock "18008990-9ed6-46e5-805c-4475e58855a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.965s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:40:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:40:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:40:45 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:40:45 user nova-compute[73056]: INFO nova.compute.claims [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Claim successful on node user
Aug 14 16:40:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:45 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:40:45 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:40:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.489s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:40:45 user nova-compute[73056]: DEBUG nova.compute.manager [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:40:45 user nova-compute[73056]: DEBUG nova.compute.manager [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:40:45 user nova-compute[73056]: DEBUG nova.network.neutron [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:40:46 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:40:46 user nova-compute[73056]: DEBUG nova.compute.manager [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:40:46 user nova-compute[73056]: DEBUG nova.policy [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a3fcea40a59c402ca0fa47cadc0c0e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5d50a2601044b5aef50a0d0c6e311a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:40:46 user nova-compute[73056]: DEBUG nova.compute.manager [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:40:46 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:40:46 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Creating image(s)
Aug 14 16:40:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Acquiring lock "/opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:40:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lock "/opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:40:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lock "/opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:40:46 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:46 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.191s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Acquiring lock "c889592ab94cd0b0ce896f27a2af0323771db234" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:40:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:40:46 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:46 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.223s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:46 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:46 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk 1073741824" returned: 0 in 0.065s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:40:46 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:46 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.186s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:46 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 16:40:46 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:47 user nova-compute[73056]: DEBUG nova.network.neutron [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Successfully created port: 83386dcc-c4f0-49aa-8bd0-43fd3b202c46 {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:40:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:47 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Cannot resize image /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 16:40:47 user nova-compute[73056]: DEBUG nova.objects.instance [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lazy-loading 'migration_context' on Instance uuid 4731f355-9307-4176-910b-cf35beb85e75 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:40:47 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 16:40:47 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Ensure instance console log exists: /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:40:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:40:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:40:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:40:47 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:40:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG nova.network.neutron [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Successfully updated port: 83386dcc-c4f0-49aa-8bd0-43fd3b202c46 {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Acquiring lock "refresh_cache-4731f355-9307-4176-910b-cf35beb85e75" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Acquired lock "refresh_cache-4731f355-9307-4176-910b-cf35beb85e75" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG nova.network.neutron [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG nova.compute.manager [req-ea53f8e1-70d4-413f-a395-70c865d84ada req-9aa243d9-aebb-4788-a8fc-ad5174f52dfa service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Received event network-changed-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG nova.compute.manager [req-ea53f8e1-70d4-413f-a395-70c865d84ada req-9aa243d9-aebb-4788-a8fc-ad5174f52dfa service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Refreshing instance network info cache due to event network-changed-83386dcc-c4f0-49aa-8bd0-43fd3b202c46. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ea53f8e1-70d4-413f-a395-70c865d84ada req-9aa243d9-aebb-4788-a8fc-ad5174f52dfa service nova] Acquiring lock "refresh_cache-4731f355-9307-4176-910b-cf35beb85e75" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG nova.network.neutron [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG nova.network.neutron [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Updating instance_info_cache with network_info: [{"id": "83386dcc-c4f0-49aa-8bd0-43fd3b202c46", "address": "fa:16:3e:2d:f9:8e", "network": {"id": "cf5d30f2-97c6-4785-83d2-549eeb6eca88", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1151628801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd5d50a2601044b5aef50a0d0c6e311a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83386dcc-c4", "ovs_interfaceid": "83386dcc-c4f0-49aa-8bd0-43fd3b202c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Releasing lock "refresh_cache-4731f355-9307-4176-910b-cf35beb85e75" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG nova.compute.manager [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Instance network_info: |[{"id": "83386dcc-c4f0-49aa-8bd0-43fd3b202c46", "address": "fa:16:3e:2d:f9:8e", "network": {"id": "cf5d30f2-97c6-4785-83d2-549eeb6eca88", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1151628801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd5d50a2601044b5aef50a0d0c6e311a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83386dcc-c4", "ovs_interfaceid": "83386dcc-c4f0-49aa-8bd0-43fd3b202c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ea53f8e1-70d4-413f-a395-70c865d84ada req-9aa243d9-aebb-4788-a8fc-ad5174f52dfa service nova] Acquired lock "refresh_cache-4731f355-9307-4176-910b-cf35beb85e75" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG nova.network.neutron [req-ea53f8e1-70d4-413f-a395-70c865d84ada req-9aa243d9-aebb-4788-a8fc-ad5174f52dfa service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Refreshing network info cache for port 83386dcc-c4f0-49aa-8bd0-43fd3b202c46 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Start _get_guest_xml network_info=[{"id": "83386dcc-c4f0-49aa-8bd0-43fd3b202c46", "address": "fa:16:3e:2d:f9:8e", "network": {"id": "cf5d30f2-97c6-4785-83d2-549eeb6eca88", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1151628801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd5d50a2601044b5aef50a0d0c6e311a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83386dcc-c4", "ovs_interfaceid": "83386dcc-c4f0-49aa-8bd0-43fd3b202c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:40:48 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:40:48 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:40:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1469159950',display_name='tempest-ServerStableDeviceRescueTest-server-1469159950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1469159950',id=15,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBQNxWg7OUFhWDQI9/wLnHn2nbEn9G6E26h3WdcqE+rXscJRVMjpTW2ni6zhMvgbqQhJ+9ECYhu3ChirXTVDZRVv933jeqBHwG9oVjz7+R20pljc2XSQT8462fqM4Z3mA==',key_name='tempest-keypair-610798452',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd5d50a2601044b5aef50a0d0c6e311a',ramdisk_id='',reservation_id='r-hqhusr42',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-759559269',owner_user_name='tempest-ServerStableDeviceRescueTest-759559269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:40:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3fcea40a59c402ca0fa47cadc0c0e98',uuid=4731f355-9307-4176-910b-cf35beb85e75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83386dcc-c4f0-49aa-8bd0-43fd3b202c46", "address": "fa:16:3e:2d:f9:8e", "network": {"id": "cf5d30f2-97c6-4785-83d2-549eeb6eca88", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1151628801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd5d50a2601044b5aef50a0d0c6e311a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83386dcc-c4", "ovs_interfaceid": "83386dcc-c4f0-49aa-8bd0-43fd3b202c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Converting VIF {"id": "83386dcc-c4f0-49aa-8bd0-43fd3b202c46", "address": "fa:16:3e:2d:f9:8e", "network": {"id": "cf5d30f2-97c6-4785-83d2-549eeb6eca88", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1151628801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd5d50a2601044b5aef50a0d0c6e311a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83386dcc-c4", "ovs_interfaceid": "83386dcc-c4f0-49aa-8bd0-43fd3b202c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f9:8e,bridge_name='br-int',has_traffic_filtering=True,id=83386dcc-c4f0-49aa-8bd0-43fd3b202c46,network=Network(cf5d30f2-97c6-4785-83d2-549eeb6eca88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83386dcc-c4') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG nova.objects.instance [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lazy-loading 'pci_devices' on Instance uuid 4731f355-9307-4176-910b-cf35beb85e75 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:40:48 user nova-compute[73056]:   <uuid>4731f355-9307-4176-910b-cf35beb85e75</uuid>
Aug 14 16:40:48 user nova-compute[73056]:   <name>instance-0000000f</name>
Aug 14 16:40:48 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:40:48 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:40:48 user nova-compute[73056]:   <metadata>
Aug 14 16:40:48 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:40:48 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:40:48 user nova-compute[73056]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1469159950</nova:name>
Aug 14 16:40:48 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:40:48</nova:creationTime>
Aug 14 16:40:48 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:40:48 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:40:48 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:40:48 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:40:48 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:40:48 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:40:48 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:40:48 user nova-compute[73056]:       <nova:owner>
Aug 14 16:40:48 user nova-compute[73056]:         <nova:user uuid="a3fcea40a59c402ca0fa47cadc0c0e98">tempest-ServerStableDeviceRescueTest-759559269-project-member</nova:user>
Aug 14 16:40:48 user nova-compute[73056]:         <nova:project uuid="dd5d50a2601044b5aef50a0d0c6e311a">tempest-ServerStableDeviceRescueTest-759559269</nova:project>
Aug 14 16:40:48 user nova-compute[73056]:       </nova:owner>
Aug 14 16:40:48 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:40:48 user nova-compute[73056]:       <nova:ports>
Aug 14 16:40:48 user nova-compute[73056]:         <nova:port uuid="83386dcc-c4f0-49aa-8bd0-43fd3b202c46">
Aug 14 16:40:48 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 14 16:40:48 user nova-compute[73056]:         </nova:port>
Aug 14 16:40:48 user nova-compute[73056]:       </nova:ports>
Aug 14 16:40:48 user nova-compute[73056]:     </nova:instance>
Aug 14 16:40:48 user nova-compute[73056]:   </metadata>
Aug 14 16:40:48 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:40:48 user nova-compute[73056]:     <system>
Aug 14 16:40:48 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:40:48 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:40:48 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:40:48 user nova-compute[73056]:       <entry name="serial">4731f355-9307-4176-910b-cf35beb85e75</entry>
Aug 14 16:40:48 user nova-compute[73056]:       <entry name="uuid">4731f355-9307-4176-910b-cf35beb85e75</entry>
Aug 14 16:40:48 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:40:48 user nova-compute[73056]:     </system>
Aug 14 16:40:48 user nova-compute[73056]:   </sysinfo>
Aug 14 16:40:48 user nova-compute[73056]:   <os>
Aug 14 16:40:48 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:40:48 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:40:48 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:40:48 user nova-compute[73056]:   </os>
Aug 14 16:40:48 user nova-compute[73056]:   <features>
Aug 14 16:40:48 user nova-compute[73056]:     <acpi/>
Aug 14 16:40:48 user nova-compute[73056]:     <apic/>
Aug 14 16:40:48 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:40:48 user nova-compute[73056]:   </features>
Aug 14 16:40:48 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:40:48 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:40:48 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:40:48 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:40:48 user nova-compute[73056]:   </clock>
Aug 14 16:40:48 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:40:48 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:40:48 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:40:48 user nova-compute[73056]:   </cpu>
Aug 14 16:40:48 user nova-compute[73056]:   <devices>
Aug 14 16:40:48 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:40:48 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:40:48 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk"/>
Aug 14 16:40:48 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:40:48 user nova-compute[73056]:     </disk>
Aug 14 16:40:48 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:40:48 user nova-compute[73056]:       <mac address="fa:16:3e:2d:f9:8e"/>
Aug 14 16:40:48 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:40:48 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:40:48 user nova-compute[73056]:       <target dev="tap83386dcc-c4"/>
Aug 14 16:40:48 user nova-compute[73056]:     </interface>
Aug 14 16:40:48 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:40:48 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/console.log" append="off"/>
Aug 14 16:40:48 user nova-compute[73056]:     </serial>
Aug 14 16:40:48 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:40:48 user nova-compute[73056]:     <video>
Aug 14 16:40:48 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:40:48 user nova-compute[73056]:     </video>
Aug 14 16:40:48 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:40:48 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:40:48 user nova-compute[73056]:     </rng>
Aug 14 16:40:48 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:40:48 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:40:48 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:40:48 user nova-compute[73056]:     </memballoon>
Aug 14 16:40:48 user nova-compute[73056]:   </devices>
Aug 14 16:40:48 user nova-compute[73056]: </domain>
Aug 14 16:40:48 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1469159950',display_name='tempest-ServerStableDeviceRescueTest-server-1469159950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1469159950',id=15,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBQNxWg7OUFhWDQI9/wLnHn2nbEn9G6E26h3WdcqE+rXscJRVMjpTW2ni6zhMvgbqQhJ+9ECYhu3ChirXTVDZRVv933jeqBHwG9oVjz7+R20pljc2XSQT8462fqM4Z3mA==',key_name='tempest-keypair-610798452',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd5d50a2601044b5aef50a0d0c6e311a',ramdisk_id='',reservation_id='r-hqhusr42',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-759559269',owner_user_name='tempest-ServerStableDeviceRescueTest-759559269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:40:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3fcea40a59c402ca0fa47cadc0c0e98',uuid=4731f355-9307-4176-910b-cf35beb85e75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83386dcc-c4f0-49aa-8bd0-43fd3b202c46", "address": "fa:16:3e:2d:f9:8e", "network": {"id": "cf5d30f2-97c6-4785-83d2-549eeb6eca88", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1151628801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd5d50a2601044b5aef50a0d0c6e311a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83386dcc-c4", "ovs_interfaceid": "83386dcc-c4f0-49aa-8bd0-43fd3b202c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Converting VIF {"id": "83386dcc-c4f0-49aa-8bd0-43fd3b202c46", "address": "fa:16:3e:2d:f9:8e", "network": {"id": "cf5d30f2-97c6-4785-83d2-549eeb6eca88", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1151628801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd5d50a2601044b5aef50a0d0c6e311a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83386dcc-c4", "ovs_interfaceid": "83386dcc-c4f0-49aa-8bd0-43fd3b202c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f9:8e,bridge_name='br-int',has_traffic_filtering=True,id=83386dcc-c4f0-49aa-8bd0-43fd3b202c46,network=Network(cf5d30f2-97c6-4785-83d2-549eeb6eca88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83386dcc-c4') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG os_vif [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f9:8e,bridge_name='br-int',has_traffic_filtering=True,id=83386dcc-c4f0-49aa-8bd0-43fd3b202c46,network=Network(cf5d30f2-97c6-4785-83d2-549eeb6eca88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83386dcc-c4') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap83386dcc-c4, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap83386dcc-c4, col_values=(('external_ids', {'iface-id': '83386dcc-c4f0-49aa-8bd0-43fd3b202c46', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:f9:8e', 'vm-uuid': '4731f355-9307-4176-910b-cf35beb85e75'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:48 user nova-compute[73056]: INFO os_vif [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f9:8e,bridge_name='br-int',has_traffic_filtering=True,id=83386dcc-c4f0-49aa-8bd0-43fd3b202c46,network=Network(cf5d30f2-97c6-4785-83d2-549eeb6eca88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83386dcc-c4')
Aug 14 16:40:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:40:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] No VIF found with MAC fa:16:3e:2d:f9:8e, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:40:49 user nova-compute[73056]: DEBUG nova.compute.manager [req-26f5dd60-df1a-43a8-8eba-5c2b73f54ae3 req-f46f15ae-9466-45b1-88a8-beb9bb8a4b61 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Received event network-changed-c2e32544-47df-43ff-ae83-c30388d9d618 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:40:49 user nova-compute[73056]: DEBUG nova.compute.manager [req-26f5dd60-df1a-43a8-8eba-5c2b73f54ae3 req-f46f15ae-9466-45b1-88a8-beb9bb8a4b61 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Refreshing instance network info cache due to event network-changed-c2e32544-47df-43ff-ae83-c30388d9d618. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:40:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-26f5dd60-df1a-43a8-8eba-5c2b73f54ae3 req-f46f15ae-9466-45b1-88a8-beb9bb8a4b61 service nova] Acquiring lock "refresh_cache-5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:40:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-26f5dd60-df1a-43a8-8eba-5c2b73f54ae3 req-f46f15ae-9466-45b1-88a8-beb9bb8a4b61 service nova] Acquired lock "refresh_cache-5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:40:49 user nova-compute[73056]: DEBUG nova.network.neutron [req-26f5dd60-df1a-43a8-8eba-5c2b73f54ae3 req-f46f15ae-9466-45b1-88a8-beb9bb8a4b61 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Refreshing network info cache for port c2e32544-47df-43ff-ae83-c30388d9d618 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:40:49 user nova-compute[73056]: DEBUG nova.network.neutron [req-ea53f8e1-70d4-413f-a395-70c865d84ada req-9aa243d9-aebb-4788-a8fc-ad5174f52dfa service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Updated VIF entry in instance network info cache for port 83386dcc-c4f0-49aa-8bd0-43fd3b202c46. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:40:49 user nova-compute[73056]: DEBUG nova.network.neutron [req-ea53f8e1-70d4-413f-a395-70c865d84ada req-9aa243d9-aebb-4788-a8fc-ad5174f52dfa service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Updating instance_info_cache with network_info: [{"id": "83386dcc-c4f0-49aa-8bd0-43fd3b202c46", "address": "fa:16:3e:2d:f9:8e", "network": {"id": "cf5d30f2-97c6-4785-83d2-549eeb6eca88", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1151628801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd5d50a2601044b5aef50a0d0c6e311a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83386dcc-c4", "ovs_interfaceid": "83386dcc-c4f0-49aa-8bd0-43fd3b202c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:40:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ea53f8e1-70d4-413f-a395-70c865d84ada req-9aa243d9-aebb-4788-a8fc-ad5174f52dfa service nova] Releasing lock "refresh_cache-4731f355-9307-4176-910b-cf35beb85e75" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:40:49 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:40:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:40:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:40:49 user nova-compute[73056]: DEBUG nova.objects.instance [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lazy-loading 'flavor' on Instance uuid 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:40:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:40:50 user nova-compute[73056]: DEBUG nova.network.neutron [req-26f5dd60-df1a-43a8-8eba-5c2b73f54ae3 req-f46f15ae-9466-45b1-88a8-beb9bb8a4b61 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Updated VIF entry in instance network info cache for port c2e32544-47df-43ff-ae83-c30388d9d618. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:40:50 user nova-compute[73056]: DEBUG nova.network.neutron [req-26f5dd60-df1a-43a8-8eba-5c2b73f54ae3 req-f46f15ae-9466-45b1-88a8-beb9bb8a4b61 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Updating instance_info_cache with network_info: [{"id": "c2e32544-47df-43ff-ae83-c30388d9d618", "address": "fa:16:3e:9d:43:1e", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2e32544-47", "ovs_interfaceid": "c2e32544-47df-43ff-ae83-c30388d9d618", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:40:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-26f5dd60-df1a-43a8-8eba-5c2b73f54ae3 req-f46f15ae-9466-45b1-88a8-beb9bb8a4b61 service nova] Releasing lock "refresh_cache-5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:40:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:40:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:40:50 user nova-compute[73056]: INFO nova.compute.manager [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Attaching volume 0784b982-76ba-4021-9063-b976f48f7e96 to /dev/vdb
Aug 14 16:40:50 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:40:50 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 16:40:50 user nova-compute[73056]: DEBUG os_brick.utils [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:40:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:50 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a7423d-fd32-4464-8a4a-998e59844fc8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:40:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.065s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:50 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b55a0e-d39f-4fd9-bad7-11c9d15f6860]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:40:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:50 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a61b7c9-408e-4a71-93fe-f2ac1e889d1c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:40:50 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4b23da-9cd3-4db3-8472-2b39550fb191]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:40:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:40:50 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:40:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:51 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:40:51 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:40:51 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f21cab8-daa1-40df-a4db-1cdb0bc266e8]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:40:51 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:40:51 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:40:51 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:40:51 user nova-compute[73056]: DEBUG os_brick.utils [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] <== get_connector_properties: return (842ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:40:51 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Updating existing volume attachment record: e9b2f06a-6aac-4044-a83f-5c1cb7345b2a {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 16:40:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-0974f181-2621-4c42-abf0-b8c15da16917 req-81f84b0e-33c0-4164-9ff5-b1c12b4a80c5 service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Received event network-vif-plugged-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:40:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0974f181-2621-4c42-abf0-b8c15da16917 req-81f84b0e-33c0-4164-9ff5-b1c12b4a80c5 service nova] Acquiring lock "4731f355-9307-4176-910b-cf35beb85e75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:40:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0974f181-2621-4c42-abf0-b8c15da16917 req-81f84b0e-33c0-4164-9ff5-b1c12b4a80c5 service nova] Lock "4731f355-9307-4176-910b-cf35beb85e75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:40:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0974f181-2621-4c42-abf0-b8c15da16917 req-81f84b0e-33c0-4164-9ff5-b1c12b4a80c5 service nova] Lock "4731f355-9307-4176-910b-cf35beb85e75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:40:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-0974f181-2621-4c42-abf0-b8c15da16917 req-81f84b0e-33c0-4164-9ff5-b1c12b4a80c5 service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] No waiting events found dispatching network-vif-plugged-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:40:51 user nova-compute[73056]: WARNING nova.compute.manager [req-0974f181-2621-4c42-abf0-b8c15da16917 req-81f84b0e-33c0-4164-9ff5-b1c12b4a80c5 service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Received unexpected event network-vif-plugged-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 for instance with vm_state building and task_state spawning.
Aug 14 16:40:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:52 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:40:52 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:40:52 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:40:52 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:40:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:40:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:40:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:40:52 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 16:40:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-10b6aca5-757a-4db0-87d3-37f2060bf22c req-6e431fc0-5b16-461b-aa98-882702ddecac service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Received event network-vif-plugged-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:40:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-10b6aca5-757a-4db0-87d3-37f2060bf22c req-6e431fc0-5b16-461b-aa98-882702ddecac service nova] Acquiring lock "4731f355-9307-4176-910b-cf35beb85e75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:40:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-10b6aca5-757a-4db0-87d3-37f2060bf22c req-6e431fc0-5b16-461b-aa98-882702ddecac service nova] Lock "4731f355-9307-4176-910b-cf35beb85e75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:40:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-10b6aca5-757a-4db0-87d3-37f2060bf22c req-6e431fc0-5b16-461b-aa98-882702ddecac service nova] Lock "4731f355-9307-4176-910b-cf35beb85e75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:40:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-10b6aca5-757a-4db0-87d3-37f2060bf22c req-6e431fc0-5b16-461b-aa98-882702ddecac service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] No waiting events found dispatching network-vif-plugged-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:40:53 user nova-compute[73056]: WARNING nova.compute.manager [req-10b6aca5-757a-4db0-87d3-37f2060bf22c req-6e431fc0-5b16-461b-aa98-882702ddecac service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Received unexpected event network-vif-plugged-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 for instance with vm_state building and task_state spawning.
Aug 14 16:40:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:53 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031253.9231305, 4731f355-9307-4176-910b-cf35beb85e75 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:40:53 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 4731f355-9307-4176-910b-cf35beb85e75] VM Resumed (Lifecycle Event)
Aug 14 16:40:53 user nova-compute[73056]: DEBUG nova.compute.manager [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:40:53 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:40:53 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Instance spawned successfully.
Aug 14 16:40:53 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:40:53 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:40:53 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:40:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:40:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:40:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:40:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:40:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:40:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:40:54 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 4731f355-9307-4176-910b-cf35beb85e75] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:40:54 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031253.9334142, 4731f355-9307-4176-910b-cf35beb85e75 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:40:54 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 4731f355-9307-4176-910b-cf35beb85e75] VM Started (Lifecycle Event)
Aug 14 16:40:54 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:40:54 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:40:54 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 4731f355-9307-4176-910b-cf35beb85e75] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:40:54 user nova-compute[73056]: INFO nova.compute.manager [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Took 7.97 seconds to spawn the instance on the hypervisor.
Aug 14 16:40:54 user nova-compute[73056]: DEBUG nova.compute.manager [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:40:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:54 user nova-compute[73056]: INFO nova.compute.manager [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Took 8.91 seconds to build instance.
Aug 14 16:40:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-e821d6b9-059c-430c-8bb8-18da6ddb95d4 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lock "4731f355-9307-4176-910b-cf35beb85e75" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.026s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:40:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/disk --force-share --output=json" returned: 0 in 0.303s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9cee38-2588-49e4-bda6-31661f7a9cd5/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9cee38-2588-49e4-bda6-31661f7a9cd5/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9cee38-2588-49e4-bda6-31661f7a9cd5/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9cee38-2588-49e4-bda6-31661f7a9cd5/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Acquiring lock "9c11423c-88d3-4fae-8917-c0d57021d194" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:40:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "9c11423c-88d3-4fae-8917-c0d57021d194" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:40:56 user nova-compute[73056]: DEBUG nova.compute.manager [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:40:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:56 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:40:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:40:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:40:56 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:40:56 user nova-compute[73056]: INFO nova.compute.claims [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Claim successful on node user
Aug 14 16:40:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5ba83-0612-4ce2-bd44-3ab55820022f/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:56 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:40:56 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:40:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.578s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:40:56 user nova-compute[73056]: DEBUG nova.compute.manager [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:40:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5ba83-0612-4ce2-bd44-3ab55820022f/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5ba83-0612-4ce2-bd44-3ab55820022f/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:56 user nova-compute[73056]: DEBUG nova.compute.manager [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:40:56 user nova-compute[73056]: DEBUG nova.network.neutron [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:40:56 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:40:56 user nova-compute[73056]: DEBUG nova.compute.manager [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:40:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5ba83-0612-4ce2-bd44-3ab55820022f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:57 user nova-compute[73056]: DEBUG nova.compute.manager [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:40:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:40:57 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Creating image(s)
Aug 14 16:40:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Acquiring lock "/opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:40:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "/opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:40:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "/opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:40:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:57 user nova-compute[73056]: DEBUG nova.policy [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c39b09d624bb4977b6d1b396f425f737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af3a3df4b8641c1ac0d02df893b524d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:40:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.249s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Acquiring lock "c889592ab94cd0b0ce896f27a2af0323771db234" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:40:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:40:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:58 user nova-compute[73056]: DEBUG nova.network.neutron [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Successfully created port: 8491a73c-f38b-4cb4-ab87-d6e41992319d {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:40:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.741s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:58 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:40:58 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:40:58 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=7847MB free_disk=25.64779281616211GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 16:40:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:40:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:40:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk 1073741824" returned: 0 in 0.068s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.815s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:40:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:58 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 9f3a7f8a-e3b9-4918-9663-968677fe5c90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:40:58 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 0fd5ba83-0612-4ce2-bd44-3ab55820022f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:40:58 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:40:58 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:40:58 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 2c9cee38-2588-49e4-bda6-31661f7a9cd5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:40:58 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 18008990-9ed6-46e5-805c-4475e58855a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:40:58 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 4731f355-9307-4176-910b-cf35beb85e75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:40:58 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 9c11423c-88d3-4fae-8917-c0d57021d194 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:40:58 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 16:40:58 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 16:40:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.294s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:58 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 16:40:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:40:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:40:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk --force-share --output=json" returned: 0 in 0.299s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:40:58 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Cannot resize image /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 16:40:58 user nova-compute[73056]: DEBUG nova.objects.instance [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lazy-loading 'migration_context' on Instance uuid 9c11423c-88d3-4fae-8917-c0d57021d194 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:40:58 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 16:40:58 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Ensure instance console log exists: /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:40:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:40:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:40:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:40:58 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:40:58 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:40:59 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 16:40:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.771s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:40:59 user nova-compute[73056]: DEBUG nova.network.neutron [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Successfully updated port: 8491a73c-f38b-4cb4-ab87-d6e41992319d {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:40:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Acquiring lock "refresh_cache-9c11423c-88d3-4fae-8917-c0d57021d194" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:40:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Acquired lock "refresh_cache-9c11423c-88d3-4fae-8917-c0d57021d194" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:40:59 user nova-compute[73056]: DEBUG nova.network.neutron [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:40:59 user nova-compute[73056]: DEBUG nova.compute.manager [req-19ed672b-9798-44df-b1d3-dd327b9cebcf req-59dea088-cd22-4090-a20c-e07a707c973b service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Received event network-changed-8491a73c-f38b-4cb4-ab87-d6e41992319d {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:40:59 user nova-compute[73056]: DEBUG nova.compute.manager [req-19ed672b-9798-44df-b1d3-dd327b9cebcf req-59dea088-cd22-4090-a20c-e07a707c973b service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Refreshing instance network info cache due to event network-changed-8491a73c-f38b-4cb4-ab87-d6e41992319d. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:40:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-19ed672b-9798-44df-b1d3-dd327b9cebcf req-59dea088-cd22-4090-a20c-e07a707c973b service nova] Acquiring lock "refresh_cache-9c11423c-88d3-4fae-8917-c0d57021d194" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:40:59 user nova-compute[73056]: DEBUG nova.network.neutron [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Rebuilding the list of instances to heal {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG nova.network.neutron [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Updating instance_info_cache with network_info: [{"id": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "address": "fa:16:3e:e6:4c:64", "network": {"id": "db548415-fd97-4612-8699-d431cfe3c1ec", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-66082327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af3a3df4b8641c1ac0d02df893b524d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8491a73c-f3", "ovs_interfaceid": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Releasing lock "refresh_cache-9c11423c-88d3-4fae-8917-c0d57021d194" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG nova.compute.manager [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Instance network_info: |[{"id": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "address": "fa:16:3e:e6:4c:64", "network": {"id": "db548415-fd97-4612-8699-d431cfe3c1ec", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-66082327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af3a3df4b8641c1ac0d02df893b524d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8491a73c-f3", "ovs_interfaceid": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-19ed672b-9798-44df-b1d3-dd327b9cebcf req-59dea088-cd22-4090-a20c-e07a707c973b service nova] Acquired lock "refresh_cache-9c11423c-88d3-4fae-8917-c0d57021d194" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG nova.network.neutron [req-19ed672b-9798-44df-b1d3-dd327b9cebcf req-59dea088-cd22-4090-a20c-e07a707c973b service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Refreshing network info cache for port 8491a73c-f38b-4cb4-ab87-d6e41992319d {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Start _get_guest_xml network_info=[{"id": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "address": "fa:16:3e:e6:4c:64", "network": {"id": "db548415-fd97-4612-8699-d431cfe3c1ec", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-66082327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af3a3df4b8641c1ac0d02df893b524d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8491a73c-f3", "ovs_interfaceid": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Skipping network cache update for instance because it is Building. {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 14 16:41:00 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:41:00 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:41:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:40:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1141868820',display_name='tempest-ServerActionsTestOtherB-server-1141868820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1141868820',id=16,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsc3Uaz7vmbmV86lMnvYNdRaSVfJcdYXdG4vY0wVNgR/VZPzr09+A51tF4EmKhmmLDKglhmcpoAJJc05z8zlcL3Fqhx5uVkS7BbyNbqt0mNNKT7ar0AXFL2PnABSrfDLg==',key_name='tempest-keypair-1532112814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4af3a3df4b8641c1ac0d02df893b524d',ramdisk_id='',reservation_id='r-z7s601zt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1168667086',owner_user_name='tempest-ServerActionsTestOtherB-1168667086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:40:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c39b09d624bb4977b6d1b396f425f737',uuid=9c11423c-88d3-4fae-8917-c0d57021d194,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "address": "fa:16:3e:e6:4c:64", "network": {"id": "db548415-fd97-4612-8699-d431cfe3c1ec", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-66082327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af3a3df4b8641c1ac0d02df893b524d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8491a73c-f3", "ovs_interfaceid": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Converting VIF {"id": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "address": "fa:16:3e:e6:4c:64", "network": {"id": "db548415-fd97-4612-8699-d431cfe3c1ec", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-66082327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af3a3df4b8641c1ac0d02df893b524d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8491a73c-f3", "ovs_interfaceid": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:4c:64,bridge_name='br-int',has_traffic_filtering=True,id=8491a73c-f38b-4cb4-ab87-d6e41992319d,network=Network(db548415-fd97-4612-8699-d431cfe3c1ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8491a73c-f3') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG nova.objects.instance [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c11423c-88d3-4fae-8917-c0d57021d194 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-9f3a7f8a-e3b9-4918-9663-968677fe5c90" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-9f3a7f8a-e3b9-4918-9663-968677fe5c90" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG nova.objects.instance [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lazy-loading 'info_cache' on Instance uuid 9f3a7f8a-e3b9-4918-9663-968677fe5c90 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:41:00 user nova-compute[73056]:   <uuid>9c11423c-88d3-4fae-8917-c0d57021d194</uuid>
Aug 14 16:41:00 user nova-compute[73056]:   <name>instance-00000010</name>
Aug 14 16:41:00 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:41:00 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:41:00 user nova-compute[73056]:   <metadata>
Aug 14 16:41:00 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:41:00 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:41:00 user nova-compute[73056]:       <nova:name>tempest-ServerActionsTestOtherB-server-1141868820</nova:name>
Aug 14 16:41:00 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:41:00</nova:creationTime>
Aug 14 16:41:00 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:41:00 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:41:00 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:41:00 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:41:00 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:41:00 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:41:00 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:41:00 user nova-compute[73056]:       <nova:owner>
Aug 14 16:41:00 user nova-compute[73056]:         <nova:user uuid="c39b09d624bb4977b6d1b396f425f737">tempest-ServerActionsTestOtherB-1168667086-project-member</nova:user>
Aug 14 16:41:00 user nova-compute[73056]:         <nova:project uuid="4af3a3df4b8641c1ac0d02df893b524d">tempest-ServerActionsTestOtherB-1168667086</nova:project>
Aug 14 16:41:00 user nova-compute[73056]:       </nova:owner>
Aug 14 16:41:00 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:41:00 user nova-compute[73056]:       <nova:ports>
Aug 14 16:41:00 user nova-compute[73056]:         <nova:port uuid="8491a73c-f38b-4cb4-ab87-d6e41992319d">
Aug 14 16:41:00 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 16:41:00 user nova-compute[73056]:         </nova:port>
Aug 14 16:41:00 user nova-compute[73056]:       </nova:ports>
Aug 14 16:41:00 user nova-compute[73056]:     </nova:instance>
Aug 14 16:41:00 user nova-compute[73056]:   </metadata>
Aug 14 16:41:00 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:41:00 user nova-compute[73056]:     <system>
Aug 14 16:41:00 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:41:00 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:41:00 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:41:00 user nova-compute[73056]:       <entry name="serial">9c11423c-88d3-4fae-8917-c0d57021d194</entry>
Aug 14 16:41:00 user nova-compute[73056]:       <entry name="uuid">9c11423c-88d3-4fae-8917-c0d57021d194</entry>
Aug 14 16:41:00 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:41:00 user nova-compute[73056]:     </system>
Aug 14 16:41:00 user nova-compute[73056]:   </sysinfo>
Aug 14 16:41:00 user nova-compute[73056]:   <os>
Aug 14 16:41:00 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:41:00 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:41:00 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:41:00 user nova-compute[73056]:   </os>
Aug 14 16:41:00 user nova-compute[73056]:   <features>
Aug 14 16:41:00 user nova-compute[73056]:     <acpi/>
Aug 14 16:41:00 user nova-compute[73056]:     <apic/>
Aug 14 16:41:00 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:41:00 user nova-compute[73056]:   </features>
Aug 14 16:41:00 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:41:00 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:41:00 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:41:00 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:41:00 user nova-compute[73056]:   </clock>
Aug 14 16:41:00 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:41:00 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:41:00 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:41:00 user nova-compute[73056]:   </cpu>
Aug 14 16:41:00 user nova-compute[73056]:   <devices>
Aug 14 16:41:00 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:41:00 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:41:00 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk"/>
Aug 14 16:41:00 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:41:00 user nova-compute[73056]:     </disk>
Aug 14 16:41:00 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:41:00 user nova-compute[73056]:       <mac address="fa:16:3e:e6:4c:64"/>
Aug 14 16:41:00 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:41:00 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:41:00 user nova-compute[73056]:       <target dev="tap8491a73c-f3"/>
Aug 14 16:41:00 user nova-compute[73056]:     </interface>
Aug 14 16:41:00 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:41:00 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/console.log" append="off"/>
Aug 14 16:41:00 user nova-compute[73056]:     </serial>
Aug 14 16:41:00 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:41:00 user nova-compute[73056]:     <video>
Aug 14 16:41:00 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:41:00 user nova-compute[73056]:     </video>
Aug 14 16:41:00 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:41:00 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:41:00 user nova-compute[73056]:     </rng>
Aug 14 16:41:00 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:41:00 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:41:00 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:41:00 user nova-compute[73056]:     </memballoon>
Aug 14 16:41:00 user nova-compute[73056]:   </devices>
Aug 14 16:41:00 user nova-compute[73056]: </domain>
Aug 14 16:41:00 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:40:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1141868820',display_name='tempest-ServerActionsTestOtherB-server-1141868820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1141868820',id=16,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsc3Uaz7vmbmV86lMnvYNdRaSVfJcdYXdG4vY0wVNgR/VZPzr09+A51tF4EmKhmmLDKglhmcpoAJJc05z8zlcL3Fqhx5uVkS7BbyNbqt0mNNKT7ar0AXFL2PnABSrfDLg==',key_name='tempest-keypair-1532112814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4af3a3df4b8641c1ac0d02df893b524d',ramdisk_id='',reservation_id='r-z7s601zt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1168667086',owner_user_name='tempest-ServerActionsTestOtherB-1168667086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:40:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c39b09d624bb4977b6d1b396f425f737',uuid=9c11423c-88d3-4fae-8917-c0d57021d194,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "address": "fa:16:3e:e6:4c:64", "network": {"id": "db548415-fd97-4612-8699-d431cfe3c1ec", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-66082327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af3a3df4b8641c1ac0d02df893b524d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8491a73c-f3", "ovs_interfaceid": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Converting VIF {"id": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "address": "fa:16:3e:e6:4c:64", "network": {"id": "db548415-fd97-4612-8699-d431cfe3c1ec", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-66082327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af3a3df4b8641c1ac0d02df893b524d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8491a73c-f3", "ovs_interfaceid": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:4c:64,bridge_name='br-int',has_traffic_filtering=True,id=8491a73c-f38b-4cb4-ab87-d6e41992319d,network=Network(db548415-fd97-4612-8699-d431cfe3c1ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8491a73c-f3') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG os_vif [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:4c:64,bridge_name='br-int',has_traffic_filtering=True,id=8491a73c-f38b-4cb4-ab87-d6e41992319d,network=Network(db548415-fd97-4612-8699-d431cfe3c1ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8491a73c-f3') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8491a73c-f3, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8491a73c-f3, col_values=(('external_ids', {'iface-id': '8491a73c-f38b-4cb4-ab87-d6e41992319d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:4c:64', 'vm-uuid': '9c11423c-88d3-4fae-8917-c0d57021d194'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:00 user nova-compute[73056]: INFO os_vif [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:4c:64,bridge_name='br-int',has_traffic_filtering=True,id=8491a73c-f38b-4cb4-ab87-d6e41992319d,network=Network(db548415-fd97-4612-8699-d431cfe3c1ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8491a73c-f3')
Aug 14 16:41:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] No VIF found with MAC fa:16:3e:e6:4c:64, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Updating instance_info_cache with network_info: [{"id": "312bec25-d19f-423b-aca3-a4117119fc1f", "address": "fa:16:3e:03:ce:11", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312bec25-d1", "ovs_interfaceid": "312bec25-d19f-423b-aca3-a4117119fc1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-9f3a7f8a-e3b9-4918-9663-968677fe5c90" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 16:41:00 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:41:01 user nova-compute[73056]: DEBUG nova.network.neutron [req-19ed672b-9798-44df-b1d3-dd327b9cebcf req-59dea088-cd22-4090-a20c-e07a707c973b service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Updated VIF entry in instance network info cache for port 8491a73c-f38b-4cb4-ab87-d6e41992319d. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:41:01 user nova-compute[73056]: DEBUG nova.network.neutron [req-19ed672b-9798-44df-b1d3-dd327b9cebcf req-59dea088-cd22-4090-a20c-e07a707c973b service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Updating instance_info_cache with network_info: [{"id": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "address": "fa:16:3e:e6:4c:64", "network": {"id": "db548415-fd97-4612-8699-d431cfe3c1ec", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-66082327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af3a3df4b8641c1ac0d02df893b524d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8491a73c-f3", "ovs_interfaceid": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:41:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-19ed672b-9798-44df-b1d3-dd327b9cebcf req-59dea088-cd22-4090-a20c-e07a707c973b service nova] Releasing lock "refresh_cache-9c11423c-88d3-4fae-8917-c0d57021d194" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:41:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AYPjGBth', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:41:02 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:41:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:41:02 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:41:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:41:02 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:41:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4705ea-b56a-4484-a5d3-0df8f8838010]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:41:02 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fff924-7840-4d72-a67c-02c24482b83a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96] added
Aug 14 16:41:02 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ea7bd0-7eeb-4c4d-90e5-17ae00c004ca]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95c747a-d0c8-49da-82f5-ec3d254d6e51]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AYPjGBth {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AYPjGBth" returned: 0 in 0.036s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef0924f-f6a8-4d86-adce-3b60094a5336]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AYPjGBth'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c432256-8e2b-4494-817d-be4985ed79b5]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1539bd-0ba7-4508-87d9-ea55ab0ed2d9]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)
Aug 14 16:41:02 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)
Aug 14 16:41:02 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG nova.compute.manager [req-614ed8b4-2393-45cf-9aa6-8f7c15cbae27 req-92c8dbda-b05b-4aea-8e7b-e8f2964df36b service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Received event network-vif-plugged-8491a73c-f38b-4cb4-ab87-d6e41992319d {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-614ed8b4-2393-45cf-9aa6-8f7c15cbae27 req-92c8dbda-b05b-4aea-8e7b-e8f2964df36b service nova] Acquiring lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-614ed8b4-2393-45cf-9aa6-8f7c15cbae27 req-92c8dbda-b05b-4aea-8e7b-e8f2964df36b service nova] Lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-614ed8b4-2393-45cf-9aa6-8f7c15cbae27 req-92c8dbda-b05b-4aea-8e7b-e8f2964df36b service nova] Lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG nova.compute.manager [req-614ed8b4-2393-45cf-9aa6-8f7c15cbae27 req-92c8dbda-b05b-4aea-8e7b-e8f2964df36b service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] No waiting events found dispatching network-vif-plugged-8491a73c-f38b-4cb4-ab87-d6e41992319d {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:41:02 user nova-compute[73056]: WARNING nova.compute.manager [req-614ed8b4-2393-45cf-9aa6-8f7c15cbae27 req-92c8dbda-b05b-4aea-8e7b-e8f2964df36b service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Received unexpected event network-vif-plugged-8491a73c-f38b-4cb4-ab87-d6e41992319d for instance with vm_state building and task_state spawning.
Aug 14 16:41:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef6fcc0-db18-49ec-8dec-6da90c381af6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96, portal: 172.16.0.220,3260]
Aug 14 16:41:02 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96, portal: 172.16.0.220,3260] successful.
Aug 14 16:41:02 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2faf11-18d1-458d-8efa-42548eebe86b]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a625936e-47f1-4e69-a571-654fbc49828e]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)
Aug 14 16:41:02 user nova-compute[73056]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 (non-flash)
Aug 14 16:41:02 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)
Aug 14 16:41:02 user nova-compute[73056]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 (non-flash)
Aug 14 16:41:02 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.028s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7fc4fb-658e-40b5-8eee-c355827b2b08]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AYPjGBth', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:03 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.444s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:41:03 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] <== connect_volume: return (1446ms) {'type': 'block', 'scsi_wwn': '23062326163383061', 'path': '/dev/sdc'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:41:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062326163383061', 'path': '/dev/sdc'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:41:03 user nova-compute[73056]: DEBUG nova.objects.instance [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lazy-loading 'flavor' on Instance uuid 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:41:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 16:41:03 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:41:03 user nova-compute[73056]:   <source dev="/dev/sdc"/>
Aug 14 16:41:03 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:41:03 user nova-compute[73056]:   <serial>0784b982-76ba-4021-9063-b976f48f7e96</serial>
Aug 14 16:41:03 user nova-compute[73056]: </disk>
Aug 14 16:41:03 user nova-compute[73056]:  {{(pid=73056) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 16:41:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:41:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:41:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] No VIF found with MAC fa:16:3e:9d:43:1e, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:41:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a12a6e0a-227e-4037-9671-f49953d18b45 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.535s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:41:04 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031264.671637, 9c11423c-88d3-4fae-8917-c0d57021d194 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:41:04 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] VM Resumed (Lifecycle Event)
Aug 14 16:41:04 user nova-compute[73056]: DEBUG nova.compute.manager [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:41:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:41:04 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Instance spawned successfully.
Aug 14 16:41:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:41:04 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:41:04 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:41:04 user nova-compute[73056]: DEBUG nova.compute.manager [req-97f1a58a-a089-4596-a227-cd4c8042d9d7 req-0481ef68-0f55-4277-aa7e-b43aeb5c23c5 service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Received event network-vif-plugged-8491a73c-f38b-4cb4-ab87-d6e41992319d {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:41:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-97f1a58a-a089-4596-a227-cd4c8042d9d7 req-0481ef68-0f55-4277-aa7e-b43aeb5c23c5 service nova] Acquiring lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:41:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-97f1a58a-a089-4596-a227-cd4c8042d9d7 req-0481ef68-0f55-4277-aa7e-b43aeb5c23c5 service nova] Lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:41:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-97f1a58a-a089-4596-a227-cd4c8042d9d7 req-0481ef68-0f55-4277-aa7e-b43aeb5c23c5 service nova] Lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:41:04 user nova-compute[73056]: DEBUG nova.compute.manager [req-97f1a58a-a089-4596-a227-cd4c8042d9d7 req-0481ef68-0f55-4277-aa7e-b43aeb5c23c5 service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] No waiting events found dispatching network-vif-plugged-8491a73c-f38b-4cb4-ab87-d6e41992319d {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:41:04 user nova-compute[73056]: WARNING nova.compute.manager [req-97f1a58a-a089-4596-a227-cd4c8042d9d7 req-0481ef68-0f55-4277-aa7e-b43aeb5c23c5 service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Received unexpected event network-vif-plugged-8491a73c-f38b-4cb4-ab87-d6e41992319d for instance with vm_state building and task_state spawning.
Aug 14 16:41:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:41:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:41:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:41:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:41:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:41:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:41:04 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:41:04 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031264.6766741, 9c11423c-88d3-4fae-8917-c0d57021d194 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:41:04 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] VM Started (Lifecycle Event)
Aug 14 16:41:04 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:41:04 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:41:04 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:41:04 user nova-compute[73056]: INFO nova.compute.manager [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Took 7.72 seconds to spawn the instance on the hypervisor.
Aug 14 16:41:04 user nova-compute[73056]: DEBUG nova.compute.manager [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:41:05 user nova-compute[73056]: INFO nova.compute.manager [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Took 8.79 seconds to build instance.
Aug 14 16:41:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-201a7c09-2e22-47dc-a990-7a9cce091c67 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "9c11423c-88d3-4fae-8917-c0d57021d194" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.046s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:41:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:06 user nova-compute[73056]: INFO nova.compute.manager [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Rebuilding instance
Aug 14 16:41:06 user nova-compute[73056]: DEBUG nova.objects.instance [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:41:06 user nova-compute[73056]: DEBUG nova.compute.manager [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:41:06 user nova-compute[73056]: DEBUG nova.objects.instance [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lazy-loading 'pci_requests' on Instance uuid 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:41:06 user nova-compute[73056]: DEBUG nova.objects.instance [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lazy-loading 'pci_devices' on Instance uuid 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:41:06 user nova-compute[73056]: DEBUG nova.objects.instance [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lazy-loading 'resources' on Instance uuid 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:41:06 user nova-compute[73056]: DEBUG nova.objects.instance [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lazy-loading 'migration_context' on Instance uuid 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:41:07 user nova-compute[73056]: DEBUG nova.objects.instance [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73056) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 14 16:41:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:07 user nova-compute[73056]: DEBUG nova.compute.manager [req-5d4e3018-2c1c-4bb8-bbd8-210c3640b645 req-a42bb114-f914-4fc6-914e-8b6abc9c617f service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Received event network-vif-unplugged-c2e32544-47df-43ff-ae83-c30388d9d618 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:41:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-5d4e3018-2c1c-4bb8-bbd8-210c3640b645 req-a42bb114-f914-4fc6-914e-8b6abc9c617f service nova] Acquiring lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:41:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-5d4e3018-2c1c-4bb8-bbd8-210c3640b645 req-a42bb114-f914-4fc6-914e-8b6abc9c617f service nova] Lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:41:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-5d4e3018-2c1c-4bb8-bbd8-210c3640b645 req-a42bb114-f914-4fc6-914e-8b6abc9c617f service nova] Lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:41:07 user nova-compute[73056]: DEBUG nova.compute.manager [req-5d4e3018-2c1c-4bb8-bbd8-210c3640b645 req-a42bb114-f914-4fc6-914e-8b6abc9c617f service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] No waiting events found dispatching network-vif-unplugged-c2e32544-47df-43ff-ae83-c30388d9d618 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:41:07 user nova-compute[73056]: WARNING nova.compute.manager [req-5d4e3018-2c1c-4bb8-bbd8-210c3640b645 req-a42bb114-f914-4fc6-914e-8b6abc9c617f service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Received unexpected event network-vif-unplugged-c2e32544-47df-43ff-ae83-c30388d9d618 for instance with vm_state active and task_state rebuilding.
Aug 14 16:41:07 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Instance destroyed successfully.
Aug 14 16:41:08 user nova-compute[73056]: INFO nova.compute.manager [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Detaching volume 0784b982-76ba-4021-9063-b976f48f7e96
Aug 14 16:41:08 user nova-compute[73056]: INFO nova.virt.block_device [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Attempting to driver detach volume 0784b982-76ba-4021-9063-b976f48f7e96 from mountpoint /dev/vdb
Aug 14 16:41:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Attempting to detach device vdb from instance 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8 from the persistent domain config. {{(pid=73056) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 16:41:08 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:41:08 user nova-compute[73056]:   <source dev="/dev/sdc"/>
Aug 14 16:41:08 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:41:08 user nova-compute[73056]:   <serial>0784b982-76ba-4021-9063-b976f48f7e96</serial>
Aug 14 16:41:08 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 16:41:08 user nova-compute[73056]: </disk>
Aug 14 16:41:08 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 16:41:08 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Successfully detached device vdb from instance 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8 from the persistent domain config.
Aug 14 16:41:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AYPjGBth', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:41:08 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 16:41:08 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b361bc-2b28-47ea-80a3-e1f3378e23c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7895582-2f45-47a9-9bd7-2a871ae55f3c]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)
Aug 14 16:41:08 user nova-compute[73056]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 (non-flash)
Aug 14 16:41:08 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)
Aug 14 16:41:08 user nova-compute[73056]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 (non-flash)
Aug 14 16:41:08 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff32fbc0280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96'): ({'sdc'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Removing single pathed devices sdc {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b712cf57-17ec-4420-95b3-531f8b71f602]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4be8ad3-701c-4e80-a6a0-b1d61b16df3c]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Flushing IO for device /dev/sdc {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfd0422-2337-491d-b0b4-4834828e4552]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ff7306-cadc-41d8-9efb-101267131b88]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] SCSI volumes sdc have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[da73dda8-0784-4d07-9aba-974e3d65e112]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[6449744d-550e-4a48-982c-77d92b6679bf]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96, portal: 172.16.0.220,3260]
Aug 14 16:41:08 user nova-compute[73056]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96, portal: 172.16.0.220,3260] successful.
Aug 14 16:41:08 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4090b15-a9d1-47c4-a5b5-f5a7234b2824]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] <== disconnect_volume: return (279ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:41:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:41:09 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Instance destroyed successfully.
Aug 14 16:41:09 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:38:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1424363203',display_name='tempest-ServerActionsTestOtherA-server-1074934452',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1424363203',id=12,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzrXyeuWZXAQJXaMndVYP8YLJJO4IYhi0DtFWiIOZyO1xgLu2NdayGj34gx2+069d0uD51u6mLg7wO65+6tBrUyZO5VP+z88aMjR2XH1fCtm3ZNL2N1XZkwSHRBMKbi2w==',key_name='tempest-keypair-417234224',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:39:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2dd5723fb8384aa985cf401d95aa7d08',ramdisk_id='',reservation_id='r-ueazm8wy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-380813086',owner_user_name='tempest-ServerActionsTestOtherA-380813086-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:41:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9404ed7386e14eed8d046e8c45942c75',uuid=5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2e32544-47df-43ff-ae83-c30388d9d618", "address": "fa:16:3e:9d:43:1e", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2e32544-47", "ovs_interfaceid": "c2e32544-47df-43ff-ae83-c30388d9d618", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Converting VIF {"id": "c2e32544-47df-43ff-ae83-c30388d9d618", "address": "fa:16:3e:9d:43:1e", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2e32544-47", "ovs_interfaceid": "c2e32544-47df-43ff-ae83-c30388d9d618", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:43:1e,bridge_name='br-int',has_traffic_filtering=True,id=c2e32544-47df-43ff-ae83-c30388d9d618,network=Network(2c5f0d57-9485-4a0b-a847-49eea5cd17c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2e32544-47') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG os_vif [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:43:1e,bridge_name='br-int',has_traffic_filtering=True,id=c2e32544-47df-43ff-ae83-c30388d9d618,network=Network(2c5f0d57-9485-4a0b-a847-49eea5cd17c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2e32544-47') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2e32544-47, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:41:09 user nova-compute[73056]: INFO os_vif [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:43:1e,bridge_name='br-int',has_traffic_filtering=True,id=c2e32544-47df-43ff-ae83-c30388d9d618,network=Network(2c5f0d57-9485-4a0b-a847-49eea5cd17c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2e32544-47')
Aug 14 16:41:09 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AYPjGBth', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:41:09 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 16:41:09 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aea6f25-a3aa-434d-8146-e782a7b2a2cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[735027ec-19d9-446c-8f3c-f2705a3bf2be]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)
Aug 14 16:41:09 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)
Aug 14 16:41:09 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff2dcd07be0>, {}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Disconnecting from: [] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.048s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] <== disconnect_volume: return (50ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:41:09 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Deleting instance files /opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8_del
Aug 14 16:41:09 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Deletion of /opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8_del complete
Aug 14 16:41:09 user nova-compute[73056]: DEBUG nova.compute.manager [req-5ae59bc2-10cd-4402-91cf-0c0f748d1507 req-b4207b33-db58-408c-93a6-bacf7f93ad0c service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Received event network-vif-plugged-c2e32544-47df-43ff-ae83-c30388d9d618 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-5ae59bc2-10cd-4402-91cf-0c0f748d1507 req-b4207b33-db58-408c-93a6-bacf7f93ad0c service nova] Acquiring lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-5ae59bc2-10cd-4402-91cf-0c0f748d1507 req-b4207b33-db58-408c-93a6-bacf7f93ad0c service nova] Lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-5ae59bc2-10cd-4402-91cf-0c0f748d1507 req-b4207b33-db58-408c-93a6-bacf7f93ad0c service nova] Lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG nova.compute.manager [req-5ae59bc2-10cd-4402-91cf-0c0f748d1507 req-b4207b33-db58-408c-93a6-bacf7f93ad0c service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] No waiting events found dispatching network-vif-plugged-c2e32544-47df-43ff-ae83-c30388d9d618 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:41:09 user nova-compute[73056]: WARNING nova.compute.manager [req-5ae59bc2-10cd-4402-91cf-0c0f748d1507 req-b4207b33-db58-408c-93a6-bacf7f93ad0c service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Received unexpected event network-vif-plugged-c2e32544-47df-43ff-ae83-c30388d9d618 for instance with vm_state active and task_state rebuilding.
Aug 14 16:41:09 user nova-compute[73056]: INFO nova.virt.block_device [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Booting with volume 0784b982-76ba-4021-9063-b976f48f7e96 at /dev/vdb
Aug 14 16:41:09 user nova-compute[73056]: DEBUG os_brick.utils [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[690cb712-5fc3-42e7-a5b7-e28123509dd8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a890e9-87a2-4510-bdf4-5de3ba2bbaae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f744d83-c02e-4fbc-a618-73531735fb79]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e963ca-996d-4779-af10-73b58632df10]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:41:09 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:41:09 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[23991bd9-5097-4f9b-813b-c89b5455d2bc]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:10 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:41:10 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:41:10 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:41:10 user nova-compute[73056]: DEBUG os_brick.utils [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:41:10 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Updating existing volume attachment record: f9f068cd-a8fa-48c1-ab69-5d5833e4374d {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 16:41:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:14 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:20 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:41:20 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Creating image(s)
Aug 14 16:41:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "/opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:41:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "/opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:41:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "/opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:41:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.201s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "c889592ab94cd0b0ce896f27a2af0323771db234" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:41:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:41:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.175s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/disk 1073741824" returned: 0 in 0.052s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.226s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Cannot resize image /opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Ensure instance console log exists: /opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Start _get_guest_xml network_info=[{"id": "c2e32544-47df-43ff-ae83-c30388d9d618", "address": "fa:16:3e:9d:43:1e", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2e32544-47", "ovs_interfaceid": "c2e32544-47df-43ff-ae83-c30388d9d618", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AYPjGBth', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8', 'attached_at': '', 'detached_at': '', 'volume_id': '0784b982-76ba-4021-9063-b976f48f7e96', 'serial': '0784b982-76ba-4021-9063-b976f48f7e96'}, 'attachment_id': 'f9f068cd-a8fa-48c1-ab69-5d5833e4374d', 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:41:21 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 14 16:41:21 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 14 16:41:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG nova.objects.instance [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AYPjGBth', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:41:21 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 16:41:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:41:21 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 16:41:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:41:21 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:41:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5cf122-7e7c-4875-9f92-25245c57a080]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:41:21 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf29bcdc-4c84-45e2-8b40-f63804a46c60]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96] added
Aug 14 16:41:21 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f2d10e-a19c-41e9-9de8-696e794a1abf]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a376b351-b969-4b4f-a70f-3cdf210668b5]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AYPjGBth {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AYPjGBth" returned: 0 in 0.026s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[34de1fbb-6910-45a8-993b-f5ae788e2e55]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AYPjGBth'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30b24d5-658f-4108-ba95-219640b77a55]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.084s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[011ed1e7-a0d0-4102-a89c-a633c5656923]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)
Aug 14 16:41:21 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)
Aug 14 16:41:21 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd997c1a-c509-467c-860e-1e929faa6fe1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96, portal: 172.16.0.220,3260]
Aug 14 16:41:21 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96, portal: 172.16.0.220,3260] successful.
Aug 14 16:41:21 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:41:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:22 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a3977e-b8d1-409e-bf25-d24b9e3ad579]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:22 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:41:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:22 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d62b93-ff57-42bd-a260-c43d408ed994]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:22 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)
Aug 14 16:41:22 user nova-compute[73056]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 (non-flash)
Aug 14 16:41:22 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:41:22 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)
Aug 14 16:41:22 user nova-compute[73056]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 (non-flash)
Aug 14 16:41:22 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:41:22 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.436s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:41:22 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:41:22 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:41:22 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:41:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:22 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3c3c4e-fac8-4737-ae8e-c4659e7b84cd]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:22 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:41:22 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AYPjGBth', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:41:22 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:22 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692031267.94457, 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:41:22 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] VM Stopped (Lifecycle Event)
Aug 14 16:41:22 user nova-compute[73056]: DEBUG nova.compute.manager [None req-4a0cdc9b-7928-4039-8f86-075ac3d271ca None None] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:41:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.476s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:41:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] <== connect_volume: return (1478ms) {'type': 'block', 'scsi_wwn': '23062326163383061', 'path': '/dev/sdc'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:41:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062326163383061', 'path': '/dev/sdc'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:41:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T16:38:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1424363203',display_name='tempest-ServerActionsTestOtherA-server-1074934452',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1424363203',id=12,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzrXyeuWZXAQJXaMndVYP8YLJJO4IYhi0DtFWiIOZyO1xgLu2NdayGj34gx2+069d0uD51u6mLg7wO65+6tBrUyZO5VP+z88aMjR2XH1fCtm3ZNL2N1XZkwSHRBMKbi2w==',key_name='tempest-keypair-417234224',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:39:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2dd5723fb8384aa985cf401d95aa7d08',ramdisk_id='',reservation_id='r-ueazm8wy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-380813086',owner_user_name='tempest-ServerActionsTestOtherA-380813086-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:41:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9404ed7386e14eed8d046e8c45942c75',uuid=5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2e32544-47df-43ff-ae83-c30388d9d618", "address": "fa:16:3e:9d:43:1e", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2e32544-47", "ovs_interfaceid": "c2e32544-47df-43ff-ae83-c30388d9d618", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:41:23 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Converting VIF {"id": "c2e32544-47df-43ff-ae83-c30388d9d618", "address": "fa:16:3e:9d:43:1e", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2e32544-47", "ovs_interfaceid": "c2e32544-47df-43ff-ae83-c30388d9d618", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:41:23 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:43:1e,bridge_name='br-int',has_traffic_filtering=True,id=c2e32544-47df-43ff-ae83-c30388d9d618,network=Network(2c5f0d57-9485-4a0b-a847-49eea5cd17c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2e32544-47') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:41:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:41:23 user nova-compute[73056]:   <uuid>5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8</uuid>
Aug 14 16:41:23 user nova-compute[73056]:   <name>instance-0000000c</name>
Aug 14 16:41:23 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:41:23 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:41:23 user nova-compute[73056]:   <metadata>
Aug 14 16:41:23 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:41:23 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:41:23 user nova-compute[73056]:       <nova:name>tempest-ServerActionsTestOtherA-server-1074934452</nova:name>
Aug 14 16:41:23 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:41:21</nova:creationTime>
Aug 14 16:41:23 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:41:23 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:41:23 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:41:23 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:41:23 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:41:23 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:41:23 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:41:23 user nova-compute[73056]:       <nova:owner>
Aug 14 16:41:23 user nova-compute[73056]:         <nova:user uuid="9404ed7386e14eed8d046e8c45942c75">tempest-ServerActionsTestOtherA-380813086-project-member</nova:user>
Aug 14 16:41:23 user nova-compute[73056]:         <nova:project uuid="2dd5723fb8384aa985cf401d95aa7d08">tempest-ServerActionsTestOtherA-380813086</nova:project>
Aug 14 16:41:23 user nova-compute[73056]:       </nova:owner>
Aug 14 16:41:23 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:41:23 user nova-compute[73056]:       <nova:ports>
Aug 14 16:41:23 user nova-compute[73056]:         <nova:port uuid="c2e32544-47df-43ff-ae83-c30388d9d618">
Aug 14 16:41:23 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 16:41:23 user nova-compute[73056]:         </nova:port>
Aug 14 16:41:23 user nova-compute[73056]:       </nova:ports>
Aug 14 16:41:23 user nova-compute[73056]:     </nova:instance>
Aug 14 16:41:23 user nova-compute[73056]:   </metadata>
Aug 14 16:41:23 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:41:23 user nova-compute[73056]:     <system>
Aug 14 16:41:23 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:41:23 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:41:23 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:41:23 user nova-compute[73056]:       <entry name="serial">5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8</entry>
Aug 14 16:41:23 user nova-compute[73056]:       <entry name="uuid">5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8</entry>
Aug 14 16:41:23 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:41:23 user nova-compute[73056]:     </system>
Aug 14 16:41:23 user nova-compute[73056]:   </sysinfo>
Aug 14 16:41:23 user nova-compute[73056]:   <os>
Aug 14 16:41:23 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:41:23 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:41:23 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:41:23 user nova-compute[73056]:   </os>
Aug 14 16:41:23 user nova-compute[73056]:   <features>
Aug 14 16:41:23 user nova-compute[73056]:     <acpi/>
Aug 14 16:41:23 user nova-compute[73056]:     <apic/>
Aug 14 16:41:23 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:41:23 user nova-compute[73056]:   </features>
Aug 14 16:41:23 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:41:23 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:41:23 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:41:23 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:41:23 user nova-compute[73056]:   </clock>
Aug 14 16:41:23 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:41:23 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:41:23 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:41:23 user nova-compute[73056]:   </cpu>
Aug 14 16:41:23 user nova-compute[73056]:   <devices>
Aug 14 16:41:23 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:41:23 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:41:23 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/disk"/>
Aug 14 16:41:23 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:41:23 user nova-compute[73056]:     </disk>
Aug 14 16:41:23 user nova-compute[73056]:     <disk type="block" device="disk">
Aug 14 16:41:23 user nova-compute[73056]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:41:23 user nova-compute[73056]:       <source dev="/dev/sdc"/>
Aug 14 16:41:23 user nova-compute[73056]:       <target dev="vdb" bus="virtio"/>
Aug 14 16:41:23 user nova-compute[73056]:       <serial>0784b982-76ba-4021-9063-b976f48f7e96</serial>
Aug 14 16:41:23 user nova-compute[73056]:     </disk>
Aug 14 16:41:23 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:41:23 user nova-compute[73056]:       <mac address="fa:16:3e:9d:43:1e"/>
Aug 14 16:41:23 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:41:23 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:41:23 user nova-compute[73056]:       <target dev="tapc2e32544-47"/>
Aug 14 16:41:23 user nova-compute[73056]:     </interface>
Aug 14 16:41:23 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:41:23 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/console.log" append="off"/>
Aug 14 16:41:23 user nova-compute[73056]:     </serial>
Aug 14 16:41:23 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:41:23 user nova-compute[73056]:     <video>
Aug 14 16:41:23 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:41:23 user nova-compute[73056]:     </video>
Aug 14 16:41:23 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:41:23 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:41:23 user nova-compute[73056]:     </rng>
Aug 14 16:41:23 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:41:23 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:41:23 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:41:23 user nova-compute[73056]:     </memballoon>
Aug 14 16:41:23 user nova-compute[73056]:   </devices>
Aug 14 16:41:23 user nova-compute[73056]: </domain>
Aug 14 16:41:23 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:41:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T16:38:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1424363203',display_name='tempest-ServerActionsTestOtherA-server-1074934452',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1424363203',id=12,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzrXyeuWZXAQJXaMndVYP8YLJJO4IYhi0DtFWiIOZyO1xgLu2NdayGj34gx2+069d0uD51u6mLg7wO65+6tBrUyZO5VP+z88aMjR2XH1fCtm3ZNL2N1XZkwSHRBMKbi2w==',key_name='tempest-keypair-417234224',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:39:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2dd5723fb8384aa985cf401d95aa7d08',ramdisk_id='',reservation_id='r-ueazm8wy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-380813086',owner_user_name='tempest-ServerActionsTestOtherA-380813086-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:41:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9404ed7386e14eed8d046e8c45942c75',uuid=5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2e32544-47df-43ff-ae83-c30388d9d618", "address": "fa:16:3e:9d:43:1e", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2e32544-47", "ovs_interfaceid": "c2e32544-47df-43ff-ae83-c30388d9d618", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:41:23 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Converting VIF {"id": "c2e32544-47df-43ff-ae83-c30388d9d618", "address": "fa:16:3e:9d:43:1e", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2e32544-47", "ovs_interfaceid": "c2e32544-47df-43ff-ae83-c30388d9d618", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:41:23 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:43:1e,bridge_name='br-int',has_traffic_filtering=True,id=c2e32544-47df-43ff-ae83-c30388d9d618,network=Network(2c5f0d57-9485-4a0b-a847-49eea5cd17c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2e32544-47') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:41:23 user nova-compute[73056]: DEBUG os_vif [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:43:1e,bridge_name='br-int',has_traffic_filtering=True,id=c2e32544-47df-43ff-ae83-c30388d9d618,network=Network(2c5f0d57-9485-4a0b-a847-49eea5cd17c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2e32544-47') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:41:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:41:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:41:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2e32544-47, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:41:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc2e32544-47, col_values=(('external_ids', {'iface-id': 'c2e32544-47df-43ff-ae83-c30388d9d618', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:43:1e', 'vm-uuid': '5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:41:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:41:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:23 user nova-compute[73056]: INFO os_vif [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:43:1e,bridge_name='br-int',has_traffic_filtering=True,id=c2e32544-47df-43ff-ae83-c30388d9d618,network=Network(2c5f0d57-9485-4a0b-a847-49eea5cd17c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2e32544-47')
Aug 14 16:41:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:41:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:41:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] No VIF found with MAC fa:16:3e:9d:43:1e, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:41:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:24 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:24 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:24 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:24 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:25 user nova-compute[73056]: DEBUG nova.compute.manager [req-88c0b46d-6a31-4559-85cb-e553807f7725 req-ee6c0436-e588-4751-bb8e-a62f60f4db07 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Received event network-vif-plugged-c2e32544-47df-43ff-ae83-c30388d9d618 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:41:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-88c0b46d-6a31-4559-85cb-e553807f7725 req-ee6c0436-e588-4751-bb8e-a62f60f4db07 service nova] Acquiring lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:41:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-88c0b46d-6a31-4559-85cb-e553807f7725 req-ee6c0436-e588-4751-bb8e-a62f60f4db07 service nova] Lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:41:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-88c0b46d-6a31-4559-85cb-e553807f7725 req-ee6c0436-e588-4751-bb8e-a62f60f4db07 service nova] Lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:41:25 user nova-compute[73056]: DEBUG nova.compute.manager [req-88c0b46d-6a31-4559-85cb-e553807f7725 req-ee6c0436-e588-4751-bb8e-a62f60f4db07 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] No waiting events found dispatching network-vif-plugged-c2e32544-47df-43ff-ae83-c30388d9d618 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:41:25 user nova-compute[73056]: WARNING nova.compute.manager [req-88c0b46d-6a31-4559-85cb-e553807f7725 req-ee6c0436-e588-4751-bb8e-a62f60f4db07 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Received unexpected event network-vif-plugged-c2e32544-47df-43ff-ae83-c30388d9d618 for instance with vm_state active and task_state rebuild_spawning.
Aug 14 16:41:26 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:27 user nova-compute[73056]: DEBUG nova.compute.manager [req-7ac756ed-1e99-453d-8e6f-b2718b43e4df req-43171fcb-1a0c-4d8d-be6e-59ba46b14c64 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Received event network-vif-plugged-c2e32544-47df-43ff-ae83-c30388d9d618 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:41:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-7ac756ed-1e99-453d-8e6f-b2718b43e4df req-43171fcb-1a0c-4d8d-be6e-59ba46b14c64 service nova] Acquiring lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:41:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-7ac756ed-1e99-453d-8e6f-b2718b43e4df req-43171fcb-1a0c-4d8d-be6e-59ba46b14c64 service nova] Lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:41:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-7ac756ed-1e99-453d-8e6f-b2718b43e4df req-43171fcb-1a0c-4d8d-be6e-59ba46b14c64 service nova] Lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:41:27 user nova-compute[73056]: DEBUG nova.compute.manager [req-7ac756ed-1e99-453d-8e6f-b2718b43e4df req-43171fcb-1a0c-4d8d-be6e-59ba46b14c64 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] No waiting events found dispatching network-vif-plugged-c2e32544-47df-43ff-ae83-c30388d9d618 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:41:27 user nova-compute[73056]: WARNING nova.compute.manager [req-7ac756ed-1e99-453d-8e6f-b2718b43e4df req-43171fcb-1a0c-4d8d-be6e-59ba46b14c64 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Received unexpected event network-vif-plugged-c2e32544-47df-43ff-ae83-c30388d9d618 for instance with vm_state active and task_state rebuild_spawning.
Aug 14 16:41:27 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031287.3045497, 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:41:27 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] VM Resumed (Lifecycle Event)
Aug 14 16:41:27 user nova-compute[73056]: DEBUG nova.compute.manager [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:41:27 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:41:27 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Instance spawned successfully.
Aug 14 16:41:27 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:41:27 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:41:27 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:41:27 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:41:27 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:41:27 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:41:27 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:41:27 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:41:27 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:41:27 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 14 16:41:27 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031287.306305, 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:41:27 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] VM Started (Lifecycle Event)
Aug 14 16:41:27 user nova-compute[73056]: DEBUG nova.compute.manager [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:41:27 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:41:27 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:41:27 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 14 16:41:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:41:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:41:27 user nova-compute[73056]: DEBUG nova.objects.instance [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73056) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 14 16:41:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-41983939-0054-4c8a-8900-ebda3735e489 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.119s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:41:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:31 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-242b7ad6-cce2-44cc-a36b-0e20e03812d2 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Acquiring lock "2c9cee38-2588-49e4-bda6-31661f7a9cd5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:41:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-242b7ad6-cce2-44cc-a36b-0e20e03812d2 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "2c9cee38-2588-49e4-bda6-31661f7a9cd5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:41:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-242b7ad6-cce2-44cc-a36b-0e20e03812d2 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Acquiring lock "2c9cee38-2588-49e4-bda6-31661f7a9cd5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:41:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-242b7ad6-cce2-44cc-a36b-0e20e03812d2 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "2c9cee38-2588-49e4-bda6-31661f7a9cd5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:41:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-242b7ad6-cce2-44cc-a36b-0e20e03812d2 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "2c9cee38-2588-49e4-bda6-31661f7a9cd5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:41:31 user nova-compute[73056]: INFO nova.compute.manager [None req-242b7ad6-cce2-44cc-a36b-0e20e03812d2 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Terminating instance
Aug 14 16:41:31 user nova-compute[73056]: DEBUG nova.compute.manager [None req-242b7ad6-cce2-44cc-a36b-0e20e03812d2 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 16:41:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:32 user nova-compute[73056]: DEBUG nova.compute.manager [req-65387999-4454-4f47-bf6e-b0aabb3288be req-8bfd890c-98ac-4701-a288-9e6b00835d9b service nova] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Received event network-vif-unplugged-163edb7f-e2e2-4885-89c6-873c7d7c9c1d {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:41:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-65387999-4454-4f47-bf6e-b0aabb3288be req-8bfd890c-98ac-4701-a288-9e6b00835d9b service nova] Acquiring lock "2c9cee38-2588-49e4-bda6-31661f7a9cd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:41:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-65387999-4454-4f47-bf6e-b0aabb3288be req-8bfd890c-98ac-4701-a288-9e6b00835d9b service nova] Lock "2c9cee38-2588-49e4-bda6-31661f7a9cd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:41:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-65387999-4454-4f47-bf6e-b0aabb3288be req-8bfd890c-98ac-4701-a288-9e6b00835d9b service nova] Lock "2c9cee38-2588-49e4-bda6-31661f7a9cd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:41:32 user nova-compute[73056]: DEBUG nova.compute.manager [req-65387999-4454-4f47-bf6e-b0aabb3288be req-8bfd890c-98ac-4701-a288-9e6b00835d9b service nova] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] No waiting events found dispatching network-vif-unplugged-163edb7f-e2e2-4885-89c6-873c7d7c9c1d {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:41:32 user nova-compute[73056]: DEBUG nova.compute.manager [req-65387999-4454-4f47-bf6e-b0aabb3288be req-8bfd890c-98ac-4701-a288-9e6b00835d9b service nova] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Received event network-vif-unplugged-163edb7f-e2e2-4885-89c6-873c7d7c9c1d for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:41:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:32 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Instance destroyed successfully.
Aug 14 16:41:32 user nova-compute[73056]: DEBUG nova.objects.instance [None req-242b7ad6-cce2-44cc-a36b-0e20e03812d2 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lazy-loading 'resources' on Instance uuid 2c9cee38-2588-49e4-bda6-31661f7a9cd5 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:41:32 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-242b7ad6-cce2-44cc-a36b-0e20e03812d2 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:39:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-250238643',display_name='tempest-VolumesAdminNegativeTest-server-250238643',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-250238643',id=13,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:39:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4bf992869a24ad2b1d391e2baff2b34',ramdisk_id='',reservation_id='r-u1w6s8zt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1902234353',owner_user_name='tempest-VolumesAdminNegativeTest-1902234353-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:39:35Z,user_data=None,user_id='b76fb5a2ba84410584b31e9006c67f37',uuid=2c9cee38-2588-49e4-bda6-31661f7a9cd5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "163edb7f-e2e2-4885-89c6-873c7d7c9c1d", "address": "fa:16:3e:ec:14:76", "network": {"id": "2b53e507-f50b-411d-bce8-8769fc50bc28", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-515017098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4bf992869a24ad2b1d391e2baff2b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap163edb7f-e2", "ovs_interfaceid": "163edb7f-e2e2-4885-89c6-873c7d7c9c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:41:32 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-242b7ad6-cce2-44cc-a36b-0e20e03812d2 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Converting VIF {"id": "163edb7f-e2e2-4885-89c6-873c7d7c9c1d", "address": "fa:16:3e:ec:14:76", "network": {"id": "2b53e507-f50b-411d-bce8-8769fc50bc28", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-515017098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4bf992869a24ad2b1d391e2baff2b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap163edb7f-e2", "ovs_interfaceid": "163edb7f-e2e2-4885-89c6-873c7d7c9c1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:41:32 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-242b7ad6-cce2-44cc-a36b-0e20e03812d2 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:14:76,bridge_name='br-int',has_traffic_filtering=True,id=163edb7f-e2e2-4885-89c6-873c7d7c9c1d,network=Network(2b53e507-f50b-411d-bce8-8769fc50bc28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap163edb7f-e2') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:41:32 user nova-compute[73056]: DEBUG os_vif [None req-242b7ad6-cce2-44cc-a36b-0e20e03812d2 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:14:76,bridge_name='br-int',has_traffic_filtering=True,id=163edb7f-e2e2-4885-89c6-873c7d7c9c1d,network=Network(2b53e507-f50b-411d-bce8-8769fc50bc28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap163edb7f-e2') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:41:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap163edb7f-e2, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:41:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:41:32 user nova-compute[73056]: INFO os_vif [None req-242b7ad6-cce2-44cc-a36b-0e20e03812d2 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:14:76,bridge_name='br-int',has_traffic_filtering=True,id=163edb7f-e2e2-4885-89c6-873c7d7c9c1d,network=Network(2b53e507-f50b-411d-bce8-8769fc50bc28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap163edb7f-e2')
Aug 14 16:41:32 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-242b7ad6-cce2-44cc-a36b-0e20e03812d2 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Deleting instance files /opt/stack/data/nova/instances/2c9cee38-2588-49e4-bda6-31661f7a9cd5_del
Aug 14 16:41:32 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-242b7ad6-cce2-44cc-a36b-0e20e03812d2 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Deletion of /opt/stack/data/nova/instances/2c9cee38-2588-49e4-bda6-31661f7a9cd5_del complete
Aug 14 16:41:32 user nova-compute[73056]: INFO nova.compute.manager [None req-242b7ad6-cce2-44cc-a36b-0e20e03812d2 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Took 0.80 seconds to destroy the instance on the hypervisor.
Aug 14 16:41:32 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-242b7ad6-cce2-44cc-a36b-0e20e03812d2 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 16:41:32 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 16:41:32 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 16:41:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:34 user nova-compute[73056]: DEBUG nova.compute.manager [req-4619b80a-8b14-4fd0-b453-9e8ac2b38b50 req-9a8ad2b9-4bd0-4ef2-a368-029726b0c3df service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Received event network-changed-1f7ab99b-ea66-43bf-91e2-da6938d28d2f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:41:34 user nova-compute[73056]: DEBUG nova.compute.manager [req-4619b80a-8b14-4fd0-b453-9e8ac2b38b50 req-9a8ad2b9-4bd0-4ef2-a368-029726b0c3df service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Refreshing instance network info cache due to event network-changed-1f7ab99b-ea66-43bf-91e2-da6938d28d2f. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:41:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4619b80a-8b14-4fd0-b453-9e8ac2b38b50 req-9a8ad2b9-4bd0-4ef2-a368-029726b0c3df service nova] Acquiring lock "refresh_cache-9bb2cf77-cd65-49fd-a85b-d7961c2db3bf" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:41:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4619b80a-8b14-4fd0-b453-9e8ac2b38b50 req-9a8ad2b9-4bd0-4ef2-a368-029726b0c3df service nova] Acquired lock "refresh_cache-9bb2cf77-cd65-49fd-a85b-d7961c2db3bf" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:41:34 user nova-compute[73056]: DEBUG nova.network.neutron [req-4619b80a-8b14-4fd0-b453-9e8ac2b38b50 req-9a8ad2b9-4bd0-4ef2-a368-029726b0c3df service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Refreshing network info cache for port 1f7ab99b-ea66-43bf-91e2-da6938d28d2f {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:41:34 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:41:34 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Took 1.75 seconds to deallocate network for instance.
Aug 14 16:41:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-242b7ad6-cce2-44cc-a36b-0e20e03812d2 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:41:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-242b7ad6-cce2-44cc-a36b-0e20e03812d2 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:41:34 user nova-compute[73056]: DEBUG nova.compute.manager [req-e437cb7c-9557-4b23-bb1a-819ef5985079 req-1a740662-7914-4e18-8b70-8a43508cb707 service nova] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Received event network-vif-plugged-163edb7f-e2e2-4885-89c6-873c7d7c9c1d {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:41:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e437cb7c-9557-4b23-bb1a-819ef5985079 req-1a740662-7914-4e18-8b70-8a43508cb707 service nova] Acquiring lock "2c9cee38-2588-49e4-bda6-31661f7a9cd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:41:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e437cb7c-9557-4b23-bb1a-819ef5985079 req-1a740662-7914-4e18-8b70-8a43508cb707 service nova] Lock "2c9cee38-2588-49e4-bda6-31661f7a9cd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:41:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e437cb7c-9557-4b23-bb1a-819ef5985079 req-1a740662-7914-4e18-8b70-8a43508cb707 service nova] Lock "2c9cee38-2588-49e4-bda6-31661f7a9cd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:41:34 user nova-compute[73056]: DEBUG nova.compute.manager [req-e437cb7c-9557-4b23-bb1a-819ef5985079 req-1a740662-7914-4e18-8b70-8a43508cb707 service nova] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] No waiting events found dispatching network-vif-plugged-163edb7f-e2e2-4885-89c6-873c7d7c9c1d {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:41:34 user nova-compute[73056]: WARNING nova.compute.manager [req-e437cb7c-9557-4b23-bb1a-819ef5985079 req-1a740662-7914-4e18-8b70-8a43508cb707 service nova] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Received unexpected event network-vif-plugged-163edb7f-e2e2-4885-89c6-873c7d7c9c1d for instance with vm_state deleted and task_state None.
Aug 14 16:41:34 user nova-compute[73056]: DEBUG nova.compute.manager [req-e437cb7c-9557-4b23-bb1a-819ef5985079 req-1a740662-7914-4e18-8b70-8a43508cb707 service nova] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Received event network-vif-deleted-163edb7f-e2e2-4885-89c6-873c7d7c9c1d {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:41:34 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-242b7ad6-cce2-44cc-a36b-0e20e03812d2 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:41:34 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-242b7ad6-cce2-44cc-a36b-0e20e03812d2 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:41:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-242b7ad6-cce2-44cc-a36b-0e20e03812d2 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:41:35 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-242b7ad6-cce2-44cc-a36b-0e20e03812d2 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Deleted allocations for instance 2c9cee38-2588-49e4-bda6-31661f7a9cd5
Aug 14 16:41:35 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-242b7ad6-cce2-44cc-a36b-0e20e03812d2 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "2c9cee38-2588-49e4-bda6-31661f7a9cd5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.172s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:41:35 user nova-compute[73056]: DEBUG nova.network.neutron [req-4619b80a-8b14-4fd0-b453-9e8ac2b38b50 req-9a8ad2b9-4bd0-4ef2-a368-029726b0c3df service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Updated VIF entry in instance network info cache for port 1f7ab99b-ea66-43bf-91e2-da6938d28d2f. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:41:35 user nova-compute[73056]: DEBUG nova.network.neutron [req-4619b80a-8b14-4fd0-b453-9e8ac2b38b50 req-9a8ad2b9-4bd0-4ef2-a368-029726b0c3df service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Updating instance_info_cache with network_info: [{"id": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "address": "fa:16:3e:8d:d8:88", "network": {"id": "dd844e8d-9264-4868-819d-0b01ad3b1d41", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-568480417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e6131531ab4553b55ea090d5e7f47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7ab99b-ea", "ovs_interfaceid": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:41:35 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4619b80a-8b14-4fd0-b453-9e8ac2b38b50 req-9a8ad2b9-4bd0-4ef2-a368-029726b0c3df service nova] Releasing lock "refresh_cache-9bb2cf77-cd65-49fd-a85b-d7961c2db3bf" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:41:35 user nova-compute[73056]: DEBUG nova.compute.manager [req-e7a37cda-553f-4d1c-beea-be26fa81184d req-46415d14-ede5-44d6-8037-c7e6fa8f79bc service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Received event network-changed-1f7ab99b-ea66-43bf-91e2-da6938d28d2f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:41:35 user nova-compute[73056]: DEBUG nova.compute.manager [req-e7a37cda-553f-4d1c-beea-be26fa81184d req-46415d14-ede5-44d6-8037-c7e6fa8f79bc service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Refreshing instance network info cache due to event network-changed-1f7ab99b-ea66-43bf-91e2-da6938d28d2f. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:41:35 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e7a37cda-553f-4d1c-beea-be26fa81184d req-46415d14-ede5-44d6-8037-c7e6fa8f79bc service nova] Acquiring lock "refresh_cache-9bb2cf77-cd65-49fd-a85b-d7961c2db3bf" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:41:35 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e7a37cda-553f-4d1c-beea-be26fa81184d req-46415d14-ede5-44d6-8037-c7e6fa8f79bc service nova] Acquired lock "refresh_cache-9bb2cf77-cd65-49fd-a85b-d7961c2db3bf" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:41:35 user nova-compute[73056]: DEBUG nova.network.neutron [req-e7a37cda-553f-4d1c-beea-be26fa81184d req-46415d14-ede5-44d6-8037-c7e6fa8f79bc service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Refreshing network info cache for port 1f7ab99b-ea66-43bf-91e2-da6938d28d2f {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:41:35 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-1dbb3815-c4d3-4766-baba-206e0a582e0a tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquiring lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:41:35 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-1dbb3815-c4d3-4766-baba-206e0a582e0a tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:41:35 user nova-compute[73056]: INFO nova.compute.manager [None req-1dbb3815-c4d3-4766-baba-206e0a582e0a tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Detaching volume cdf3d64f-ff30-4b56-8937-48b4d97bed1d
Aug 14 16:41:35 user nova-compute[73056]: INFO nova.virt.block_device [None req-1dbb3815-c4d3-4766-baba-206e0a582e0a tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Attempting to driver detach volume cdf3d64f-ff30-4b56-8937-48b4d97bed1d from mountpoint /dev/vdb
Aug 14 16:41:35 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-1dbb3815-c4d3-4766-baba-206e0a582e0a tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Attempting to detach device vdb from instance 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf from the persistent domain config. {{(pid=73056) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 16:41:35 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-1dbb3815-c4d3-4766-baba-206e0a582e0a tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 16:41:35 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:41:35 user nova-compute[73056]:   <source dev="/dev/sdb"/>
Aug 14 16:41:35 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:41:35 user nova-compute[73056]:   <serial>cdf3d64f-ff30-4b56-8937-48b4d97bed1d</serial>
Aug 14 16:41:35 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 16:41:35 user nova-compute[73056]: </disk>
Aug 14 16:41:35 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 16:41:35 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-1dbb3815-c4d3-4766-baba-206e0a582e0a tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Successfully detached device vdb from instance 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf from the persistent domain config.
Aug 14 16:41:35 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-1dbb3815-c4d3-4766-baba-206e0a582e0a tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf from the live domain config. {{(pid=73056) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 16:41:35 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-1dbb3815-c4d3-4766-baba-206e0a582e0a tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 16:41:35 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:41:35 user nova-compute[73056]:   <source dev="/dev/sdb"/>
Aug 14 16:41:35 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:41:35 user nova-compute[73056]:   <serial>cdf3d64f-ff30-4b56-8937-48b4d97bed1d</serial>
Aug 14 16:41:35 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 16:41:35 user nova-compute[73056]: </disk>
Aug 14 16:41:35 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG nova.network.neutron [req-e7a37cda-553f-4d1c-beea-be26fa81184d req-46415d14-ede5-44d6-8037-c7e6fa8f79bc service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Updated VIF entry in instance network info cache for port 1f7ab99b-ea66-43bf-91e2-da6938d28d2f. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG nova.network.neutron [req-e7a37cda-553f-4d1c-beea-be26fa81184d req-46415d14-ede5-44d6-8037-c7e6fa8f79bc service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Updating instance_info_cache with network_info: [{"id": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "address": "fa:16:3e:8d:d8:88", "network": {"id": "dd844e8d-9264-4868-819d-0b01ad3b1d41", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-568480417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e6131531ab4553b55ea090d5e7f47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7ab99b-ea", "ovs_interfaceid": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e7a37cda-553f-4d1c-beea-be26fa81184d req-46415d14-ede5-44d6-8037-c7e6fa8f79bc service nova] Releasing lock "refresh_cache-9bb2cf77-cd65-49fd-a85b-d7961c2db3bf" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Received event <DeviceRemovedEvent: 1692031296.5175176, 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73056) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-1dbb3815-c4d3-4766-baba-206e0a582e0a tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf {{(pid=73056) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 16:41:36 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-1dbb3815-c4d3-4766-baba-206e0a582e0a tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Successfully detached device vdb from instance 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf from the live domain config.
Aug 14 16:41:36 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1dbb3815-c4d3-4766-baba-206e0a582e0a tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dbb3815-c4d3-4766-baba-206e0a582e0a tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrxZnPzJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:41:36 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-1dbb3815-c4d3-4766-baba-206e0a582e0a tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:41:36 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-1dbb3815-c4d3-4766-baba-206e0a582e0a tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-1dbb3815-c4d3-4766-baba-206e0a582e0a tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dbb3815-c4d3-4766-baba-206e0a582e0a tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b7d56b-faf4-40b3-9ec0-89a61a1cc8bf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28f5939-c899-41aa-a523-5a174bd18044]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dbb3815-c4d3-4766-baba-206e0a582e0a tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)
Aug 14 16:41:36 user nova-compute[73056]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 (non-flash)
Aug 14 16:41:36 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dbb3815-c4d3-4766-baba-206e0a582e0a tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d (non-flash)
Aug 14 16:41:36 user nova-compute[73056]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 (non-flash)
Aug 14 16:41:36 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dbb3815-c4d3-4766-baba-206e0a582e0a tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff2dcd07b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d'): ({'sdb'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-1dbb3815-c4d3-4766-baba-206e0a582e0a tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Removing single pathed devices sdb {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7823b279-15a7-4870-bcdc-cb5f89497e63]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6f7cee-dfe9-42b0-974b-64ca5b9a079d]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-1dbb3815-c4d3-4766-baba-206e0a582e0a tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Flushing IO for device /dev/sdb {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3a1dca-25f6-4f60-a745-367a661d1d9e]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-1dbb3815-c4d3-4766-baba-206e0a582e0a tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bdb785-7f29-4eb9-b650-e0fd138d0f0e]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-1dbb3815-c4d3-4766-baba-206e0a582e0a tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-1dbb3815-c4d3-4766-baba-206e0a582e0a tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] SCSI volumes sdb have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dbb3815-c4d3-4766-baba-206e0a582e0a tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7322aff3-5ac7-4c28-9a7c-e67005be77df]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dbb3815-c4d3-4766-baba-206e0a582e0a tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d52611-f601-4c0c-acd6-bd4cd84a1964]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dbb3815-c4d3-4766-baba-206e0a582e0a tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d, portal: 172.16.0.220,3260]
Aug 14 16:41:36 user nova-compute[73056]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d, portal: 172.16.0.220,3260] successful.
Aug 14 16:41:36 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf3d64f-ff30-4b56-8937-48b4d97bed1d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb098fbd-f08f-447d-8c62-b5ada94a5dd7]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dbb3815-c4d3-4766-baba-206e0a582e0a tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-1dbb3815-c4d3-4766-baba-206e0a582e0a tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dbb3815-c4d3-4766-baba-206e0a582e0a tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] <== disconnect_volume: return (384ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:41:36 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1dbb3815-c4d3-4766-baba-206e0a582e0a tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:41:37 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:37 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:38 user nova-compute[73056]: DEBUG nova.objects.instance [None req-1dbb3815-c4d3-4766-baba-206e0a582e0a tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lazy-loading 'flavor' on Instance uuid 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:41:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-1dbb3815-c4d3-4766-baba-206e0a582e0a tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.326s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:41:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "b3270811-8241-47a6-aa36-0ec3feddf0fc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:41:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "b3270811-8241-47a6-aa36-0ec3feddf0fc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:41:42 user nova-compute[73056]: DEBUG nova.compute.manager [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:41:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:41:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:41:42 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:41:42 user nova-compute[73056]: INFO nova.compute.claims [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Claim successful on node user
Aug 14 16:41:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:42 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:41:42 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:41:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:41:42 user nova-compute[73056]: DEBUG nova.compute.manager [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:41:42 user nova-compute[73056]: DEBUG nova.compute.manager [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:41:42 user nova-compute[73056]: DEBUG nova.network.neutron [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:41:42 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:41:42 user nova-compute[73056]: DEBUG nova.compute.manager [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:41:43 user nova-compute[73056]: DEBUG nova.policy [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3dad45adee1047bda7350d8a3f8a2f54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d5a8e599b3141339ed0ae6729031b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:41:43 user nova-compute[73056]: DEBUG nova.compute.manager [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:41:43 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:41:43 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Creating image(s)
Aug 14 16:41:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "/opt/stack/data/nova/instances/b3270811-8241-47a6-aa36-0ec3feddf0fc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:41:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "/opt/stack/data/nova/instances/b3270811-8241-47a6-aa36-0ec3feddf0fc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:41:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "/opt/stack/data/nova/instances/b3270811-8241-47a6-aa36-0ec3feddf0fc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:41:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.195s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "c889592ab94cd0b0ce896f27a2af0323771db234" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:41:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:41:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.194s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/b3270811-8241-47a6-aa36-0ec3feddf0fc/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/b3270811-8241-47a6-aa36-0ec3feddf0fc/disk 1073741824" returned: 0 in 0.058s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:41:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.167s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:43 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b3270811-8241-47a6-aa36-0ec3feddf0fc/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 16:41:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3270811-8241-47a6-aa36-0ec3feddf0fc/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:43 user nova-compute[73056]: DEBUG nova.network.neutron [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Successfully created port: 3bbc228a-d2bb-4b9f-a6d0-66b15010acdb {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:41:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3270811-8241-47a6-aa36-0ec3feddf0fc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:43 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Cannot resize image /opt/stack/data/nova/instances/b3270811-8241-47a6-aa36-0ec3feddf0fc/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 16:41:43 user nova-compute[73056]: DEBUG nova.objects.instance [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lazy-loading 'migration_context' on Instance uuid b3270811-8241-47a6-aa36-0ec3feddf0fc {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:41:43 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 16:41:43 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Ensure instance console log exists: /opt/stack/data/nova/instances/b3270811-8241-47a6-aa36-0ec3feddf0fc/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:41:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:41:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:41:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:41:44 user nova-compute[73056]: DEBUG nova.network.neutron [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Successfully updated port: 3bbc228a-d2bb-4b9f-a6d0-66b15010acdb {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:41:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "refresh_cache-b3270811-8241-47a6-aa36-0ec3feddf0fc" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:41:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquired lock "refresh_cache-b3270811-8241-47a6-aa36-0ec3feddf0fc" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:41:44 user nova-compute[73056]: DEBUG nova.network.neutron [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:41:44 user nova-compute[73056]: DEBUG nova.compute.manager [req-b60ce432-0d42-4a9a-be1b-a65bb1e27e31 req-037c6f74-dbcf-441c-b5a0-c40a9dc587c8 service nova] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Received event network-changed-3bbc228a-d2bb-4b9f-a6d0-66b15010acdb {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:41:44 user nova-compute[73056]: DEBUG nova.compute.manager [req-b60ce432-0d42-4a9a-be1b-a65bb1e27e31 req-037c6f74-dbcf-441c-b5a0-c40a9dc587c8 service nova] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Refreshing instance network info cache due to event network-changed-3bbc228a-d2bb-4b9f-a6d0-66b15010acdb. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:41:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-b60ce432-0d42-4a9a-be1b-a65bb1e27e31 req-037c6f74-dbcf-441c-b5a0-c40a9dc587c8 service nova] Acquiring lock "refresh_cache-b3270811-8241-47a6-aa36-0ec3feddf0fc" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:41:44 user nova-compute[73056]: DEBUG nova.network.neutron [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG nova.network.neutron [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Updating instance_info_cache with network_info: [{"id": "3bbc228a-d2bb-4b9f-a6d0-66b15010acdb", "address": "fa:16:3e:59:b3:5d", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bbc228a-d2", "ovs_interfaceid": "3bbc228a-d2bb-4b9f-a6d0-66b15010acdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Releasing lock "refresh_cache-b3270811-8241-47a6-aa36-0ec3feddf0fc" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG nova.compute.manager [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Instance network_info: |[{"id": "3bbc228a-d2bb-4b9f-a6d0-66b15010acdb", "address": "fa:16:3e:59:b3:5d", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bbc228a-d2", "ovs_interfaceid": "3bbc228a-d2bb-4b9f-a6d0-66b15010acdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-b60ce432-0d42-4a9a-be1b-a65bb1e27e31 req-037c6f74-dbcf-441c-b5a0-c40a9dc587c8 service nova] Acquired lock "refresh_cache-b3270811-8241-47a6-aa36-0ec3feddf0fc" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG nova.network.neutron [req-b60ce432-0d42-4a9a-be1b-a65bb1e27e31 req-037c6f74-dbcf-441c-b5a0-c40a9dc587c8 service nova] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Refreshing network info cache for port 3bbc228a-d2bb-4b9f-a6d0-66b15010acdb {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Start _get_guest_xml network_info=[{"id": "3bbc228a-d2bb-4b9f-a6d0-66b15010acdb", "address": "fa:16:3e:59:b3:5d", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bbc228a-d2", "ovs_interfaceid": "3bbc228a-d2bb-4b9f-a6d0-66b15010acdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:41:45 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:41:45 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:41:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:41:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-658979013',display_name='tempest-AttachVolumeNegativeTest-server-658979013',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-658979013',id=17,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgdKMXht7wKvUNqmuBaOUIIPCU/B/W9DuOqZntyGUMjOOjAEC3lEtom6fFaKfcSgzIbTodlH06RcAQKa+gRy66ZoQbyf11gwxlOR8cvibjUIEHsqGlSc8GrypseqH8nIA==',key_name='tempest-keypair-1175775660',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d5a8e599b3141339ed0ae6729031b36',ramdisk_id='',reservation_id='r-wz555gou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-860464885',owner_user_name='tempest-AttachVolumeNegativeTest-860464885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:41:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dad45adee1047bda7350d8a3f8a2f54',uuid=b3270811-8241-47a6-aa36-0ec3feddf0fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3bbc228a-d2bb-4b9f-a6d0-66b15010acdb", "address": "fa:16:3e:59:b3:5d", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bbc228a-d2", "ovs_interfaceid": "3bbc228a-d2bb-4b9f-a6d0-66b15010acdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Converting VIF {"id": "3bbc228a-d2bb-4b9f-a6d0-66b15010acdb", "address": "fa:16:3e:59:b3:5d", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bbc228a-d2", "ovs_interfaceid": "3bbc228a-d2bb-4b9f-a6d0-66b15010acdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:b3:5d,bridge_name='br-int',has_traffic_filtering=True,id=3bbc228a-d2bb-4b9f-a6d0-66b15010acdb,network=Network(ad323a8d-7318-46f5-8af4-cbc61ae589b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bbc228a-d2') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG nova.objects.instance [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lazy-loading 'pci_devices' on Instance uuid b3270811-8241-47a6-aa36-0ec3feddf0fc {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:41:45 user nova-compute[73056]:   <uuid>b3270811-8241-47a6-aa36-0ec3feddf0fc</uuid>
Aug 14 16:41:45 user nova-compute[73056]:   <name>instance-00000011</name>
Aug 14 16:41:45 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:41:45 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:41:45 user nova-compute[73056]:   <metadata>
Aug 14 16:41:45 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:41:45 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:41:45 user nova-compute[73056]:       <nova:name>tempest-AttachVolumeNegativeTest-server-658979013</nova:name>
Aug 14 16:41:45 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:41:45</nova:creationTime>
Aug 14 16:41:45 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:41:45 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:41:45 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:41:45 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:41:45 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:41:45 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:41:45 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:41:45 user nova-compute[73056]:       <nova:owner>
Aug 14 16:41:45 user nova-compute[73056]:         <nova:user uuid="3dad45adee1047bda7350d8a3f8a2f54">tempest-AttachVolumeNegativeTest-860464885-project-member</nova:user>
Aug 14 16:41:45 user nova-compute[73056]:         <nova:project uuid="9d5a8e599b3141339ed0ae6729031b36">tempest-AttachVolumeNegativeTest-860464885</nova:project>
Aug 14 16:41:45 user nova-compute[73056]:       </nova:owner>
Aug 14 16:41:45 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:41:45 user nova-compute[73056]:       <nova:ports>
Aug 14 16:41:45 user nova-compute[73056]:         <nova:port uuid="3bbc228a-d2bb-4b9f-a6d0-66b15010acdb">
Aug 14 16:41:45 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 16:41:45 user nova-compute[73056]:         </nova:port>
Aug 14 16:41:45 user nova-compute[73056]:       </nova:ports>
Aug 14 16:41:45 user nova-compute[73056]:     </nova:instance>
Aug 14 16:41:45 user nova-compute[73056]:   </metadata>
Aug 14 16:41:45 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:41:45 user nova-compute[73056]:     <system>
Aug 14 16:41:45 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:41:45 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:41:45 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:41:45 user nova-compute[73056]:       <entry name="serial">b3270811-8241-47a6-aa36-0ec3feddf0fc</entry>
Aug 14 16:41:45 user nova-compute[73056]:       <entry name="uuid">b3270811-8241-47a6-aa36-0ec3feddf0fc</entry>
Aug 14 16:41:45 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:41:45 user nova-compute[73056]:     </system>
Aug 14 16:41:45 user nova-compute[73056]:   </sysinfo>
Aug 14 16:41:45 user nova-compute[73056]:   <os>
Aug 14 16:41:45 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:41:45 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:41:45 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:41:45 user nova-compute[73056]:   </os>
Aug 14 16:41:45 user nova-compute[73056]:   <features>
Aug 14 16:41:45 user nova-compute[73056]:     <acpi/>
Aug 14 16:41:45 user nova-compute[73056]:     <apic/>
Aug 14 16:41:45 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:41:45 user nova-compute[73056]:   </features>
Aug 14 16:41:45 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:41:45 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:41:45 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:41:45 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:41:45 user nova-compute[73056]:   </clock>
Aug 14 16:41:45 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:41:45 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:41:45 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:41:45 user nova-compute[73056]:   </cpu>
Aug 14 16:41:45 user nova-compute[73056]:   <devices>
Aug 14 16:41:45 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:41:45 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:41:45 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/b3270811-8241-47a6-aa36-0ec3feddf0fc/disk"/>
Aug 14 16:41:45 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:41:45 user nova-compute[73056]:     </disk>
Aug 14 16:41:45 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:41:45 user nova-compute[73056]:       <mac address="fa:16:3e:59:b3:5d"/>
Aug 14 16:41:45 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:41:45 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:41:45 user nova-compute[73056]:       <target dev="tap3bbc228a-d2"/>
Aug 14 16:41:45 user nova-compute[73056]:     </interface>
Aug 14 16:41:45 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:41:45 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/b3270811-8241-47a6-aa36-0ec3feddf0fc/console.log" append="off"/>
Aug 14 16:41:45 user nova-compute[73056]:     </serial>
Aug 14 16:41:45 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:41:45 user nova-compute[73056]:     <video>
Aug 14 16:41:45 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:41:45 user nova-compute[73056]:     </video>
Aug 14 16:41:45 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:41:45 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:41:45 user nova-compute[73056]:     </rng>
Aug 14 16:41:45 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:41:45 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:41:45 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:41:45 user nova-compute[73056]:     </memballoon>
Aug 14 16:41:45 user nova-compute[73056]:   </devices>
Aug 14 16:41:45 user nova-compute[73056]: </domain>
Aug 14 16:41:45 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:41:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-658979013',display_name='tempest-AttachVolumeNegativeTest-server-658979013',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-658979013',id=17,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgdKMXht7wKvUNqmuBaOUIIPCU/B/W9DuOqZntyGUMjOOjAEC3lEtom6fFaKfcSgzIbTodlH06RcAQKa+gRy66ZoQbyf11gwxlOR8cvibjUIEHsqGlSc8GrypseqH8nIA==',key_name='tempest-keypair-1175775660',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d5a8e599b3141339ed0ae6729031b36',ramdisk_id='',reservation_id='r-wz555gou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-860464885',owner_user_name='tempest-AttachVolumeNegativeTest-860464885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:41:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dad45adee1047bda7350d8a3f8a2f54',uuid=b3270811-8241-47a6-aa36-0ec3feddf0fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3bbc228a-d2bb-4b9f-a6d0-66b15010acdb", "address": "fa:16:3e:59:b3:5d", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bbc228a-d2", "ovs_interfaceid": "3bbc228a-d2bb-4b9f-a6d0-66b15010acdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Converting VIF {"id": "3bbc228a-d2bb-4b9f-a6d0-66b15010acdb", "address": "fa:16:3e:59:b3:5d", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bbc228a-d2", "ovs_interfaceid": "3bbc228a-d2bb-4b9f-a6d0-66b15010acdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:b3:5d,bridge_name='br-int',has_traffic_filtering=True,id=3bbc228a-d2bb-4b9f-a6d0-66b15010acdb,network=Network(ad323a8d-7318-46f5-8af4-cbc61ae589b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bbc228a-d2') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG os_vif [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:b3:5d,bridge_name='br-int',has_traffic_filtering=True,id=3bbc228a-d2bb-4b9f-a6d0-66b15010acdb,network=Network(ad323a8d-7318-46f5-8af4-cbc61ae589b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bbc228a-d2') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3bbc228a-d2, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3bbc228a-d2, col_values=(('external_ids', {'iface-id': '3bbc228a-d2bb-4b9f-a6d0-66b15010acdb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:b3:5d', 'vm-uuid': 'b3270811-8241-47a6-aa36-0ec3feddf0fc'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:45 user nova-compute[73056]: INFO os_vif [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:b3:5d,bridge_name='br-int',has_traffic_filtering=True,id=3bbc228a-d2bb-4b9f-a6d0-66b15010acdb,network=Network(ad323a8d-7318-46f5-8af4-cbc61ae589b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bbc228a-d2')
Aug 14 16:41:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] No VIF found with MAC fa:16:3e:59:b3:5d, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG nova.network.neutron [req-b60ce432-0d42-4a9a-be1b-a65bb1e27e31 req-037c6f74-dbcf-441c-b5a0-c40a9dc587c8 service nova] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Updated VIF entry in instance network info cache for port 3bbc228a-d2bb-4b9f-a6d0-66b15010acdb. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG nova.network.neutron [req-b60ce432-0d42-4a9a-be1b-a65bb1e27e31 req-037c6f74-dbcf-441c-b5a0-c40a9dc587c8 service nova] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Updating instance_info_cache with network_info: [{"id": "3bbc228a-d2bb-4b9f-a6d0-66b15010acdb", "address": "fa:16:3e:59:b3:5d", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bbc228a-d2", "ovs_interfaceid": "3bbc228a-d2bb-4b9f-a6d0-66b15010acdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:41:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-b60ce432-0d42-4a9a-be1b-a65bb1e27e31 req-037c6f74-dbcf-441c-b5a0-c40a9dc587c8 service nova] Releasing lock "refresh_cache-b3270811-8241-47a6-aa36-0ec3feddf0fc" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:41:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:46 user nova-compute[73056]: DEBUG nova.compute.manager [req-147f9697-ea49-4c60-a1f2-3d9e5d49c72a req-49d1efbe-596c-4e0b-921d-356133a89424 service nova] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Received event network-vif-plugged-3bbc228a-d2bb-4b9f-a6d0-66b15010acdb {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:41:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-147f9697-ea49-4c60-a1f2-3d9e5d49c72a req-49d1efbe-596c-4e0b-921d-356133a89424 service nova] Acquiring lock "b3270811-8241-47a6-aa36-0ec3feddf0fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:41:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-147f9697-ea49-4c60-a1f2-3d9e5d49c72a req-49d1efbe-596c-4e0b-921d-356133a89424 service nova] Lock "b3270811-8241-47a6-aa36-0ec3feddf0fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:41:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-147f9697-ea49-4c60-a1f2-3d9e5d49c72a req-49d1efbe-596c-4e0b-921d-356133a89424 service nova] Lock "b3270811-8241-47a6-aa36-0ec3feddf0fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:41:46 user nova-compute[73056]: DEBUG nova.compute.manager [req-147f9697-ea49-4c60-a1f2-3d9e5d49c72a req-49d1efbe-596c-4e0b-921d-356133a89424 service nova] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] No waiting events found dispatching network-vif-plugged-3bbc228a-d2bb-4b9f-a6d0-66b15010acdb {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:41:46 user nova-compute[73056]: WARNING nova.compute.manager [req-147f9697-ea49-4c60-a1f2-3d9e5d49c72a req-49d1efbe-596c-4e0b-921d-356133a89424 service nova] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Received unexpected event network-vif-plugged-3bbc228a-d2bb-4b9f-a6d0-66b15010acdb for instance with vm_state building and task_state spawning.
Aug 14 16:41:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:47 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692031292.6087916, 2c9cee38-2588-49e4-bda6-31661f7a9cd5 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:41:47 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] VM Stopped (Lifecycle Event)
Aug 14 16:41:47 user nova-compute[73056]: DEBUG nova.compute.manager [None req-b4e9839f-d249-4184-b822-c4e0d230722f None None] [instance: 2c9cee38-2588-49e4-bda6-31661f7a9cd5] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:41:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:48 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:41:48 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031308.7207303, b3270811-8241-47a6-aa36-0ec3feddf0fc => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:41:48 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] VM Resumed (Lifecycle Event)
Aug 14 16:41:48 user nova-compute[73056]: DEBUG nova.compute.manager [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:41:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:41:48 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Instance spawned successfully.
Aug 14 16:41:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:41:48 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:41:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:41:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:41:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:41:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:41:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:41:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:41:48 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:41:48 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:41:48 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031308.7220004, b3270811-8241-47a6-aa36-0ec3feddf0fc => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:41:48 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] VM Started (Lifecycle Event)
Aug 14 16:41:48 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:41:48 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:41:48 user nova-compute[73056]: DEBUG nova.compute.manager [req-34e546ab-0603-4925-b64c-b3f9a9105482 req-4adb79f9-7a56-4e77-8c94-514aaf2095a1 service nova] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Received event network-vif-plugged-3bbc228a-d2bb-4b9f-a6d0-66b15010acdb {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:41:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-34e546ab-0603-4925-b64c-b3f9a9105482 req-4adb79f9-7a56-4e77-8c94-514aaf2095a1 service nova] Acquiring lock "b3270811-8241-47a6-aa36-0ec3feddf0fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:41:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-34e546ab-0603-4925-b64c-b3f9a9105482 req-4adb79f9-7a56-4e77-8c94-514aaf2095a1 service nova] Lock "b3270811-8241-47a6-aa36-0ec3feddf0fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:41:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-34e546ab-0603-4925-b64c-b3f9a9105482 req-4adb79f9-7a56-4e77-8c94-514aaf2095a1 service nova] Lock "b3270811-8241-47a6-aa36-0ec3feddf0fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:41:48 user nova-compute[73056]: DEBUG nova.compute.manager [req-34e546ab-0603-4925-b64c-b3f9a9105482 req-4adb79f9-7a56-4e77-8c94-514aaf2095a1 service nova] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] No waiting events found dispatching network-vif-plugged-3bbc228a-d2bb-4b9f-a6d0-66b15010acdb {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:41:48 user nova-compute[73056]: WARNING nova.compute.manager [req-34e546ab-0603-4925-b64c-b3f9a9105482 req-4adb79f9-7a56-4e77-8c94-514aaf2095a1 service nova] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Received unexpected event network-vif-plugged-3bbc228a-d2bb-4b9f-a6d0-66b15010acdb for instance with vm_state building and task_state spawning.
Aug 14 16:41:48 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:41:48 user nova-compute[73056]: INFO nova.compute.manager [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Took 5.82 seconds to spawn the instance on the hypervisor.
Aug 14 16:41:48 user nova-compute[73056]: DEBUG nova.compute.manager [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:41:48 user nova-compute[73056]: INFO nova.compute.manager [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Took 6.68 seconds to build instance.
Aug 14 16:41:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3c212fc3-69c2-4edb-bf97-2bda6571a145 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "b3270811-8241-47a6-aa36-0ec3feddf0fc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.787s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:41:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:50 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:41:50 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:41:50 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 16:41:52 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:41:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:53 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:41:53 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:41:53 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 16:41:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-0fd5ba83-0612-4ce2-bd44-3ab55820022f" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:41:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-0fd5ba83-0612-4ce2-bd44-3ab55820022f" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:41:53 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 16:41:53 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Updating instance_info_cache with network_info: [{"id": "86a6c609-36e2-43e7-a675-670cdf35db58", "address": "fa:16:3e:eb:73:c7", "network": {"id": "2b53e507-f50b-411d-bce8-8769fc50bc28", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-515017098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4bf992869a24ad2b1d391e2baff2b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a6c609-36", "ovs_interfaceid": "86a6c609-36e2-43e7-a675-670cdf35db58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:41:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-0fd5ba83-0612-4ce2-bd44-3ab55820022f" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:41:53 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 16:41:53 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:41:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:41:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:41:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:41:54 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 16:41:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:41:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5ba83-0612-4ce2-bd44-3ab55820022f/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5ba83-0612-4ce2-bd44-3ab55820022f/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5ba83-0612-4ce2-bd44-3ab55820022f/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd5ba83-0612-4ce2-bd44-3ab55820022f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3270811-8241-47a6-aa36-0ec3feddf0fc/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3270811-8241-47a6-aa36-0ec3feddf0fc/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3270811-8241-47a6-aa36-0ec3feddf0fc/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3270811-8241-47a6-aa36-0ec3feddf0fc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:41:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:41:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:41:57 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:41:57 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:41:57 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=7446MB free_disk=25.558040618896484GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 16:41:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:41:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:41:58 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 9f3a7f8a-e3b9-4918-9663-968677fe5c90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:41:58 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 0fd5ba83-0612-4ce2-bd44-3ab55820022f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:41:58 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:41:58 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:41:58 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 18008990-9ed6-46e5-805c-4475e58855a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:41:58 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 4731f355-9307-4176-910b-cf35beb85e75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:41:58 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 9c11423c-88d3-4fae-8917-c0d57021d194 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:41:58 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance b3270811-8241-47a6-aa36-0ec3feddf0fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:41:58 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 16:41:58 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 16:41:58 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:41:58 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:41:58 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 16:41:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.560s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:41:58 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:41:58 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Cleaning up deleted instances {{(pid=73056) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 16:41:58 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] There are 0 instances to clean {{(pid=73056) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 16:41:58 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:41:58 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73056) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 16:41:58 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:41:58 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:41:58 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:41:58 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:42:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:42:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 16:42:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 16:42:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 16:42:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:22 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Acquiring lock "1beaec7b-ecd0-4586-b4b2-b04588ce9e2a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:42:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Lock "1beaec7b-ecd0-4586-b4b2-b04588ce9e2a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:42:24 user nova-compute[73056]: DEBUG nova.compute.manager [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:42:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:42:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:42:24 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:42:24 user nova-compute[73056]: INFO nova.compute.claims [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Claim successful on node user
Aug 14 16:42:24 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Refreshing inventories for resource provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 16:42:24 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Updating ProviderTree inventory for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 16:42:24 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Updating inventory in ProviderTree for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 16:42:24 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Refreshing aggregate associations for resource provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b, aggregates: None {{(pid=73056) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 16:42:24 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Refreshing trait associations for resource provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=73056) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 16:42:24 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:42:24 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:42:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.614s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:42:24 user nova-compute[73056]: DEBUG nova.compute.manager [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:42:24 user nova-compute[73056]: DEBUG nova.compute.manager [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:42:24 user nova-compute[73056]: DEBUG nova.network.neutron [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:42:24 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:42:24 user nova-compute[73056]: DEBUG nova.compute.manager [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:42:25 user nova-compute[73056]: DEBUG nova.compute.manager [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:42:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:42:25 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Creating image(s)
Aug 14 16:42:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Acquiring lock "/opt/stack/data/nova/instances/1beaec7b-ecd0-4586-b4b2-b04588ce9e2a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:42:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Lock "/opt/stack/data/nova/instances/1beaec7b-ecd0-4586-b4b2-b04588ce9e2a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:42:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Lock "/opt/stack/data/nova/instances/1beaec7b-ecd0-4586-b4b2-b04588ce9e2a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:42:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:25 user nova-compute[73056]: DEBUG nova.policy [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6f3c0d0bffd749299fe0bf8ab5aaf8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1bd35329054f4793440e9a780a0a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:42:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.170s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Acquiring lock "c889592ab94cd0b0ce896f27a2af0323771db234" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:42:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:42:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.171s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/1beaec7b-ecd0-4586-b4b2-b04588ce9e2a/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/1beaec7b-ecd0-4586-b4b2-b04588ce9e2a/disk 1073741824" returned: 0 in 0.057s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:42:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.212s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:25 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1beaec7b-ecd0-4586-b4b2-b04588ce9e2a/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 16:42:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1beaec7b-ecd0-4586-b4b2-b04588ce9e2a/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:25 user nova-compute[73056]: DEBUG nova.network.neutron [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Successfully created port: 19e38b07-dcc8-41aa-a433-38ca54ed0b4e {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:42:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1beaec7b-ecd0-4586-b4b2-b04588ce9e2a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:25 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Cannot resize image /opt/stack/data/nova/instances/1beaec7b-ecd0-4586-b4b2-b04588ce9e2a/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 16:42:25 user nova-compute[73056]: DEBUG nova.objects.instance [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Lazy-loading 'migration_context' on Instance uuid 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:42:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 16:42:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Ensure instance console log exists: /opt/stack/data/nova/instances/1beaec7b-ecd0-4586-b4b2-b04588ce9e2a/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:42:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:42:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:42:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:42:26 user nova-compute[73056]: DEBUG nova.network.neutron [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Successfully updated port: 19e38b07-dcc8-41aa-a433-38ca54ed0b4e {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:42:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Acquiring lock "refresh_cache-1beaec7b-ecd0-4586-b4b2-b04588ce9e2a" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:42:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Acquired lock "refresh_cache-1beaec7b-ecd0-4586-b4b2-b04588ce9e2a" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:42:26 user nova-compute[73056]: DEBUG nova.network.neutron [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:42:26 user nova-compute[73056]: DEBUG nova.compute.manager [req-fc558700-58b6-44be-b7fa-17eb0ca7742c req-17b1e78d-47c6-4bd1-b596-959018a3f92a service nova] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Received event network-changed-19e38b07-dcc8-41aa-a433-38ca54ed0b4e {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:42:26 user nova-compute[73056]: DEBUG nova.compute.manager [req-fc558700-58b6-44be-b7fa-17eb0ca7742c req-17b1e78d-47c6-4bd1-b596-959018a3f92a service nova] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Refreshing instance network info cache due to event network-changed-19e38b07-dcc8-41aa-a433-38ca54ed0b4e. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:42:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-fc558700-58b6-44be-b7fa-17eb0ca7742c req-17b1e78d-47c6-4bd1-b596-959018a3f92a service nova] Acquiring lock "refresh_cache-1beaec7b-ecd0-4586-b4b2-b04588ce9e2a" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:42:26 user nova-compute[73056]: DEBUG nova.network.neutron [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG nova.network.neutron [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Updating instance_info_cache with network_info: [{"id": "19e38b07-dcc8-41aa-a433-38ca54ed0b4e", "address": "fa:16:3e:38:40:27", "network": {"id": "90290111-0089-4535-9ba5-97fb3b034dcd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1526741248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1bd35329054f4793440e9a780a0a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e38b07-dc", "ovs_interfaceid": "19e38b07-dcc8-41aa-a433-38ca54ed0b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Releasing lock "refresh_cache-1beaec7b-ecd0-4586-b4b2-b04588ce9e2a" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG nova.compute.manager [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Instance network_info: |[{"id": "19e38b07-dcc8-41aa-a433-38ca54ed0b4e", "address": "fa:16:3e:38:40:27", "network": {"id": "90290111-0089-4535-9ba5-97fb3b034dcd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1526741248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1bd35329054f4793440e9a780a0a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e38b07-dc", "ovs_interfaceid": "19e38b07-dcc8-41aa-a433-38ca54ed0b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-fc558700-58b6-44be-b7fa-17eb0ca7742c req-17b1e78d-47c6-4bd1-b596-959018a3f92a service nova] Acquired lock "refresh_cache-1beaec7b-ecd0-4586-b4b2-b04588ce9e2a" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG nova.network.neutron [req-fc558700-58b6-44be-b7fa-17eb0ca7742c req-17b1e78d-47c6-4bd1-b596-959018a3f92a service nova] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Refreshing network info cache for port 19e38b07-dcc8-41aa-a433-38ca54ed0b4e {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Start _get_guest_xml network_info=[{"id": "19e38b07-dcc8-41aa-a433-38ca54ed0b4e", "address": "fa:16:3e:38:40:27", "network": {"id": "90290111-0089-4535-9ba5-97fb3b034dcd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1526741248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1bd35329054f4793440e9a780a0a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e38b07-dc", "ovs_interfaceid": "19e38b07-dcc8-41aa-a433-38ca54ed0b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:42:27 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:42:27 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:42:27 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:42:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1833232215',display_name='tempest-VolumesActionsTest-instance-1833232215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1833232215',id=18,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b1bd35329054f4793440e9a780a0a75',ramdisk_id='',reservation_id='r-n5jzi0on',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1822561302',owner_user_name='tempest-VolumesActionsTest-1822561302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:42:25Z,user_data=None,user_id='6f3c0d0bffd749299fe0bf8ab5aaf8c5',uuid=1beaec7b-ecd0-4586-b4b2-b04588ce9e2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19e38b07-dcc8-41aa-a433-38ca54ed0b4e", "address": "fa:16:3e:38:40:27", "network": {"id": "90290111-0089-4535-9ba5-97fb3b034dcd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1526741248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1bd35329054f4793440e9a780a0a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e38b07-dc", "ovs_interfaceid": "19e38b07-dcc8-41aa-a433-38ca54ed0b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Converting VIF {"id": "19e38b07-dcc8-41aa-a433-38ca54ed0b4e", "address": "fa:16:3e:38:40:27", "network": {"id": "90290111-0089-4535-9ba5-97fb3b034dcd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1526741248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1bd35329054f4793440e9a780a0a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e38b07-dc", "ovs_interfaceid": "19e38b07-dcc8-41aa-a433-38ca54ed0b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:40:27,bridge_name='br-int',has_traffic_filtering=True,id=19e38b07-dcc8-41aa-a433-38ca54ed0b4e,network=Network(90290111-0089-4535-9ba5-97fb3b034dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19e38b07-dc') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG nova.objects.instance [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Lazy-loading 'pci_devices' on Instance uuid 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:42:27 user nova-compute[73056]:   <uuid>1beaec7b-ecd0-4586-b4b2-b04588ce9e2a</uuid>
Aug 14 16:42:27 user nova-compute[73056]:   <name>instance-00000012</name>
Aug 14 16:42:27 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:42:27 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:42:27 user nova-compute[73056]:   <metadata>
Aug 14 16:42:27 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:42:27 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:42:27 user nova-compute[73056]:       <nova:name>tempest-VolumesActionsTest-instance-1833232215</nova:name>
Aug 14 16:42:27 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:42:27</nova:creationTime>
Aug 14 16:42:27 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:42:27 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:42:27 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:42:27 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:42:27 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:42:27 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:42:27 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:42:27 user nova-compute[73056]:       <nova:owner>
Aug 14 16:42:27 user nova-compute[73056]:         <nova:user uuid="6f3c0d0bffd749299fe0bf8ab5aaf8c5">tempest-VolumesActionsTest-1822561302-project-member</nova:user>
Aug 14 16:42:27 user nova-compute[73056]:         <nova:project uuid="3b1bd35329054f4793440e9a780a0a75">tempest-VolumesActionsTest-1822561302</nova:project>
Aug 14 16:42:27 user nova-compute[73056]:       </nova:owner>
Aug 14 16:42:27 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:42:27 user nova-compute[73056]:       <nova:ports>
Aug 14 16:42:27 user nova-compute[73056]:         <nova:port uuid="19e38b07-dcc8-41aa-a433-38ca54ed0b4e">
Aug 14 16:42:27 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 16:42:27 user nova-compute[73056]:         </nova:port>
Aug 14 16:42:27 user nova-compute[73056]:       </nova:ports>
Aug 14 16:42:27 user nova-compute[73056]:     </nova:instance>
Aug 14 16:42:27 user nova-compute[73056]:   </metadata>
Aug 14 16:42:27 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:42:27 user nova-compute[73056]:     <system>
Aug 14 16:42:27 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:42:27 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:42:27 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:42:27 user nova-compute[73056]:       <entry name="serial">1beaec7b-ecd0-4586-b4b2-b04588ce9e2a</entry>
Aug 14 16:42:27 user nova-compute[73056]:       <entry name="uuid">1beaec7b-ecd0-4586-b4b2-b04588ce9e2a</entry>
Aug 14 16:42:27 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:42:27 user nova-compute[73056]:     </system>
Aug 14 16:42:27 user nova-compute[73056]:   </sysinfo>
Aug 14 16:42:27 user nova-compute[73056]:   <os>
Aug 14 16:42:27 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:42:27 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:42:27 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:42:27 user nova-compute[73056]:   </os>
Aug 14 16:42:27 user nova-compute[73056]:   <features>
Aug 14 16:42:27 user nova-compute[73056]:     <acpi/>
Aug 14 16:42:27 user nova-compute[73056]:     <apic/>
Aug 14 16:42:27 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:42:27 user nova-compute[73056]:   </features>
Aug 14 16:42:27 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:42:27 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:42:27 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:42:27 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:42:27 user nova-compute[73056]:   </clock>
Aug 14 16:42:27 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:42:27 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:42:27 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:42:27 user nova-compute[73056]:   </cpu>
Aug 14 16:42:27 user nova-compute[73056]:   <devices>
Aug 14 16:42:27 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:42:27 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:42:27 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/1beaec7b-ecd0-4586-b4b2-b04588ce9e2a/disk"/>
Aug 14 16:42:27 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:42:27 user nova-compute[73056]:     </disk>
Aug 14 16:42:27 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:42:27 user nova-compute[73056]:       <mac address="fa:16:3e:38:40:27"/>
Aug 14 16:42:27 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:42:27 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:42:27 user nova-compute[73056]:       <target dev="tap19e38b07-dc"/>
Aug 14 16:42:27 user nova-compute[73056]:     </interface>
Aug 14 16:42:27 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:42:27 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/1beaec7b-ecd0-4586-b4b2-b04588ce9e2a/console.log" append="off"/>
Aug 14 16:42:27 user nova-compute[73056]:     </serial>
Aug 14 16:42:27 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:42:27 user nova-compute[73056]:     <video>
Aug 14 16:42:27 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:42:27 user nova-compute[73056]:     </video>
Aug 14 16:42:27 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:42:27 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:42:27 user nova-compute[73056]:     </rng>
Aug 14 16:42:27 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:42:27 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:42:27 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:42:27 user nova-compute[73056]:     </memballoon>
Aug 14 16:42:27 user nova-compute[73056]:   </devices>
Aug 14 16:42:27 user nova-compute[73056]: </domain>
Aug 14 16:42:27 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:42:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1833232215',display_name='tempest-VolumesActionsTest-instance-1833232215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1833232215',id=18,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b1bd35329054f4793440e9a780a0a75',ramdisk_id='',reservation_id='r-n5jzi0on',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1822561302',owner_user_name='tempest-VolumesActionsTest-1822561302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:42:25Z,user_data=None,user_id='6f3c0d0bffd749299fe0bf8ab5aaf8c5',uuid=1beaec7b-ecd0-4586-b4b2-b04588ce9e2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19e38b07-dcc8-41aa-a433-38ca54ed0b4e", "address": "fa:16:3e:38:40:27", "network": {"id": "90290111-0089-4535-9ba5-97fb3b034dcd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1526741248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1bd35329054f4793440e9a780a0a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e38b07-dc", "ovs_interfaceid": "19e38b07-dcc8-41aa-a433-38ca54ed0b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Converting VIF {"id": "19e38b07-dcc8-41aa-a433-38ca54ed0b4e", "address": "fa:16:3e:38:40:27", "network": {"id": "90290111-0089-4535-9ba5-97fb3b034dcd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1526741248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1bd35329054f4793440e9a780a0a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e38b07-dc", "ovs_interfaceid": "19e38b07-dcc8-41aa-a433-38ca54ed0b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:40:27,bridge_name='br-int',has_traffic_filtering=True,id=19e38b07-dcc8-41aa-a433-38ca54ed0b4e,network=Network(90290111-0089-4535-9ba5-97fb3b034dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19e38b07-dc') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG os_vif [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:40:27,bridge_name='br-int',has_traffic_filtering=True,id=19e38b07-dcc8-41aa-a433-38ca54ed0b4e,network=Network(90290111-0089-4535-9ba5-97fb3b034dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19e38b07-dc') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19e38b07-dc, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap19e38b07-dc, col_values=(('external_ids', {'iface-id': '19e38b07-dcc8-41aa-a433-38ca54ed0b4e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:40:27', 'vm-uuid': '1beaec7b-ecd0-4586-b4b2-b04588ce9e2a'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:27 user nova-compute[73056]: INFO os_vif [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:40:27,bridge_name='br-int',has_traffic_filtering=True,id=19e38b07-dcc8-41aa-a433-38ca54ed0b4e,network=Network(90290111-0089-4535-9ba5-97fb3b034dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19e38b07-dc')
Aug 14 16:42:27 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] No VIF found with MAC fa:16:3e:38:40:27, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:42:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:28 user nova-compute[73056]: DEBUG nova.network.neutron [req-fc558700-58b6-44be-b7fa-17eb0ca7742c req-17b1e78d-47c6-4bd1-b596-959018a3f92a service nova] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Updated VIF entry in instance network info cache for port 19e38b07-dcc8-41aa-a433-38ca54ed0b4e. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:42:28 user nova-compute[73056]: DEBUG nova.network.neutron [req-fc558700-58b6-44be-b7fa-17eb0ca7742c req-17b1e78d-47c6-4bd1-b596-959018a3f92a service nova] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Updating instance_info_cache with network_info: [{"id": "19e38b07-dcc8-41aa-a433-38ca54ed0b4e", "address": "fa:16:3e:38:40:27", "network": {"id": "90290111-0089-4535-9ba5-97fb3b034dcd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1526741248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1bd35329054f4793440e9a780a0a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e38b07-dc", "ovs_interfaceid": "19e38b07-dcc8-41aa-a433-38ca54ed0b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:42:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-fc558700-58b6-44be-b7fa-17eb0ca7742c req-17b1e78d-47c6-4bd1-b596-959018a3f92a service nova] Releasing lock "refresh_cache-1beaec7b-ecd0-4586-b4b2-b04588ce9e2a" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:42:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:28 user nova-compute[73056]: DEBUG nova.compute.manager [req-4c1b5e8a-8a1f-4fbb-82a2-ad3f42dedd29 req-44b1d023-d921-4fe8-85f9-9acb9525d6cd service nova] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Received event network-vif-plugged-19e38b07-dcc8-41aa-a433-38ca54ed0b4e {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:42:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4c1b5e8a-8a1f-4fbb-82a2-ad3f42dedd29 req-44b1d023-d921-4fe8-85f9-9acb9525d6cd service nova] Acquiring lock "1beaec7b-ecd0-4586-b4b2-b04588ce9e2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:42:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4c1b5e8a-8a1f-4fbb-82a2-ad3f42dedd29 req-44b1d023-d921-4fe8-85f9-9acb9525d6cd service nova] Lock "1beaec7b-ecd0-4586-b4b2-b04588ce9e2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:42:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4c1b5e8a-8a1f-4fbb-82a2-ad3f42dedd29 req-44b1d023-d921-4fe8-85f9-9acb9525d6cd service nova] Lock "1beaec7b-ecd0-4586-b4b2-b04588ce9e2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:42:28 user nova-compute[73056]: DEBUG nova.compute.manager [req-4c1b5e8a-8a1f-4fbb-82a2-ad3f42dedd29 req-44b1d023-d921-4fe8-85f9-9acb9525d6cd service nova] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] No waiting events found dispatching network-vif-plugged-19e38b07-dcc8-41aa-a433-38ca54ed0b4e {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:42:28 user nova-compute[73056]: WARNING nova.compute.manager [req-4c1b5e8a-8a1f-4fbb-82a2-ad3f42dedd29 req-44b1d023-d921-4fe8-85f9-9acb9525d6cd service nova] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Received unexpected event network-vif-plugged-19e38b07-dcc8-41aa-a433-38ca54ed0b4e for instance with vm_state building and task_state spawning.
Aug 14 16:42:29 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:29 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:29 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:29 user nova-compute[73056]: DEBUG nova.compute.manager [req-c735e384-e868-4fc7-bc54-62c513d6effc req-3bd3ab3e-3779-4da1-ab0b-d47dc6db985e service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Received event network-changed-90cb9090-537a-414e-ac09-1893281186c2 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:42:29 user nova-compute[73056]: DEBUG nova.compute.manager [req-c735e384-e868-4fc7-bc54-62c513d6effc req-3bd3ab3e-3779-4da1-ab0b-d47dc6db985e service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Refreshing instance network info cache due to event network-changed-90cb9090-537a-414e-ac09-1893281186c2. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:42:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c735e384-e868-4fc7-bc54-62c513d6effc req-3bd3ab3e-3779-4da1-ab0b-d47dc6db985e service nova] Acquiring lock "refresh_cache-18008990-9ed6-46e5-805c-4475e58855a6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:42:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c735e384-e868-4fc7-bc54-62c513d6effc req-3bd3ab3e-3779-4da1-ab0b-d47dc6db985e service nova] Acquired lock "refresh_cache-18008990-9ed6-46e5-805c-4475e58855a6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:42:29 user nova-compute[73056]: DEBUG nova.network.neutron [req-c735e384-e868-4fc7-bc54-62c513d6effc req-3bd3ab3e-3779-4da1-ab0b-d47dc6db985e service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Refreshing network info cache for port 90cb9090-537a-414e-ac09-1893281186c2 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:42:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-60764533-b522-47cd-90b9-1557d3c18378 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Acquiring lock "interface-18008990-9ed6-46e5-805c-4475e58855a6-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:42:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-60764533-b522-47cd-90b9-1557d3c18378 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lock "interface-18008990-9ed6-46e5-805c-4475e58855a6-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:42:30 user nova-compute[73056]: DEBUG nova.objects.instance [None req-60764533-b522-47cd-90b9-1557d3c18378 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lazy-loading 'flavor' on Instance uuid 18008990-9ed6-46e5-805c-4475e58855a6 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:42:30 user nova-compute[73056]: DEBUG nova.network.neutron [req-c735e384-e868-4fc7-bc54-62c513d6effc req-3bd3ab3e-3779-4da1-ab0b-d47dc6db985e service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Updated VIF entry in instance network info cache for port 90cb9090-537a-414e-ac09-1893281186c2. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:42:30 user nova-compute[73056]: DEBUG nova.network.neutron [req-c735e384-e868-4fc7-bc54-62c513d6effc req-3bd3ab3e-3779-4da1-ab0b-d47dc6db985e service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Updating instance_info_cache with network_info: [{"id": "90cb9090-537a-414e-ac09-1893281186c2", "address": "fa:16:3e:f2:46:30", "network": {"id": "d4aa57ea-03bd-491a-9861-e52c142e083c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1629351750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc25a4854a194e9283b568768daea226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90cb9090-53", "ovs_interfaceid": "90cb9090-537a-414e-ac09-1893281186c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:42:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c735e384-e868-4fc7-bc54-62c513d6effc req-3bd3ab3e-3779-4da1-ab0b-d47dc6db985e service nova] Releasing lock "refresh_cache-18008990-9ed6-46e5-805c-4475e58855a6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:42:30 user nova-compute[73056]: DEBUG nova.objects.instance [None req-60764533-b522-47cd-90b9-1557d3c18378 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lazy-loading 'pci_requests' on Instance uuid 18008990-9ed6-46e5-805c-4475e58855a6 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:42:30 user nova-compute[73056]: DEBUG nova.network.neutron [None req-60764533-b522-47cd-90b9-1557d3c18378 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:42:30 user nova-compute[73056]: DEBUG nova.policy [None req-60764533-b522-47cd-90b9-1557d3c18378 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '333c53f1db334c3aad3b1c7dca862e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc25a4854a194e9283b568768daea226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:42:30 user nova-compute[73056]: DEBUG nova.compute.manager [req-5d6115be-908b-48b7-a478-94a937dd0144 req-0fc9857c-0687-4a34-b050-a0e9f0927404 service nova] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Received event network-vif-plugged-19e38b07-dcc8-41aa-a433-38ca54ed0b4e {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:42:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-5d6115be-908b-48b7-a478-94a937dd0144 req-0fc9857c-0687-4a34-b050-a0e9f0927404 service nova] Acquiring lock "1beaec7b-ecd0-4586-b4b2-b04588ce9e2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:42:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-5d6115be-908b-48b7-a478-94a937dd0144 req-0fc9857c-0687-4a34-b050-a0e9f0927404 service nova] Lock "1beaec7b-ecd0-4586-b4b2-b04588ce9e2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:42:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-5d6115be-908b-48b7-a478-94a937dd0144 req-0fc9857c-0687-4a34-b050-a0e9f0927404 service nova] Lock "1beaec7b-ecd0-4586-b4b2-b04588ce9e2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:42:30 user nova-compute[73056]: DEBUG nova.compute.manager [req-5d6115be-908b-48b7-a478-94a937dd0144 req-0fc9857c-0687-4a34-b050-a0e9f0927404 service nova] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] No waiting events found dispatching network-vif-plugged-19e38b07-dcc8-41aa-a433-38ca54ed0b4e {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:42:30 user nova-compute[73056]: WARNING nova.compute.manager [req-5d6115be-908b-48b7-a478-94a937dd0144 req-0fc9857c-0687-4a34-b050-a0e9f0927404 service nova] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Received unexpected event network-vif-plugged-19e38b07-dcc8-41aa-a433-38ca54ed0b4e for instance with vm_state building and task_state spawning.
Aug 14 16:42:30 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031350.979114, 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:42:30 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] VM Resumed (Lifecycle Event)
Aug 14 16:42:30 user nova-compute[73056]: DEBUG nova.compute.manager [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:42:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:42:31 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Instance spawned successfully.
Aug 14 16:42:31 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:42:31 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:42:31 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:42:31 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:42:31 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:42:31 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:42:31 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:42:31 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:42:31 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:42:31 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:42:31 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031350.9838018, 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:42:31 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] VM Started (Lifecycle Event)
Aug 14 16:42:31 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:42:31 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:42:31 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:42:31 user nova-compute[73056]: INFO nova.compute.manager [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Took 6.06 seconds to spawn the instance on the hypervisor.
Aug 14 16:42:31 user nova-compute[73056]: DEBUG nova.compute.manager [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:42:31 user nova-compute[73056]: INFO nova.compute.manager [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Took 7.05 seconds to build instance.
Aug 14 16:42:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-35773d53-57dc-43c8-8c29-3edd7ebbec28 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Lock "1beaec7b-ecd0-4586-b4b2-b04588ce9e2a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.159s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:42:31 user nova-compute[73056]: DEBUG nova.network.neutron [None req-60764533-b522-47cd-90b9-1557d3c18378 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Successfully created port: 664963e1-f4ab-4f68-a310-5f321a2b0a21 {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:42:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:32 user nova-compute[73056]: DEBUG nova.network.neutron [None req-60764533-b522-47cd-90b9-1557d3c18378 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Successfully updated port: 664963e1-f4ab-4f68-a310-5f321a2b0a21 {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:42:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-60764533-b522-47cd-90b9-1557d3c18378 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Acquiring lock "refresh_cache-18008990-9ed6-46e5-805c-4475e58855a6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:42:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-60764533-b522-47cd-90b9-1557d3c18378 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Acquired lock "refresh_cache-18008990-9ed6-46e5-805c-4475e58855a6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:42:32 user nova-compute[73056]: DEBUG nova.network.neutron [None req-60764533-b522-47cd-90b9-1557d3c18378 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:42:32 user nova-compute[73056]: DEBUG nova.compute.manager [req-79f83dee-823b-4ed1-a07b-fc149e6c5334 req-0a268656-5ff7-47e0-8968-3f101cbabd55 service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Received event network-changed-664963e1-f4ab-4f68-a310-5f321a2b0a21 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:42:32 user nova-compute[73056]: DEBUG nova.compute.manager [req-79f83dee-823b-4ed1-a07b-fc149e6c5334 req-0a268656-5ff7-47e0-8968-3f101cbabd55 service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Refreshing instance network info cache due to event network-changed-664963e1-f4ab-4f68-a310-5f321a2b0a21. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:42:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-79f83dee-823b-4ed1-a07b-fc149e6c5334 req-0a268656-5ff7-47e0-8968-3f101cbabd55 service nova] Acquiring lock "refresh_cache-18008990-9ed6-46e5-805c-4475e58855a6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:42:33 user nova-compute[73056]: DEBUG nova.network.neutron [None req-60764533-b522-47cd-90b9-1557d3c18378 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Updating instance_info_cache with network_info: [{"id": "90cb9090-537a-414e-ac09-1893281186c2", "address": "fa:16:3e:f2:46:30", "network": {"id": "d4aa57ea-03bd-491a-9861-e52c142e083c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1629351750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc25a4854a194e9283b568768daea226", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90cb9090-53", "ovs_interfaceid": "90cb9090-537a-414e-ac09-1893281186c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "664963e1-f4ab-4f68-a310-5f321a2b0a21", "address": "fa:16:3e:dc:4f:2b", "network": {"id": "bb5a8d29-6265-47e7-b3f9-bd002a8ffb53", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-354574264", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bc25a4854a194e9283b568768daea226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664963e1-f4", "ovs_interfaceid": "664963e1-f4ab-4f68-a310-5f321a2b0a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:42:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-60764533-b522-47cd-90b9-1557d3c18378 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Releasing lock "refresh_cache-18008990-9ed6-46e5-805c-4475e58855a6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:42:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-79f83dee-823b-4ed1-a07b-fc149e6c5334 req-0a268656-5ff7-47e0-8968-3f101cbabd55 service nova] Acquired lock "refresh_cache-18008990-9ed6-46e5-805c-4475e58855a6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:42:33 user nova-compute[73056]: DEBUG nova.network.neutron [req-79f83dee-823b-4ed1-a07b-fc149e6c5334 req-0a268656-5ff7-47e0-8968-3f101cbabd55 service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Refreshing network info cache for port 664963e1-f4ab-4f68-a310-5f321a2b0a21 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:42:33 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-60764533-b522-47cd-90b9-1557d3c18378 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:40:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-208719382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-208719382',id=14,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHcJB5Em/BEdrrn+3nBSCQk8RXjQ9vXtMOi9k99zFp25ODkL4n/iUoo0VukLAcCxol9GBK/BdSObNT2aRPP96ToqXFULMlclvIpuOcZpv+502q1tzSo+JKq19K8Nkl5pQ==',key_name='tempest-keypair-370895944',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:40:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bc25a4854a194e9283b568768daea226',ramdisk_id='',reservation_id='r-pde63aya',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1768493659',owner_user_name='tempest-TaggedAttachmentsTest-1768493659-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:40:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='333c53f1db334c3aad3b1c7dca862e74',uuid=18008990-9ed6-46e5-805c-4475e58855a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "664963e1-f4ab-4f68-a310-5f321a2b0a21", "address": "fa:16:3e:dc:4f:2b", "network": {"id": "bb5a8d29-6265-47e7-b3f9-bd002a8ffb53", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-354574264", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bc25a4854a194e9283b568768daea226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664963e1-f4", "ovs_interfaceid": "664963e1-f4ab-4f68-a310-5f321a2b0a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:42:33 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-60764533-b522-47cd-90b9-1557d3c18378 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Converting VIF {"id": "664963e1-f4ab-4f68-a310-5f321a2b0a21", "address": "fa:16:3e:dc:4f:2b", "network": {"id": "bb5a8d29-6265-47e7-b3f9-bd002a8ffb53", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-354574264", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bc25a4854a194e9283b568768daea226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664963e1-f4", "ovs_interfaceid": "664963e1-f4ab-4f68-a310-5f321a2b0a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:42:33 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-60764533-b522-47cd-90b9-1557d3c18378 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:4f:2b,bridge_name='br-int',has_traffic_filtering=True,id=664963e1-f4ab-4f68-a310-5f321a2b0a21,network=Network(bb5a8d29-6265-47e7-b3f9-bd002a8ffb53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap664963e1-f4') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:42:33 user nova-compute[73056]: DEBUG os_vif [None req-60764533-b522-47cd-90b9-1557d3c18378 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:4f:2b,bridge_name='br-int',has_traffic_filtering=True,id=664963e1-f4ab-4f68-a310-5f321a2b0a21,network=Network(bb5a8d29-6265-47e7-b3f9-bd002a8ffb53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap664963e1-f4') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:42:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:42:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:42:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap664963e1-f4, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:42:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap664963e1-f4, col_values=(('external_ids', {'iface-id': '664963e1-f4ab-4f68-a310-5f321a2b0a21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:4f:2b', 'vm-uuid': '18008990-9ed6-46e5-805c-4475e58855a6'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:42:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:42:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:33 user nova-compute[73056]: INFO os_vif [None req-60764533-b522-47cd-90b9-1557d3c18378 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:4f:2b,bridge_name='br-int',has_traffic_filtering=True,id=664963e1-f4ab-4f68-a310-5f321a2b0a21,network=Network(bb5a8d29-6265-47e7-b3f9-bd002a8ffb53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap664963e1-f4')
Aug 14 16:42:33 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-60764533-b522-47cd-90b9-1557d3c18378 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:40:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-208719382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-208719382',id=14,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHcJB5Em/BEdrrn+3nBSCQk8RXjQ9vXtMOi9k99zFp25ODkL4n/iUoo0VukLAcCxol9GBK/BdSObNT2aRPP96ToqXFULMlclvIpuOcZpv+502q1tzSo+JKq19K8Nkl5pQ==',key_name='tempest-keypair-370895944',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:40:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bc25a4854a194e9283b568768daea226',ramdisk_id='',reservation_id='r-pde63aya',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1768493659',owner_user_name='tempest-TaggedAttachmentsTest-1768493659-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:40:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='333c53f1db334c3aad3b1c7dca862e74',uuid=18008990-9ed6-46e5-805c-4475e58855a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "664963e1-f4ab-4f68-a310-5f321a2b0a21", "address": "fa:16:3e:dc:4f:2b", "network": {"id": "bb5a8d29-6265-47e7-b3f9-bd002a8ffb53", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-354574264", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bc25a4854a194e9283b568768daea226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664963e1-f4", "ovs_interfaceid": "664963e1-f4ab-4f68-a310-5f321a2b0a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:42:33 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-60764533-b522-47cd-90b9-1557d3c18378 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Converting VIF {"id": "664963e1-f4ab-4f68-a310-5f321a2b0a21", "address": "fa:16:3e:dc:4f:2b", "network": {"id": "bb5a8d29-6265-47e7-b3f9-bd002a8ffb53", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-354574264", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bc25a4854a194e9283b568768daea226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664963e1-f4", "ovs_interfaceid": "664963e1-f4ab-4f68-a310-5f321a2b0a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:42:33 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-60764533-b522-47cd-90b9-1557d3c18378 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:4f:2b,bridge_name='br-int',has_traffic_filtering=True,id=664963e1-f4ab-4f68-a310-5f321a2b0a21,network=Network(bb5a8d29-6265-47e7-b3f9-bd002a8ffb53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap664963e1-f4') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:42:33 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-60764533-b522-47cd-90b9-1557d3c18378 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] attach device xml: <interface type="ethernet">
Aug 14 16:42:33 user nova-compute[73056]:   <mac address="fa:16:3e:dc:4f:2b"/>
Aug 14 16:42:33 user nova-compute[73056]:   <model type="virtio"/>
Aug 14 16:42:33 user nova-compute[73056]:   <mtu size="1442"/>
Aug 14 16:42:33 user nova-compute[73056]:   <target dev="tap664963e1-f4"/>
Aug 14 16:42:33 user nova-compute[73056]: </interface>
Aug 14 16:42:33 user nova-compute[73056]:  {{(pid=73056) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 16:42:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:34 user nova-compute[73056]: DEBUG nova.compute.manager [req-0c0d7311-4236-4734-ba69-033862d8198b req-1232eea1-d8d2-48d2-87c3-66f76bdeaf0c service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Received event network-vif-plugged-664963e1-f4ab-4f68-a310-5f321a2b0a21 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:42:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0c0d7311-4236-4734-ba69-033862d8198b req-1232eea1-d8d2-48d2-87c3-66f76bdeaf0c service nova] Acquiring lock "18008990-9ed6-46e5-805c-4475e58855a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:42:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0c0d7311-4236-4734-ba69-033862d8198b req-1232eea1-d8d2-48d2-87c3-66f76bdeaf0c service nova] Lock "18008990-9ed6-46e5-805c-4475e58855a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:42:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0c0d7311-4236-4734-ba69-033862d8198b req-1232eea1-d8d2-48d2-87c3-66f76bdeaf0c service nova] Lock "18008990-9ed6-46e5-805c-4475e58855a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:42:34 user nova-compute[73056]: DEBUG nova.compute.manager [req-0c0d7311-4236-4734-ba69-033862d8198b req-1232eea1-d8d2-48d2-87c3-66f76bdeaf0c service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] No waiting events found dispatching network-vif-plugged-664963e1-f4ab-4f68-a310-5f321a2b0a21 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:42:34 user nova-compute[73056]: WARNING nova.compute.manager [req-0c0d7311-4236-4734-ba69-033862d8198b req-1232eea1-d8d2-48d2-87c3-66f76bdeaf0c service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Received unexpected event network-vif-plugged-664963e1-f4ab-4f68-a310-5f321a2b0a21 for instance with vm_state active and task_state None.
Aug 14 16:42:34 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-60764533-b522-47cd-90b9-1557d3c18378 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:42:34 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-60764533-b522-47cd-90b9-1557d3c18378 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] No BDM found with device name hda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:42:34 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-60764533-b522-47cd-90b9-1557d3c18378 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] No VIF found with MAC fa:16:3e:f2:46:30, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:42:34 user nova-compute[73056]: DEBUG nova.network.neutron [req-79f83dee-823b-4ed1-a07b-fc149e6c5334 req-0a268656-5ff7-47e0-8968-3f101cbabd55 service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Updated VIF entry in instance network info cache for port 664963e1-f4ab-4f68-a310-5f321a2b0a21. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:42:34 user nova-compute[73056]: DEBUG nova.network.neutron [req-79f83dee-823b-4ed1-a07b-fc149e6c5334 req-0a268656-5ff7-47e0-8968-3f101cbabd55 service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Updating instance_info_cache with network_info: [{"id": "90cb9090-537a-414e-ac09-1893281186c2", "address": "fa:16:3e:f2:46:30", "network": {"id": "d4aa57ea-03bd-491a-9861-e52c142e083c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1629351750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc25a4854a194e9283b568768daea226", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90cb9090-53", "ovs_interfaceid": "90cb9090-537a-414e-ac09-1893281186c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "664963e1-f4ab-4f68-a310-5f321a2b0a21", "address": "fa:16:3e:dc:4f:2b", "network": {"id": "bb5a8d29-6265-47e7-b3f9-bd002a8ffb53", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-354574264", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bc25a4854a194e9283b568768daea226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664963e1-f4", "ovs_interfaceid": "664963e1-f4ab-4f68-a310-5f321a2b0a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:42:34 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-60764533-b522-47cd-90b9-1557d3c18378 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:42:34 user nova-compute[73056]:   <nova:package version="0.0.0"/>
Aug 14 16:42:34 user nova-compute[73056]:   <nova:name>tempest-device-tagging-server-208719382</nova:name>
Aug 14 16:42:34 user nova-compute[73056]:   <nova:creationTime>2023-08-14 16:42:34</nova:creationTime>
Aug 14 16:42:34 user nova-compute[73056]:   <nova:flavor name="m1.tiny">
Aug 14 16:42:34 user nova-compute[73056]:     <nova:memory>512</nova:memory>
Aug 14 16:42:34 user nova-compute[73056]:     <nova:disk>1</nova:disk>
Aug 14 16:42:34 user nova-compute[73056]:     <nova:swap>0</nova:swap>
Aug 14 16:42:34 user nova-compute[73056]:     <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:42:34 user nova-compute[73056]:     <nova:vcpus>1</nova:vcpus>
Aug 14 16:42:34 user nova-compute[73056]:   </nova:flavor>
Aug 14 16:42:34 user nova-compute[73056]:   <nova:owner>
Aug 14 16:42:34 user nova-compute[73056]:     <nova:user uuid="333c53f1db334c3aad3b1c7dca862e74">tempest-TaggedAttachmentsTest-1768493659-project-member</nova:user>
Aug 14 16:42:34 user nova-compute[73056]:     <nova:project uuid="bc25a4854a194e9283b568768daea226">tempest-TaggedAttachmentsTest-1768493659</nova:project>
Aug 14 16:42:34 user nova-compute[73056]:   </nova:owner>
Aug 14 16:42:34 user nova-compute[73056]:   <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:42:34 user nova-compute[73056]:   <nova:ports>
Aug 14 16:42:34 user nova-compute[73056]:     <nova:port uuid="90cb9090-537a-414e-ac09-1893281186c2">
Aug 14 16:42:34 user nova-compute[73056]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 14 16:42:34 user nova-compute[73056]:     </nova:port>
Aug 14 16:42:34 user nova-compute[73056]:     <nova:port uuid="664963e1-f4ab-4f68-a310-5f321a2b0a21">
Aug 14 16:42:34 user nova-compute[73056]:       <nova:ip type="fixed" address="10.10.10.45" ipVersion="4"/>
Aug 14 16:42:34 user nova-compute[73056]:     </nova:port>
Aug 14 16:42:34 user nova-compute[73056]:   </nova:ports>
Aug 14 16:42:34 user nova-compute[73056]: </nova:instance>
Aug 14 16:42:34 user nova-compute[73056]:  {{(pid=73056) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 14 16:42:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-79f83dee-823b-4ed1-a07b-fc149e6c5334 req-0a268656-5ff7-47e0-8968-3f101cbabd55 service nova] Releasing lock "refresh_cache-18008990-9ed6-46e5-805c-4475e58855a6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:42:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-60764533-b522-47cd-90b9-1557d3c18378 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lock "interface-18008990-9ed6-46e5-805c-4475e58855a6-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.890s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:42:34 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:34 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:34 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:34 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:34 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Acquiring lock "18008990-9ed6-46e5-805c-4475e58855a6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:42:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lock "18008990-9ed6-46e5-805c-4475e58855a6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:42:34 user nova-compute[73056]: DEBUG nova.objects.instance [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lazy-loading 'flavor' on Instance uuid 18008990-9ed6-46e5-805c-4475e58855a6 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:42:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lock "18008990-9ed6-46e5-805c-4475e58855a6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:42:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Acquiring lock "18008990-9ed6-46e5-805c-4475e58855a6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:42:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lock "18008990-9ed6-46e5-805c-4475e58855a6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:42:34 user nova-compute[73056]: INFO nova.compute.manager [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Attaching volume 8cac313f-c53b-4d02-b5ab-f27592e46c53 to /dev/vdb
Aug 14 16:42:34 user nova-compute[73056]: DEBUG os_brick.utils [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:42:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6f4b6c37-3d9a-418d-a714-dc52b37ca0f5 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquiring lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:42:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6f4b6c37-3d9a-418d-a714-dc52b37ca0f5 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:42:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6f4b6c37-3d9a-418d-a714-dc52b37ca0f5 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquiring lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:42:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6f4b6c37-3d9a-418d-a714-dc52b37ca0f5 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:42:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6f4b6c37-3d9a-418d-a714-dc52b37ca0f5 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:42:34 user nova-compute[73056]: INFO nova.compute.manager [None req-6f4b6c37-3d9a-418d-a714-dc52b37ca0f5 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Terminating instance
Aug 14 16:42:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.028s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:34 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b4838a-ed1c-4336-9059-d57f09331fb2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:42:34 user nova-compute[73056]: DEBUG nova.compute.manager [None req-6f4b6c37-3d9a-418d-a714-dc52b37ca0f5 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 16:42:35 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:35 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:35 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[70675ac0-d866-4ac8-b58f-a6f13c695747]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:42:35 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:35 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:35 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[22007b64-65da-44e3-8508-368dc6f1dd0b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:42:35 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[87aa0902-bf21-443a-a4c7-5935a3a1790a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:42:35 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:35 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:42:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:35 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:42:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:35 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:35 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:42:35 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:42:35 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15c005b-bfd8-4fe9-9ba0-7d553aa93928]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:42:35 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:42:35 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:42:35 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:42:35 user nova-compute[73056]: DEBUG os_brick.utils [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] <== get_connector_properties: return (191ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:42:35 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Updating existing volume attachment record: 8e369069-a405-4286-b36e-53909e8768ce {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 16:42:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:35 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Instance destroyed successfully.
Aug 14 16:42:35 user nova-compute[73056]: DEBUG nova.objects.instance [None req-6f4b6c37-3d9a-418d-a714-dc52b37ca0f5 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lazy-loading 'resources' on Instance uuid 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:42:35 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-6f4b6c37-3d9a-418d-a714-dc52b37ca0f5 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:36:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-364355732',display_name='tempest-TestMinimumBasicScenario-server-364355732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-364355732',id=8,image_ref='db2f8653-21f9-470f-aa59-8a25169ac11e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuQWFEsEgmiiXIvuQi3N5xOhs1P8YjYnRlzicPQUcOOw+2bb9wXe4RzvSbe0On1iDTJZMKYHX2WGcWfSPj8whHQVrmn2R8JQ6dGhqXQ/Yqt8WAGBvV80bIdSH+vTO7dOA==',key_name='tempest-TestMinimumBasicScenario-2085563484',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:37:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95e6131531ab4553b55ea090d5e7f47d',ramdisk_id='',reservation_id='r-3mcfhmfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='db2f8653-21f9-470f-aa59-8a25169ac11e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2039952053',owner_user_name='tempest-TestMinimumBasicScenario-2039952053-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:39:49Z,user_data=None,user_id='78a1ab88047b4199bb611c0d7c8d6dee',uuid=9bb2cf77-cd65-49fd-a85b-d7961c2db3bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "address": "fa:16:3e:8d:d8:88", "network": {"id": "dd844e8d-9264-4868-819d-0b01ad3b1d41", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-568480417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e6131531ab4553b55ea090d5e7f47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7ab99b-ea", "ovs_interfaceid": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:42:35 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-6f4b6c37-3d9a-418d-a714-dc52b37ca0f5 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Converting VIF {"id": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "address": "fa:16:3e:8d:d8:88", "network": {"id": "dd844e8d-9264-4868-819d-0b01ad3b1d41", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-568480417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e6131531ab4553b55ea090d5e7f47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7ab99b-ea", "ovs_interfaceid": "1f7ab99b-ea66-43bf-91e2-da6938d28d2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:42:35 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-6f4b6c37-3d9a-418d-a714-dc52b37ca0f5 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:d8:88,bridge_name='br-int',has_traffic_filtering=True,id=1f7ab99b-ea66-43bf-91e2-da6938d28d2f,network=Network(dd844e8d-9264-4868-819d-0b01ad3b1d41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7ab99b-ea') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:42:35 user nova-compute[73056]: DEBUG os_vif [None req-6f4b6c37-3d9a-418d-a714-dc52b37ca0f5 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:d8:88,bridge_name='br-int',has_traffic_filtering=True,id=1f7ab99b-ea66-43bf-91e2-da6938d28d2f,network=Network(dd844e8d-9264-4868-819d-0b01ad3b1d41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7ab99b-ea') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:42:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f7ab99b-ea, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:42:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:35 user nova-compute[73056]: INFO os_vif [None req-6f4b6c37-3d9a-418d-a714-dc52b37ca0f5 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:d8:88,bridge_name='br-int',has_traffic_filtering=True,id=1f7ab99b-ea66-43bf-91e2-da6938d28d2f,network=Network(dd844e8d-9264-4868-819d-0b01ad3b1d41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7ab99b-ea')
Aug 14 16:42:35 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-6f4b6c37-3d9a-418d-a714-dc52b37ca0f5 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Deleting instance files /opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf_del
Aug 14 16:42:35 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-6f4b6c37-3d9a-418d-a714-dc52b37ca0f5 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Deletion of /opt/stack/data/nova/instances/9bb2cf77-cd65-49fd-a85b-d7961c2db3bf_del complete
Aug 14 16:42:36 user nova-compute[73056]: INFO nova.compute.manager [None req-6f4b6c37-3d9a-418d-a714-dc52b37ca0f5 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 14 16:42:36 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-6f4b6c37-3d9a-418d-a714-dc52b37ca0f5 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 16:42:36 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 16:42:36 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 16:42:36 user nova-compute[73056]: DEBUG nova.compute.manager [req-e112fe9c-0c3c-463d-9057-97abf126e193 req-9a4d4eda-43ff-43cd-ac59-1666738155bd service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Received event network-vif-plugged-664963e1-f4ab-4f68-a310-5f321a2b0a21 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:42:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e112fe9c-0c3c-463d-9057-97abf126e193 req-9a4d4eda-43ff-43cd-ac59-1666738155bd service nova] Acquiring lock "18008990-9ed6-46e5-805c-4475e58855a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:42:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e112fe9c-0c3c-463d-9057-97abf126e193 req-9a4d4eda-43ff-43cd-ac59-1666738155bd service nova] Lock "18008990-9ed6-46e5-805c-4475e58855a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:42:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e112fe9c-0c3c-463d-9057-97abf126e193 req-9a4d4eda-43ff-43cd-ac59-1666738155bd service nova] Lock "18008990-9ed6-46e5-805c-4475e58855a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:42:36 user nova-compute[73056]: DEBUG nova.compute.manager [req-e112fe9c-0c3c-463d-9057-97abf126e193 req-9a4d4eda-43ff-43cd-ac59-1666738155bd service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] No waiting events found dispatching network-vif-plugged-664963e1-f4ab-4f68-a310-5f321a2b0a21 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:42:36 user nova-compute[73056]: WARNING nova.compute.manager [req-e112fe9c-0c3c-463d-9057-97abf126e193 req-9a4d4eda-43ff-43cd-ac59-1666738155bd service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Received unexpected event network-vif-plugged-664963e1-f4ab-4f68-a310-5f321a2b0a21 for instance with vm_state active and task_state None.
Aug 14 16:42:36 user nova-compute[73056]: DEBUG nova.compute.manager [req-e112fe9c-0c3c-463d-9057-97abf126e193 req-9a4d4eda-43ff-43cd-ac59-1666738155bd service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Received event network-vif-unplugged-1f7ab99b-ea66-43bf-91e2-da6938d28d2f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:42:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e112fe9c-0c3c-463d-9057-97abf126e193 req-9a4d4eda-43ff-43cd-ac59-1666738155bd service nova] Acquiring lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:42:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e112fe9c-0c3c-463d-9057-97abf126e193 req-9a4d4eda-43ff-43cd-ac59-1666738155bd service nova] Lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:42:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e112fe9c-0c3c-463d-9057-97abf126e193 req-9a4d4eda-43ff-43cd-ac59-1666738155bd service nova] Lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:42:36 user nova-compute[73056]: DEBUG nova.compute.manager [req-e112fe9c-0c3c-463d-9057-97abf126e193 req-9a4d4eda-43ff-43cd-ac59-1666738155bd service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] No waiting events found dispatching network-vif-unplugged-1f7ab99b-ea66-43bf-91e2-da6938d28d2f {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:42:36 user nova-compute[73056]: DEBUG nova.compute.manager [req-e112fe9c-0c3c-463d-9057-97abf126e193 req-9a4d4eda-43ff-43cd-ac59-1666738155bd service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Received event network-vif-unplugged-1f7ab99b-ea66-43bf-91e2-da6938d28d2f for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:42:36 user nova-compute[73056]: DEBUG nova.compute.manager [req-e112fe9c-0c3c-463d-9057-97abf126e193 req-9a4d4eda-43ff-43cd-ac59-1666738155bd service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Received event network-vif-plugged-1f7ab99b-ea66-43bf-91e2-da6938d28d2f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:42:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e112fe9c-0c3c-463d-9057-97abf126e193 req-9a4d4eda-43ff-43cd-ac59-1666738155bd service nova] Acquiring lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:42:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e112fe9c-0c3c-463d-9057-97abf126e193 req-9a4d4eda-43ff-43cd-ac59-1666738155bd service nova] Lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:42:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e112fe9c-0c3c-463d-9057-97abf126e193 req-9a4d4eda-43ff-43cd-ac59-1666738155bd service nova] Lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:42:36 user nova-compute[73056]: DEBUG nova.compute.manager [req-e112fe9c-0c3c-463d-9057-97abf126e193 req-9a4d4eda-43ff-43cd-ac59-1666738155bd service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] No waiting events found dispatching network-vif-plugged-1f7ab99b-ea66-43bf-91e2-da6938d28d2f {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:42:36 user nova-compute[73056]: WARNING nova.compute.manager [req-e112fe9c-0c3c-463d-9057-97abf126e193 req-9a4d4eda-43ff-43cd-ac59-1666738155bd service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Received unexpected event network-vif-plugged-1f7ab99b-ea66-43bf-91e2-da6938d28d2f for instance with vm_state active and task_state deleting.
Aug 14 16:42:36 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:42:36 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Took 0.72 seconds to deallocate network for instance.
Aug 14 16:42:36 user nova-compute[73056]: DEBUG nova.compute.manager [req-33b5b97c-8939-4191-a820-996b9be01b75 req-2a8dd82d-a9ef-488a-8ebe-f8c897facf33 service nova] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Received event network-vif-deleted-1f7ab99b-ea66-43bf-91e2-da6938d28d2f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:42:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6f4b6c37-3d9a-418d-a714-dc52b37ca0f5 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:42:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6f4b6c37-3d9a-418d-a714-dc52b37ca0f5 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:42:37 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-6f4b6c37-3d9a-418d-a714-dc52b37ca0f5 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:42:37 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-6f4b6c37-3d9a-418d-a714-dc52b37ca0f5 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:42:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6f4b6c37-3d9a-418d-a714-dc52b37ca0f5 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.387s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:42:37 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-6f4b6c37-3d9a-418d-a714-dc52b37ca0f5 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Deleted allocations for instance 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf
Aug 14 16:42:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6f4b6c37-3d9a-418d-a714-dc52b37ca0f5 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "9bb2cf77-cd65-49fd-a85b-d7961c2db3bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.370s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:42:37 user nova-compute[73056]: DEBUG nova.compute.manager [req-007f7ff2-469e-466f-b81d-df6646654dbe req-16adef96-802e-438a-8b1f-8a3503e75e64 service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Received event network-changed-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:42:37 user nova-compute[73056]: DEBUG nova.compute.manager [req-007f7ff2-469e-466f-b81d-df6646654dbe req-16adef96-802e-438a-8b1f-8a3503e75e64 service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Refreshing instance network info cache due to event network-changed-83386dcc-c4f0-49aa-8bd0-43fd3b202c46. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:42:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-007f7ff2-469e-466f-b81d-df6646654dbe req-16adef96-802e-438a-8b1f-8a3503e75e64 service nova] Acquiring lock "refresh_cache-4731f355-9307-4176-910b-cf35beb85e75" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:42:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-007f7ff2-469e-466f-b81d-df6646654dbe req-16adef96-802e-438a-8b1f-8a3503e75e64 service nova] Acquired lock "refresh_cache-4731f355-9307-4176-910b-cf35beb85e75" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:42:37 user nova-compute[73056]: DEBUG nova.network.neutron [req-007f7ff2-469e-466f-b81d-df6646654dbe req-16adef96-802e-438a-8b1f-8a3503e75e64 service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Refreshing network info cache for port 83386dcc-c4f0-49aa-8bd0-43fd3b202c46 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:42:37 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:38 user nova-compute[73056]: DEBUG nova.network.neutron [req-007f7ff2-469e-466f-b81d-df6646654dbe req-16adef96-802e-438a-8b1f-8a3503e75e64 service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Updated VIF entry in instance network info cache for port 83386dcc-c4f0-49aa-8bd0-43fd3b202c46. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:42:38 user nova-compute[73056]: DEBUG nova.network.neutron [req-007f7ff2-469e-466f-b81d-df6646654dbe req-16adef96-802e-438a-8b1f-8a3503e75e64 service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Updating instance_info_cache with network_info: [{"id": "83386dcc-c4f0-49aa-8bd0-43fd3b202c46", "address": "fa:16:3e:2d:f9:8e", "network": {"id": "cf5d30f2-97c6-4785-83d2-549eeb6eca88", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1151628801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd5d50a2601044b5aef50a0d0c6e311a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83386dcc-c4", "ovs_interfaceid": "83386dcc-c4f0-49aa-8bd0-43fd3b202c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:42:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-007f7ff2-469e-466f-b81d-df6646654dbe req-16adef96-802e-438a-8b1f-8a3503e75e64 service nova] Releasing lock "refresh_cache-4731f355-9307-4176-910b-cf35beb85e75" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:42:38 user nova-compute[73056]: DEBUG nova.compute.manager [None req-27ebab52-cbc3-438c-ac29-71074e7d64a1 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:42:38 user nova-compute[73056]: INFO nova.compute.manager [None req-27ebab52-cbc3-438c-ac29-71074e7d64a1 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] instance snapshotting
Aug 14 16:42:38 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-27ebab52-cbc3-438c-ac29-71074e7d64a1 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Beginning live snapshot process
Aug 14 16:42:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-27ebab52-cbc3-438c-ac29-71074e7d64a1 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk --force-share --output=json -f qcow2 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-27ebab52-cbc3-438c-ac29-71074e7d64a1 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-27ebab52-cbc3-438c-ac29-71074e7d64a1 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk --force-share --output=json -f qcow2 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-27ebab52-cbc3-438c-ac29-71074e7d64a1 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk --force-share --output=json -f qcow2" returned: 0 in 0.213s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-27ebab52-cbc3-438c-ac29-71074e7d64a1 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-27ebab52-cbc3-438c-ac29-71074e7d64a1 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.217s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-27ebab52-cbc3-438c-ac29-71074e7d64a1 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_zztcznb/4442bc33c57544ef939f054ee84a38d7.delta 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-27ebab52-cbc3-438c-ac29-71074e7d64a1 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_zztcznb/4442bc33c57544ef939f054ee84a38d7.delta 1073741824" returned: 0 in 0.058s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:39 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-27ebab52-cbc3-438c-ac29-71074e7d64a1 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 14 16:42:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-123ab545-92e5-4947-9314-bd57c4479055 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Acquiring lock "0fd5ba83-0612-4ce2-bd44-3ab55820022f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:42:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-123ab545-92e5-4947-9314-bd57c4479055 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "0fd5ba83-0612-4ce2-bd44-3ab55820022f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:42:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-123ab545-92e5-4947-9314-bd57c4479055 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Acquiring lock "0fd5ba83-0612-4ce2-bd44-3ab55820022f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:42:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-123ab545-92e5-4947-9314-bd57c4479055 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "0fd5ba83-0612-4ce2-bd44-3ab55820022f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:42:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-123ab545-92e5-4947-9314-bd57c4479055 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "0fd5ba83-0612-4ce2-bd44-3ab55820022f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:42:39 user nova-compute[73056]: INFO nova.compute.manager [None req-123ab545-92e5-4947-9314-bd57c4479055 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Terminating instance
Aug 14 16:42:39 user nova-compute[73056]: DEBUG nova.compute.manager [None req-123ab545-92e5-4947-9314-bd57c4479055 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 16:42:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:40 user nova-compute[73056]: DEBUG nova.compute.manager [req-79e80dc2-7ddc-4b21-9901-914a247dfc09 req-5e3ee97e-da79-40f6-b277-b3c52474a418 service nova] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Received event network-vif-unplugged-86a6c609-36e2-43e7-a675-670cdf35db58 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:42:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-79e80dc2-7ddc-4b21-9901-914a247dfc09 req-5e3ee97e-da79-40f6-b277-b3c52474a418 service nova] Acquiring lock "0fd5ba83-0612-4ce2-bd44-3ab55820022f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:42:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-79e80dc2-7ddc-4b21-9901-914a247dfc09 req-5e3ee97e-da79-40f6-b277-b3c52474a418 service nova] Lock "0fd5ba83-0612-4ce2-bd44-3ab55820022f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:42:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-79e80dc2-7ddc-4b21-9901-914a247dfc09 req-5e3ee97e-da79-40f6-b277-b3c52474a418 service nova] Lock "0fd5ba83-0612-4ce2-bd44-3ab55820022f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:42:40 user nova-compute[73056]: DEBUG nova.compute.manager [req-79e80dc2-7ddc-4b21-9901-914a247dfc09 req-5e3ee97e-da79-40f6-b277-b3c52474a418 service nova] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] No waiting events found dispatching network-vif-unplugged-86a6c609-36e2-43e7-a675-670cdf35db58 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:42:40 user nova-compute[73056]: DEBUG nova.compute.manager [req-79e80dc2-7ddc-4b21-9901-914a247dfc09 req-5e3ee97e-da79-40f6-b277-b3c52474a418 service nova] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Received event network-vif-unplugged-86a6c609-36e2-43e7-a675-670cdf35db58 for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:42:40 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-27ebab52-cbc3-438c-ac29-71074e7d64a1 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73056) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 16:42:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:41 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Instance destroyed successfully.
Aug 14 16:42:41 user nova-compute[73056]: DEBUG nova.objects.instance [None req-123ab545-92e5-4947-9314-bd57c4479055 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lazy-loading 'resources' on Instance uuid 0fd5ba83-0612-4ce2-bd44-3ab55820022f {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:42:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-123ab545-92e5-4947-9314-bd57c4479055 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:36:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-498074295',display_name='tempest-VolumesAdminNegativeTest-server-498074295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-498074295',id=3,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/0vU3HnKRG9rpjc5H2uxQKlyyAwpIusoCgH/Y/hhnjCtdnXDZ3eXcSDOWAEMecoqCaXZDbNfjdCPjEcdr6ttmUXsXmC+M+alfpqkGA1bv+tU67mp4F+YXj6mZh84t5Kw==',key_name='tempest-keypair-170937755',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:36:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4bf992869a24ad2b1d391e2baff2b34',ramdisk_id='',reservation_id='r-c8z5r1xj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1902234353',owner_user_name='tempest-VolumesAdminNegativeTest-1902234353-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:36:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b76fb5a2ba84410584b31e9006c67f37',uuid=0fd5ba83-0612-4ce2-bd44-3ab55820022f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86a6c609-36e2-43e7-a675-670cdf35db58", "address": "fa:16:3e:eb:73:c7", "network": {"id": "2b53e507-f50b-411d-bce8-8769fc50bc28", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-515017098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4bf992869a24ad2b1d391e2baff2b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a6c609-36", "ovs_interfaceid": "86a6c609-36e2-43e7-a675-670cdf35db58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:42:41 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-123ab545-92e5-4947-9314-bd57c4479055 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Converting VIF {"id": "86a6c609-36e2-43e7-a675-670cdf35db58", "address": "fa:16:3e:eb:73:c7", "network": {"id": "2b53e507-f50b-411d-bce8-8769fc50bc28", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-515017098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4bf992869a24ad2b1d391e2baff2b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a6c609-36", "ovs_interfaceid": "86a6c609-36e2-43e7-a675-670cdf35db58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:42:41 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-123ab545-92e5-4947-9314-bd57c4479055 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:73:c7,bridge_name='br-int',has_traffic_filtering=True,id=86a6c609-36e2-43e7-a675-670cdf35db58,network=Network(2b53e507-f50b-411d-bce8-8769fc50bc28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86a6c609-36') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:42:41 user nova-compute[73056]: DEBUG os_vif [None req-123ab545-92e5-4947-9314-bd57c4479055 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:73:c7,bridge_name='br-int',has_traffic_filtering=True,id=86a6c609-36e2-43e7-a675-670cdf35db58,network=Network(2b53e507-f50b-411d-bce8-8769fc50bc28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86a6c609-36') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:42:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86a6c609-36, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:42:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:41 user nova-compute[73056]: INFO os_vif [None req-123ab545-92e5-4947-9314-bd57c4479055 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:73:c7,bridge_name='br-int',has_traffic_filtering=True,id=86a6c609-36e2-43e7-a675-670cdf35db58,network=Network(2b53e507-f50b-411d-bce8-8769fc50bc28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86a6c609-36')
Aug 14 16:42:41 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-123ab545-92e5-4947-9314-bd57c4479055 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Deleting instance files /opt/stack/data/nova/instances/0fd5ba83-0612-4ce2-bd44-3ab55820022f_del
Aug 14 16:42:41 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-123ab545-92e5-4947-9314-bd57c4479055 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Deletion of /opt/stack/data/nova/instances/0fd5ba83-0612-4ce2-bd44-3ab55820022f_del complete
Aug 14 16:42:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-27ebab52-cbc3-438c-ac29-71074e7d64a1 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73056) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 16:42:41 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-27ebab52-cbc3-438c-ac29-71074e7d64a1 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 14 16:42:41 user nova-compute[73056]: DEBUG nova.privsep.utils [None req-27ebab52-cbc3-438c-ac29-71074e7d64a1 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73056) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 16:42:41 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-27ebab52-cbc3-438c-ac29-71074e7d64a1 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_zztcznb/4442bc33c57544ef939f054ee84a38d7.delta /opt/stack/data/nova/instances/snapshots/tmp_zztcznb/4442bc33c57544ef939f054ee84a38d7 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:41 user nova-compute[73056]: INFO nova.compute.manager [None req-123ab545-92e5-4947-9314-bd57c4479055 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Took 1.38 seconds to destroy the instance on the hypervisor.
Aug 14 16:42:41 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-123ab545-92e5-4947-9314-bd57c4479055 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 16:42:41 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 16:42:41 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 16:42:41 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-27ebab52-cbc3-438c-ac29-71074e7d64a1 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_zztcznb/4442bc33c57544ef939f054ee84a38d7.delta /opt/stack/data/nova/instances/snapshots/tmp_zztcznb/4442bc33c57544ef939f054ee84a38d7" returned: 0 in 0.417s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:41 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-27ebab52-cbc3-438c-ac29-71074e7d64a1 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Snapshot extracted, beginning image upload
Aug 14 16:42:42 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:42:42 user nova-compute[73056]: DEBUG nova.compute.manager [req-822c0122-7095-4945-837f-07a823eb5d0b req-1016de44-688d-44f7-8e44-9ff6e7aaf335 service nova] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Received event network-vif-plugged-86a6c609-36e2-43e7-a675-670cdf35db58 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:42:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-822c0122-7095-4945-837f-07a823eb5d0b req-1016de44-688d-44f7-8e44-9ff6e7aaf335 service nova] Acquiring lock "0fd5ba83-0612-4ce2-bd44-3ab55820022f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:42:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-822c0122-7095-4945-837f-07a823eb5d0b req-1016de44-688d-44f7-8e44-9ff6e7aaf335 service nova] Lock "0fd5ba83-0612-4ce2-bd44-3ab55820022f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:42:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-822c0122-7095-4945-837f-07a823eb5d0b req-1016de44-688d-44f7-8e44-9ff6e7aaf335 service nova] Lock "0fd5ba83-0612-4ce2-bd44-3ab55820022f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:42:42 user nova-compute[73056]: DEBUG nova.compute.manager [req-822c0122-7095-4945-837f-07a823eb5d0b req-1016de44-688d-44f7-8e44-9ff6e7aaf335 service nova] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] No waiting events found dispatching network-vif-plugged-86a6c609-36e2-43e7-a675-670cdf35db58 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:42:42 user nova-compute[73056]: WARNING nova.compute.manager [req-822c0122-7095-4945-837f-07a823eb5d0b req-1016de44-688d-44f7-8e44-9ff6e7aaf335 service nova] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Received unexpected event network-vif-plugged-86a6c609-36e2-43e7-a675-670cdf35db58 for instance with vm_state active and task_state deleting.
Aug 14 16:42:42 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Took 1.22 seconds to deallocate network for instance.
Aug 14 16:42:42 user nova-compute[73056]: DEBUG nova.compute.manager [req-edb056bf-3426-42e8-bcae-4f20053cf2e5 req-8f3583cd-d176-4bd8-aedf-b3883d1d2525 service nova] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Received event network-vif-deleted-86a6c609-36e2-43e7-a675-670cdf35db58 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:42:42 user nova-compute[73056]: INFO nova.compute.manager [req-edb056bf-3426-42e8-bcae-4f20053cf2e5 req-8f3583cd-d176-4bd8-aedf-b3883d1d2525 service nova] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Neutron deleted interface 86a6c609-36e2-43e7-a675-670cdf35db58; detaching it from the instance and deleting it from the info cache
Aug 14 16:42:42 user nova-compute[73056]: DEBUG nova.network.neutron [req-edb056bf-3426-42e8-bcae-4f20053cf2e5 req-8f3583cd-d176-4bd8-aedf-b3883d1d2525 service nova] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:42:42 user nova-compute[73056]: DEBUG nova.compute.manager [req-edb056bf-3426-42e8-bcae-4f20053cf2e5 req-8f3583cd-d176-4bd8-aedf-b3883d1d2525 service nova] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Detach interface failed, port_id=86a6c609-36e2-43e7-a675-670cdf35db58, reason: Instance 0fd5ba83-0612-4ce2-bd44-3ab55820022f could not be found. {{(pid=73056) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 16:42:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-123ab545-92e5-4947-9314-bd57c4479055 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:42:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-123ab545-92e5-4947-9314-bd57c4479055 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:42:43 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-123ab545-92e5-4947-9314-bd57c4479055 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:42:43 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-123ab545-92e5-4947-9314-bd57c4479055 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:42:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-123ab545-92e5-4947-9314-bd57c4479055 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.408s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:42:43 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-123ab545-92e5-4947-9314-bd57c4479055 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Deleted allocations for instance 0fd5ba83-0612-4ce2-bd44-3ab55820022f
Aug 14 16:42:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-123ab545-92e5-4947-9314-bd57c4479055 tempest-VolumesAdminNegativeTest-1902234353 tempest-VolumesAdminNegativeTest-1902234353-project-member] Lock "0fd5ba83-0612-4ce2-bd44-3ab55820022f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.332s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:42:44 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-27ebab52-cbc3-438c-ac29-71074e7d64a1 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Snapshot image upload complete
Aug 14 16:42:44 user nova-compute[73056]: INFO nova.compute.manager [None req-27ebab52-cbc3-438c-ac29-71074e7d64a1 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Took 6.01 seconds to snapshot the instance on the hypervisor.
Aug 14 16:42:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LEVmBXRF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:42:45 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:42:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:42:45 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:42:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:42:45 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:42:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53 -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0ee746-b804-477c-98c0-525d5308c5a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:42:45 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53 -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3397ccf-b896-4516-9948-fcf5fe01c2a9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53] added
Aug 14 16:42:45 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[16eb9381-e9b7-4738-921e-9a34c04adcda]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[986fa2bd-b61f-49d7-8eaf-413c3996d106]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LEVmBXRF {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LEVmBXRF" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7787d75f-4246-461d-b77b-f623e1fde4f3]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LEVmBXRF'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8094d06-a676-4a87-b619-8a38260064d1]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eccc97b-8bff-4e0a-a87e-9eea6dec0051]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 (non-flash)
Aug 14 16:42:45 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 (non-flash)
Aug 14 16:42:45 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53 -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bd4299-47ba-4c60-a7b2-f4bcc4892a2a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53, portal: 172.16.0.220,3260]
Aug 14 16:42:45 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53, portal: 172.16.0.220,3260] successful.
Aug 14 16:42:45 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aecede7-2bb9-414d-93fb-ba8f30de8bad]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3b1292-0ef4-4210-bde5-a1a2d0e9c9d2]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 (non-flash)
Aug 14 16:42:45 user nova-compute[73056]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53 (non-flash)
Aug 14 16:42:45 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 (non-flash)
Aug 14 16:42:45 user nova-compute[73056]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53 (non-flash)
Aug 14 16:42:45 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[16868363-3b2d-49d0-acd1-2cf42d052438]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:42:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LEVmBXRF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:42:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:46 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:42:46 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26533313730393939', 'path': '/dev/sdb'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:42:46 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533313730393939', 'path': '/dev/sdb'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:42:46 user nova-compute[73056]: DEBUG nova.compute.manager [req-318514e7-4616-4887-9010-fac8db079ae5 req-9c5c6309-8ad1-4506-891a-712abc069e66 service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Received event network-changed-8491a73c-f38b-4cb4-ab87-d6e41992319d {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:42:46 user nova-compute[73056]: DEBUG nova.compute.manager [req-318514e7-4616-4887-9010-fac8db079ae5 req-9c5c6309-8ad1-4506-891a-712abc069e66 service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Refreshing instance network info cache due to event network-changed-8491a73c-f38b-4cb4-ab87-d6e41992319d. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:42:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-318514e7-4616-4887-9010-fac8db079ae5 req-9c5c6309-8ad1-4506-891a-712abc069e66 service nova] Acquiring lock "refresh_cache-9c11423c-88d3-4fae-8917-c0d57021d194" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:42:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-318514e7-4616-4887-9010-fac8db079ae5 req-9c5c6309-8ad1-4506-891a-712abc069e66 service nova] Acquired lock "refresh_cache-9c11423c-88d3-4fae-8917-c0d57021d194" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:42:46 user nova-compute[73056]: DEBUG nova.network.neutron [req-318514e7-4616-4887-9010-fac8db079ae5 req-9c5c6309-8ad1-4506-891a-712abc069e66 service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Refreshing network info cache for port 8491a73c-f38b-4cb4-ab87-d6e41992319d {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:42:46 user nova-compute[73056]: DEBUG nova.objects.instance [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lazy-loading 'flavor' on Instance uuid 18008990-9ed6-46e5-805c-4475e58855a6 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:42:46 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 16:42:46 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:42:46 user nova-compute[73056]:   <source dev="/dev/sdb"/>
Aug 14 16:42:46 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:42:46 user nova-compute[73056]:   <serial>8cac313f-c53b-4d02-b5ab-f27592e46c53</serial>
Aug 14 16:42:46 user nova-compute[73056]: </disk>
Aug 14 16:42:46 user nova-compute[73056]:  {{(pid=73056) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 16:42:47 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:42:47 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] No BDM found with device name hda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:42:47 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] No VIF found with MAC fa:16:3e:f2:46:30, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:42:47 user nova-compute[73056]: DEBUG nova.network.neutron [req-318514e7-4616-4887-9010-fac8db079ae5 req-9c5c6309-8ad1-4506-891a-712abc069e66 service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Updated VIF entry in instance network info cache for port 8491a73c-f38b-4cb4-ab87-d6e41992319d. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:42:47 user nova-compute[73056]: DEBUG nova.network.neutron [req-318514e7-4616-4887-9010-fac8db079ae5 req-9c5c6309-8ad1-4506-891a-712abc069e66 service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Updating instance_info_cache with network_info: [{"id": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "address": "fa:16:3e:e6:4c:64", "network": {"id": "db548415-fd97-4612-8699-d431cfe3c1ec", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-66082327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af3a3df4b8641c1ac0d02df893b524d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8491a73c-f3", "ovs_interfaceid": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:42:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-318514e7-4616-4887-9010-fac8db079ae5 req-9c5c6309-8ad1-4506-891a-712abc069e66 service nova] Releasing lock "refresh_cache-9c11423c-88d3-4fae-8917-c0d57021d194" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:42:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-f55e1161-d389-4cb7-89f1-d30d14c7f429 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lock "18008990-9ed6-46e5-805c-4475e58855a6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.611s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:42:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d1d93a92-dfc8-463f-bc29-0fa8f0f8d0dc tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Acquiring lock "18008990-9ed6-46e5-805c-4475e58855a6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:42:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d1d93a92-dfc8-463f-bc29-0fa8f0f8d0dc tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lock "18008990-9ed6-46e5-805c-4475e58855a6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:42:48 user nova-compute[73056]: INFO nova.compute.manager [None req-d1d93a92-dfc8-463f-bc29-0fa8f0f8d0dc tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Detaching volume 8cac313f-c53b-4d02-b5ab-f27592e46c53
Aug 14 16:42:48 user nova-compute[73056]: INFO nova.virt.block_device [None req-d1d93a92-dfc8-463f-bc29-0fa8f0f8d0dc tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Attempting to driver detach volume 8cac313f-c53b-4d02-b5ab-f27592e46c53 from mountpoint /dev/vdb
Aug 14 16:42:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d1d93a92-dfc8-463f-bc29-0fa8f0f8d0dc tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Attempting to detach device vdb from instance 18008990-9ed6-46e5-805c-4475e58855a6 from the persistent domain config. {{(pid=73056) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 16:42:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-d1d93a92-dfc8-463f-bc29-0fa8f0f8d0dc tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 16:42:48 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:42:48 user nova-compute[73056]:   <source dev="/dev/sdb"/>
Aug 14 16:42:48 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:42:48 user nova-compute[73056]:   <serial>8cac313f-c53b-4d02-b5ab-f27592e46c53</serial>
Aug 14 16:42:48 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 16:42:48 user nova-compute[73056]: </disk>
Aug 14 16:42:48 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 16:42:48 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-d1d93a92-dfc8-463f-bc29-0fa8f0f8d0dc tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Successfully detached device vdb from instance 18008990-9ed6-46e5-805c-4475e58855a6 from the persistent domain config.
Aug 14 16:42:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d1d93a92-dfc8-463f-bc29-0fa8f0f8d0dc tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 18008990-9ed6-46e5-805c-4475e58855a6 from the live domain config. {{(pid=73056) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 16:42:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-d1d93a92-dfc8-463f-bc29-0fa8f0f8d0dc tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 16:42:48 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:42:48 user nova-compute[73056]:   <source dev="/dev/sdb"/>
Aug 14 16:42:48 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:42:48 user nova-compute[73056]:   <serial>8cac313f-c53b-4d02-b5ab-f27592e46c53</serial>
Aug 14 16:42:48 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 16:42:48 user nova-compute[73056]: </disk>
Aug 14 16:42:48 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Received event <DeviceRemovedEvent: 1692031369.2572494, 18008990-9ed6-46e5-805c-4475e58855a6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73056) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d1d93a92-dfc8-463f-bc29-0fa8f0f8d0dc tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 18008990-9ed6-46e5-805c-4475e58855a6 {{(pid=73056) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 16:42:49 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-d1d93a92-dfc8-463f-bc29-0fa8f0f8d0dc tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Successfully detached device vdb from instance 18008990-9ed6-46e5-805c-4475e58855a6 from the live domain config.
Aug 14 16:42:49 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1d93a92-dfc8-463f-bc29-0fa8f0f8d0dc tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d93a92-dfc8-463f-bc29-0fa8f0f8d0dc tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LEVmBXRF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:42:49 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-d1d93a92-dfc8-463f-bc29-0fa8f0f8d0dc tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:42:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-d1d93a92-dfc8-463f-bc29-0fa8f0f8d0dc tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-d1d93a92-dfc8-463f-bc29-0fa8f0f8d0dc tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d93a92-dfc8-463f-bc29-0fa8f0f8d0dc tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2bdd4b-3436-42c3-9b01-92737741e34d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c73eae-e0da-4758-b10c-0c998229e227]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d93a92-dfc8-463f-bc29-0fa8f0f8d0dc tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 (non-flash)
Aug 14 16:42:49 user nova-compute[73056]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53 (non-flash)
Aug 14 16:42:49 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d93a92-dfc8-463f-bc29-0fa8f0f8d0dc tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 (non-flash)
Aug 14 16:42:49 user nova-compute[73056]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53 (non-flash)
Aug 14 16:42:49 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d93a92-dfc8-463f-bc29-0fa8f0f8d0dc tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff2dcd7e830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53'): ({'sdb'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-d1d93a92-dfc8-463f-bc29-0fa8f0f8d0dc tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Removing single pathed devices sdb {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5703d17-926f-4979-8755-08b004ae4cbc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e3c66a-1f21-42c8-bce9-21abcb7dcbde]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-d1d93a92-dfc8-463f-bc29-0fa8f0f8d0dc tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Flushing IO for device /dev/sdb {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a5aac6-103b-4ad2-b03c-2c7f15a7903e]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-d1d93a92-dfc8-463f-bc29-0fa8f0f8d0dc tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc44eae-24c2-4d13-85b0-e40325fa160f]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-d1d93a92-dfc8-463f-bc29-0fa8f0f8d0dc tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-d1d93a92-dfc8-463f-bc29-0fa8f0f8d0dc tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] SCSI volumes sdb have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d93a92-dfc8-463f-bc29-0fa8f0f8d0dc tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f3a74c-57c2-4541-bd0a-adc5d207971b]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d93a92-dfc8-463f-bc29-0fa8f0f8d0dc tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53 -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ed4279-d52f-4289-a479-ecf2999dc0ac]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d93a92-dfc8-463f-bc29-0fa8f0f8d0dc tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53, portal: 172.16.0.220,3260]
Aug 14 16:42:49 user nova-compute[73056]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53, portal: 172.16.0.220,3260] successful.
Aug 14 16:42:49 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53 -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cac313f-c53b-4d02-b5ab-f27592e46c53 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[674370a9-d369-4c12-b87a-1204eb8c6022]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d93a92-dfc8-463f-bc29-0fa8f0f8d0dc tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-d1d93a92-dfc8-463f-bc29-0fa8f0f8d0dc tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d93a92-dfc8-463f-bc29-0fa8f0f8d0dc tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] <== disconnect_volume: return (291ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:42:49 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1d93a92-dfc8-463f-bc29-0fa8f0f8d0dc tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:42:50 user nova-compute[73056]: DEBUG nova.objects.instance [None req-d1d93a92-dfc8-463f-bc29-0fa8f0f8d0dc tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lazy-loading 'flavor' on Instance uuid 18008990-9ed6-46e5-805c-4475e58855a6 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:42:50 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:42:50 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:42:50 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 16:42:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d1d93a92-dfc8-463f-bc29-0fa8f0f8d0dc tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lock "18008990-9ed6-46e5-805c-4475e58855a6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.740s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:42:50 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692031355.830138, 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:42:50 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] VM Stopped (Lifecycle Event)
Aug 14 16:42:50 user nova-compute[73056]: DEBUG nova.compute.manager [None req-271ec91f-49c8-4a88-aa12-2632d54a27f6 None None] [instance: 9bb2cf77-cd65-49fd-a85b-d7961c2db3bf] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:42:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-4e4a6f87-80e8-43a3-adb6-f07d7cb9fe2a tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Acquiring lock "interface-18008990-9ed6-46e5-805c-4475e58855a6-664963e1-f4ab-4f68-a310-5f321a2b0a21" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:42:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-4e4a6f87-80e8-43a3-adb6-f07d7cb9fe2a tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lock "interface-18008990-9ed6-46e5-805c-4475e58855a6-664963e1-f4ab-4f68-a310-5f321a2b0a21" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:42:50 user nova-compute[73056]: DEBUG nova.objects.instance [None req-4e4a6f87-80e8-43a3-adb6-f07d7cb9fe2a tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lazy-loading 'flavor' on Instance uuid 18008990-9ed6-46e5-805c-4475e58855a6 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:42:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-4e4a6f87-80e8-43a3-adb6-f07d7cb9fe2a tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:40:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-208719382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-208719382',id=14,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHcJB5Em/BEdrrn+3nBSCQk8RXjQ9vXtMOi9k99zFp25ODkL4n/iUoo0VukLAcCxol9GBK/BdSObNT2aRPP96ToqXFULMlclvIpuOcZpv+502q1tzSo+JKq19K8Nkl5pQ==',key_name='tempest-keypair-370895944',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:40:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc25a4854a194e9283b568768daea226',ramdisk_id='',reservation_id='r-pde63aya',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1768493659',owner_user_name='tempest-TaggedAttachmentsTest-1768493659-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:40:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='333c53f1db334c3aad3b1c7dca862e74',uuid=18008990-9ed6-46e5-805c-4475e58855a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "664963e1-f4ab-4f68-a310-5f321a2b0a21", "address": "fa:16:3e:dc:4f:2b", "network": {"id": "bb5a8d29-6265-47e7-b3f9-bd002a8ffb53", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-354574264", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bc25a4854a194e9283b568768daea226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664963e1-f4", "ovs_interfaceid": "664963e1-f4ab-4f68-a310-5f321a2b0a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:42:50 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-4e4a6f87-80e8-43a3-adb6-f07d7cb9fe2a tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Converting VIF {"id": "664963e1-f4ab-4f68-a310-5f321a2b0a21", "address": "fa:16:3e:dc:4f:2b", "network": {"id": "bb5a8d29-6265-47e7-b3f9-bd002a8ffb53", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-354574264", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bc25a4854a194e9283b568768daea226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664963e1-f4", "ovs_interfaceid": "664963e1-f4ab-4f68-a310-5f321a2b0a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:42:50 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-4e4a6f87-80e8-43a3-adb6-f07d7cb9fe2a tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:4f:2b,bridge_name='br-int',has_traffic_filtering=True,id=664963e1-f4ab-4f68-a310-5f321a2b0a21,network=Network(bb5a8d29-6265-47e7-b3f9-bd002a8ffb53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap664963e1-f4') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:42:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-4e4a6f87-80e8-43a3-adb6-f07d7cb9fe2a tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:dc:4f:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tap664963e1-f4"/></interface> {{(pid=73056) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 14 16:42:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-4e4a6f87-80e8-43a3-adb6-f07d7cb9fe2a tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:dc:4f:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tap664963e1-f4"/></interface> {{(pid=73056) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 14 16:42:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-4e4a6f87-80e8-43a3-adb6-f07d7cb9fe2a tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Attempting to detach device tap664963e1-f4 from instance 18008990-9ed6-46e5-805c-4475e58855a6 from the persistent domain config. {{(pid=73056) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 16:42:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-4e4a6f87-80e8-43a3-adb6-f07d7cb9fe2a tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] detach device xml: <interface type="ethernet">
Aug 14 16:42:50 user nova-compute[73056]:   <mac address="fa:16:3e:dc:4f:2b"/>
Aug 14 16:42:50 user nova-compute[73056]:   <model type="virtio"/>
Aug 14 16:42:50 user nova-compute[73056]:   <mtu size="1442"/>
Aug 14 16:42:50 user nova-compute[73056]:   <target dev="tap664963e1-f4"/>
Aug 14 16:42:50 user nova-compute[73056]: </interface>
Aug 14 16:42:50 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 16:42:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-4e4a6f87-80e8-43a3-adb6-f07d7cb9fe2a tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:dc:4f:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tap664963e1-f4"/></interface> {{(pid=73056) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 14 16:42:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-4e4a6f87-80e8-43a3-adb6-f07d7cb9fe2a tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:dc:4f:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tap664963e1-f4"/></interface>not found in domain: <domain type='kvm' id='16'>
Aug 14 16:42:50 user nova-compute[73056]:   <name>instance-0000000e</name>
Aug 14 16:42:50 user nova-compute[73056]:   <uuid>18008990-9ed6-46e5-805c-4475e58855a6</uuid>
Aug 14 16:42:50 user nova-compute[73056]:   <metadata>
Aug 14 16:42:50 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:42:50 user nova-compute[73056]:   <nova:package version="0.0.0"/>
Aug 14 16:42:50 user nova-compute[73056]:   <nova:name>tempest-device-tagging-server-208719382</nova:name>
Aug 14 16:42:50 user nova-compute[73056]:   <nova:creationTime>2023-08-14 16:42:34</nova:creationTime>
Aug 14 16:42:50 user nova-compute[73056]:   <nova:flavor name="m1.tiny">
Aug 14 16:42:50 user nova-compute[73056]:     <nova:memory>512</nova:memory>
Aug 14 16:42:50 user nova-compute[73056]:     <nova:disk>1</nova:disk>
Aug 14 16:42:50 user nova-compute[73056]:     <nova:swap>0</nova:swap>
Aug 14 16:42:50 user nova-compute[73056]:     <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:42:50 user nova-compute[73056]:     <nova:vcpus>1</nova:vcpus>
Aug 14 16:42:50 user nova-compute[73056]:   </nova:flavor>
Aug 14 16:42:50 user nova-compute[73056]:   <nova:owner>
Aug 14 16:42:50 user nova-compute[73056]:     <nova:user uuid="333c53f1db334c3aad3b1c7dca862e74">tempest-TaggedAttachmentsTest-1768493659-project-member</nova:user>
Aug 14 16:42:50 user nova-compute[73056]:     <nova:project uuid="bc25a4854a194e9283b568768daea226">tempest-TaggedAttachmentsTest-1768493659</nova:project>
Aug 14 16:42:50 user nova-compute[73056]:   </nova:owner>
Aug 14 16:42:50 user nova-compute[73056]:   <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:42:50 user nova-compute[73056]:   <nova:ports>
Aug 14 16:42:50 user nova-compute[73056]:     <nova:port uuid="90cb9090-537a-414e-ac09-1893281186c2">
Aug 14 16:42:50 user nova-compute[73056]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 14 16:42:50 user nova-compute[73056]:     </nova:port>
Aug 14 16:42:50 user nova-compute[73056]:     <nova:port uuid="664963e1-f4ab-4f68-a310-5f321a2b0a21">
Aug 14 16:42:50 user nova-compute[73056]:       <nova:ip type="fixed" address="10.10.10.45" ipVersion="4"/>
Aug 14 16:42:50 user nova-compute[73056]:     </nova:port>
Aug 14 16:42:50 user nova-compute[73056]:   </nova:ports>
Aug 14 16:42:50 user nova-compute[73056]: </nova:instance>
Aug 14 16:42:50 user nova-compute[73056]:   </metadata>
Aug 14 16:42:50 user nova-compute[73056]:   <memory unit='KiB'>524288</memory>
Aug 14 16:42:50 user nova-compute[73056]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 14 16:42:50 user nova-compute[73056]:   <vcpu placement='static'>1</vcpu>
Aug 14 16:42:50 user nova-compute[73056]:   <resource>
Aug 14 16:42:50 user nova-compute[73056]:     <partition>/machine</partition>
Aug 14 16:42:50 user nova-compute[73056]:   </resource>
Aug 14 16:42:50 user nova-compute[73056]:   <sysinfo type='smbios'>
Aug 14 16:42:50 user nova-compute[73056]:     <system>
Aug 14 16:42:50 user nova-compute[73056]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 14 16:42:50 user nova-compute[73056]:       <entry name='product'>OpenStack Nova</entry>
Aug 14 16:42:50 user nova-compute[73056]:       <entry name='version'>0.0.0</entry>
Aug 14 16:42:50 user nova-compute[73056]:       <entry name='serial'>18008990-9ed6-46e5-805c-4475e58855a6</entry>
Aug 14 16:42:50 user nova-compute[73056]:       <entry name='uuid'>18008990-9ed6-46e5-805c-4475e58855a6</entry>
Aug 14 16:42:50 user nova-compute[73056]:       <entry name='family'>Virtual Machine</entry>
Aug 14 16:42:50 user nova-compute[73056]:     </system>
Aug 14 16:42:50 user nova-compute[73056]:   </sysinfo>
Aug 14 16:42:50 user nova-compute[73056]:   <os>
Aug 14 16:42:50 user nova-compute[73056]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 14 16:42:50 user nova-compute[73056]:     <boot dev='hd'/>
Aug 14 16:42:50 user nova-compute[73056]:     <smbios mode='sysinfo'/>
Aug 14 16:42:50 user nova-compute[73056]:   </os>
Aug 14 16:42:50 user nova-compute[73056]:   <features>
Aug 14 16:42:50 user nova-compute[73056]:     <acpi/>
Aug 14 16:42:50 user nova-compute[73056]:     <apic/>
Aug 14 16:42:50 user nova-compute[73056]:     <vmcoreinfo state='on'/>
Aug 14 16:42:50 user nova-compute[73056]:   </features>
Aug 14 16:42:50 user nova-compute[73056]:   <cpu mode='custom' match='exact' check='full'>
Aug 14 16:42:50 user nova-compute[73056]:     <model fallback='forbid'>Nehalem</model>
Aug 14 16:42:50 user nova-compute[73056]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 14 16:42:50 user nova-compute[73056]:     <feature policy='require' name='vme'/>
Aug 14 16:42:50 user nova-compute[73056]:     <feature policy='require' name='x2apic'/>
Aug 14 16:42:50 user nova-compute[73056]:     <feature policy='require' name='hypervisor'/>
Aug 14 16:42:50 user nova-compute[73056]:   </cpu>
Aug 14 16:42:50 user nova-compute[73056]:   <clock offset='utc'>
Aug 14 16:42:50 user nova-compute[73056]:     <timer name='pit' tickpolicy='delay'/>
Aug 14 16:42:50 user nova-compute[73056]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 14 16:42:50 user nova-compute[73056]:     <timer name='hpet' present='no'/>
Aug 14 16:42:50 user nova-compute[73056]:   </clock>
Aug 14 16:42:50 user nova-compute[73056]:   <on_poweroff>destroy</on_poweroff>
Aug 14 16:42:50 user nova-compute[73056]:   <on_reboot>restart</on_reboot>
Aug 14 16:42:50 user nova-compute[73056]:   <on_crash>destroy</on_crash>
Aug 14 16:42:50 user nova-compute[73056]:   <devices>
Aug 14 16:42:50 user nova-compute[73056]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 14 16:42:50 user nova-compute[73056]:     <disk type='file' device='disk'>
Aug 14 16:42:50 user nova-compute[73056]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 14 16:42:50 user nova-compute[73056]:       <source file='/opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/disk' index='2'/>
Aug 14 16:42:50 user nova-compute[73056]:       <backingStore type='file' index='3'>
Aug 14 16:42:50 user nova-compute[73056]:         <format type='raw'/>
Aug 14 16:42:50 user nova-compute[73056]:         <source file='/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234'/>
Aug 14 16:42:50 user nova-compute[73056]:         <backingStore/>
Aug 14 16:42:50 user nova-compute[73056]:       </backingStore>
Aug 14 16:42:50 user nova-compute[73056]:       <target dev='vda' bus='virtio'/>
Aug 14 16:42:50 user nova-compute[73056]:       <alias name='virtio-disk0'/>
Aug 14 16:42:50 user nova-compute[73056]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 14 16:42:50 user nova-compute[73056]:     </disk>
Aug 14 16:42:50 user nova-compute[73056]:     <disk type='file' device='cdrom'>
Aug 14 16:42:50 user nova-compute[73056]:       <driver name='qemu' type='raw' cache='none'/>
Aug 14 16:42:50 user nova-compute[73056]:       <source file='/opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/disk.config' index='1'/>
Aug 14 16:42:50 user nova-compute[73056]:       <backingStore/>
Aug 14 16:42:50 user nova-compute[73056]:       <target dev='hda' bus='ide'/>
Aug 14 16:42:50 user nova-compute[73056]:       <readonly/>
Aug 14 16:42:50 user nova-compute[73056]:       <alias name='ide0-0-0'/>
Aug 14 16:42:50 user nova-compute[73056]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 14 16:42:50 user nova-compute[73056]:     </disk>
Aug 14 16:42:50 user nova-compute[73056]:     <controller type='usb' index='0' model='none'>
Aug 14 16:42:50 user nova-compute[73056]:       <alias name='usb'/>
Aug 14 16:42:50 user nova-compute[73056]:     </controller>
Aug 14 16:42:50 user nova-compute[73056]:     <controller type='pci' index='0' model='pci-root'>
Aug 14 16:42:50 user nova-compute[73056]:       <alias name='pci.0'/>
Aug 14 16:42:50 user nova-compute[73056]:     </controller>
Aug 14 16:42:50 user nova-compute[73056]:     <controller type='ide' index='0'>
Aug 14 16:42:50 user nova-compute[73056]:       <alias name='ide'/>
Aug 14 16:42:50 user nova-compute[73056]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 14 16:42:50 user nova-compute[73056]:     </controller>
Aug 14 16:42:50 user nova-compute[73056]:     <interface type='ethernet'>
Aug 14 16:42:50 user nova-compute[73056]:       <mac address='fa:16:3e:f2:46:30'/>
Aug 14 16:42:50 user nova-compute[73056]:       <target dev='tap90cb9090-53'/>
Aug 14 16:42:50 user nova-compute[73056]:       <model type='virtio'/>
Aug 14 16:42:50 user nova-compute[73056]:       <mtu size='1442'/>
Aug 14 16:42:50 user nova-compute[73056]:       <alias name='net0'/>
Aug 14 16:42:50 user nova-compute[73056]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 14 16:42:50 user nova-compute[73056]:     </interface>
Aug 14 16:42:50 user nova-compute[73056]:     <interface type='ethernet'>
Aug 14 16:42:50 user nova-compute[73056]:       <mac address='fa:16:3e:dc:4f:2b'/>
Aug 14 16:42:50 user nova-compute[73056]:       <target dev='tap664963e1-f4'/>
Aug 14 16:42:50 user nova-compute[73056]:       <model type='virtio'/>
Aug 14 16:42:50 user nova-compute[73056]:       <mtu size='1442'/>
Aug 14 16:42:50 user nova-compute[73056]:       <alias name='net1'/>
Aug 14 16:42:50 user nova-compute[73056]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 14 16:42:50 user nova-compute[73056]:     </interface>
Aug 14 16:42:50 user nova-compute[73056]:     <serial type='pty'>
Aug 14 16:42:50 user nova-compute[73056]:       <source path='/dev/pts/0'/>
Aug 14 16:42:50 user nova-compute[73056]:       <log file='/opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/console.log' append='off'/>
Aug 14 16:42:50 user nova-compute[73056]:       <target type='isa-serial' port='0'>
Aug 14 16:42:50 user nova-compute[73056]:         <model name='isa-serial'/>
Aug 14 16:42:50 user nova-compute[73056]:       </target>
Aug 14 16:42:50 user nova-compute[73056]:       <alias name='serial0'/>
Aug 14 16:42:50 user nova-compute[73056]:     </serial>
Aug 14 16:42:50 user nova-compute[73056]:     <console type='pty' tty='/dev/pts/0'>
Aug 14 16:42:50 user nova-compute[73056]:       <source path='/dev/pts/0'/>
Aug 14 16:42:50 user nova-compute[73056]:       <log file='/opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/console.log' append='off'/>
Aug 14 16:42:50 user nova-compute[73056]:       <target type='serial' port='0'/>
Aug 14 16:42:50 user nova-compute[73056]:       <alias name='serial0'/>
Aug 14 16:42:50 user nova-compute[73056]:     </console>
Aug 14 16:42:50 user nova-compute[73056]:     <input type='mouse' bus='ps2'>
Aug 14 16:42:50 user nova-compute[73056]:       <alias name='input0'/>
Aug 14 16:42:50 user nova-compute[73056]:     </input>
Aug 14 16:42:50 user nova-compute[73056]:     <input type='keyboard' bus='ps2'>
Aug 14 16:42:50 user nova-compute[73056]:       <alias name='input1'/>
Aug 14 16:42:50 user nova-compute[73056]:     </input>
Aug 14 16:42:50 user nova-compute[73056]:     <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0'>
Aug 14 16:42:50 user nova-compute[73056]:       <listen type='address' address='0.0.0.0'/>
Aug 14 16:42:50 user nova-compute[73056]:     </graphics>
Aug 14 16:42:50 user nova-compute[73056]:     <audio id='1' type='none'/>
Aug 14 16:42:50 user nova-compute[73056]:     <video>
Aug 14 16:42:50 user nova-compute[73056]:       <model type='virtio' heads='1' primary='yes'/>
Aug 14 16:42:50 user nova-compute[73056]:       <alias name='video0'/>
Aug 14 16:42:50 user nova-compute[73056]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 14 16:42:50 user nova-compute[73056]:     </video>
Aug 14 16:42:50 user nova-compute[73056]:     <memballoon model='virtio'>
Aug 14 16:42:50 user nova-compute[73056]:       <stats period='10'/>
Aug 14 16:42:50 user nova-compute[73056]:       <alias name='balloon0'/>
Aug 14 16:42:50 user nova-compute[73056]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 14 16:42:50 user nova-compute[73056]:     </memballoon>
Aug 14 16:42:50 user nova-compute[73056]:     <rng model='virtio'>
Aug 14 16:42:50 user nova-compute[73056]:       <backend model='random'>/dev/urandom</backend>
Aug 14 16:42:50 user nova-compute[73056]:       <alias name='rng0'/>
Aug 14 16:42:50 user nova-compute[73056]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 14 16:42:50 user nova-compute[73056]:     </rng>
Aug 14 16:42:50 user nova-compute[73056]:   </devices>
Aug 14 16:42:50 user nova-compute[73056]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 14 16:42:50 user nova-compute[73056]:     <label>libvirt-18008990-9ed6-46e5-805c-4475e58855a6</label>
Aug 14 16:42:50 user nova-compute[73056]:     <imagelabel>libvirt-18008990-9ed6-46e5-805c-4475e58855a6</imagelabel>
Aug 14 16:42:50 user nova-compute[73056]:   </seclabel>
Aug 14 16:42:50 user nova-compute[73056]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 14 16:42:50 user nova-compute[73056]:     <label>+64055:+108</label>
Aug 14 16:42:50 user nova-compute[73056]:     <imagelabel>+64055:+108</imagelabel>
Aug 14 16:42:50 user nova-compute[73056]:   </seclabel>
Aug 14 16:42:50 user nova-compute[73056]: </domain>
Aug 14 16:42:50 user nova-compute[73056]:  {{(pid=73056) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 14 16:42:51 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-4e4a6f87-80e8-43a3-adb6-f07d7cb9fe2a tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Successfully detached device tap664963e1-f4 from instance 18008990-9ed6-46e5-805c-4475e58855a6 from the persistent domain config.
Aug 14 16:42:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-4e4a6f87-80e8-43a3-adb6-f07d7cb9fe2a tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] (1/8): Attempting to detach device tap664963e1-f4 with device alias net1 from instance 18008990-9ed6-46e5-805c-4475e58855a6 from the live domain config. {{(pid=73056) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-4e4a6f87-80e8-43a3-adb6-f07d7cb9fe2a tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] detach device xml: <interface type="ethernet">
Aug 14 16:42:51 user nova-compute[73056]:   <mac address="fa:16:3e:dc:4f:2b"/>
Aug 14 16:42:51 user nova-compute[73056]:   <model type="virtio"/>
Aug 14 16:42:51 user nova-compute[73056]:   <mtu size="1442"/>
Aug 14 16:42:51 user nova-compute[73056]:   <target dev="tap664963e1-f4"/>
Aug 14 16:42:51 user nova-compute[73056]: </interface>
Aug 14 16:42:51 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Received event <DeviceRemovedEvent: 1692031371.2826903, 18008990-9ed6-46e5-805c-4475e58855a6 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73056) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-4e4a6f87-80e8-43a3-adb6-f07d7cb9fe2a tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Start waiting for the detach event from libvirt for device tap664963e1-f4 with device alias net1 for instance 18008990-9ed6-46e5-805c-4475e58855a6 {{(pid=73056) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-4e4a6f87-80e8-43a3-adb6-f07d7cb9fe2a tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:dc:4f:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tap664963e1-f4"/></interface> {{(pid=73056) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-4e4a6f87-80e8-43a3-adb6-f07d7cb9fe2a tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:dc:4f:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tap664963e1-f4"/></interface>not found in domain: <domain type='kvm' id='16'>
Aug 14 16:42:51 user nova-compute[73056]:   <name>instance-0000000e</name>
Aug 14 16:42:51 user nova-compute[73056]:   <uuid>18008990-9ed6-46e5-805c-4475e58855a6</uuid>
Aug 14 16:42:51 user nova-compute[73056]:   <metadata>
Aug 14 16:42:51 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:42:51 user nova-compute[73056]:   <nova:package version="0.0.0"/>
Aug 14 16:42:51 user nova-compute[73056]:   <nova:name>tempest-device-tagging-server-208719382</nova:name>
Aug 14 16:42:51 user nova-compute[73056]:   <nova:creationTime>2023-08-14 16:42:34</nova:creationTime>
Aug 14 16:42:51 user nova-compute[73056]:   <nova:flavor name="m1.tiny">
Aug 14 16:42:51 user nova-compute[73056]:     <nova:memory>512</nova:memory>
Aug 14 16:42:51 user nova-compute[73056]:     <nova:disk>1</nova:disk>
Aug 14 16:42:51 user nova-compute[73056]:     <nova:swap>0</nova:swap>
Aug 14 16:42:51 user nova-compute[73056]:     <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:42:51 user nova-compute[73056]:     <nova:vcpus>1</nova:vcpus>
Aug 14 16:42:51 user nova-compute[73056]:   </nova:flavor>
Aug 14 16:42:51 user nova-compute[73056]:   <nova:owner>
Aug 14 16:42:51 user nova-compute[73056]:     <nova:user uuid="333c53f1db334c3aad3b1c7dca862e74">tempest-TaggedAttachmentsTest-1768493659-project-member</nova:user>
Aug 14 16:42:51 user nova-compute[73056]:     <nova:project uuid="bc25a4854a194e9283b568768daea226">tempest-TaggedAttachmentsTest-1768493659</nova:project>
Aug 14 16:42:51 user nova-compute[73056]:   </nova:owner>
Aug 14 16:42:51 user nova-compute[73056]:   <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:42:51 user nova-compute[73056]:   <nova:ports>
Aug 14 16:42:51 user nova-compute[73056]:     <nova:port uuid="90cb9090-537a-414e-ac09-1893281186c2">
Aug 14 16:42:51 user nova-compute[73056]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 14 16:42:51 user nova-compute[73056]:     </nova:port>
Aug 14 16:42:51 user nova-compute[73056]:     <nova:port uuid="664963e1-f4ab-4f68-a310-5f321a2b0a21">
Aug 14 16:42:51 user nova-compute[73056]:       <nova:ip type="fixed" address="10.10.10.45" ipVersion="4"/>
Aug 14 16:42:51 user nova-compute[73056]:     </nova:port>
Aug 14 16:42:51 user nova-compute[73056]:   </nova:ports>
Aug 14 16:42:51 user nova-compute[73056]: </nova:instance>
Aug 14 16:42:51 user nova-compute[73056]:   </metadata>
Aug 14 16:42:51 user nova-compute[73056]:   <memory unit='KiB'>524288</memory>
Aug 14 16:42:51 user nova-compute[73056]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 14 16:42:51 user nova-compute[73056]:   <vcpu placement='static'>1</vcpu>
Aug 14 16:42:51 user nova-compute[73056]:   <resource>
Aug 14 16:42:51 user nova-compute[73056]:     <partition>/machine</partition>
Aug 14 16:42:51 user nova-compute[73056]:   </resource>
Aug 14 16:42:51 user nova-compute[73056]:   <sysinfo type='smbios'>
Aug 14 16:42:51 user nova-compute[73056]:     <system>
Aug 14 16:42:51 user nova-compute[73056]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 14 16:42:51 user nova-compute[73056]:       <entry name='product'>OpenStack Nova</entry>
Aug 14 16:42:51 user nova-compute[73056]:       <entry name='version'>0.0.0</entry>
Aug 14 16:42:51 user nova-compute[73056]:       <entry name='serial'>18008990-9ed6-46e5-805c-4475e58855a6</entry>
Aug 14 16:42:51 user nova-compute[73056]:       <entry name='uuid'>18008990-9ed6-46e5-805c-4475e58855a6</entry>
Aug 14 16:42:51 user nova-compute[73056]:       <entry name='family'>Virtual Machine</entry>
Aug 14 16:42:51 user nova-compute[73056]:     </system>
Aug 14 16:42:51 user nova-compute[73056]:   </sysinfo>
Aug 14 16:42:51 user nova-compute[73056]:   <os>
Aug 14 16:42:51 user nova-compute[73056]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 14 16:42:51 user nova-compute[73056]:     <boot dev='hd'/>
Aug 14 16:42:51 user nova-compute[73056]:     <smbios mode='sysinfo'/>
Aug 14 16:42:51 user nova-compute[73056]:   </os>
Aug 14 16:42:51 user nova-compute[73056]:   <features>
Aug 14 16:42:51 user nova-compute[73056]:     <acpi/>
Aug 14 16:42:51 user nova-compute[73056]:     <apic/>
Aug 14 16:42:51 user nova-compute[73056]:     <vmcoreinfo state='on'/>
Aug 14 16:42:51 user nova-compute[73056]:   </features>
Aug 14 16:42:51 user nova-compute[73056]:   <cpu mode='custom' match='exact' check='full'>
Aug 14 16:42:51 user nova-compute[73056]:     <model fallback='forbid'>Nehalem</model>
Aug 14 16:42:51 user nova-compute[73056]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 14 16:42:51 user nova-compute[73056]:     <feature policy='require' name='vme'/>
Aug 14 16:42:51 user nova-compute[73056]:     <feature policy='require' name='x2apic'/>
Aug 14 16:42:51 user nova-compute[73056]:     <feature policy='require' name='hypervisor'/>
Aug 14 16:42:51 user nova-compute[73056]:   </cpu>
Aug 14 16:42:51 user nova-compute[73056]:   <clock offset='utc'>
Aug 14 16:42:51 user nova-compute[73056]:     <timer name='pit' tickpolicy='delay'/>
Aug 14 16:42:51 user nova-compute[73056]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 14 16:42:51 user nova-compute[73056]:     <timer name='hpet' present='no'/>
Aug 14 16:42:51 user nova-compute[73056]:   </clock>
Aug 14 16:42:51 user nova-compute[73056]:   <on_poweroff>destroy</on_poweroff>
Aug 14 16:42:51 user nova-compute[73056]:   <on_reboot>restart</on_reboot>
Aug 14 16:42:51 user nova-compute[73056]:   <on_crash>destroy</on_crash>
Aug 14 16:42:51 user nova-compute[73056]:   <devices>
Aug 14 16:42:51 user nova-compute[73056]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 14 16:42:51 user nova-compute[73056]:     <disk type='file' device='disk'>
Aug 14 16:42:51 user nova-compute[73056]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 14 16:42:51 user nova-compute[73056]:       <source file='/opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/disk' index='2'/>
Aug 14 16:42:51 user nova-compute[73056]:       <backingStore type='file' index='3'>
Aug 14 16:42:51 user nova-compute[73056]:         <format type='raw'/>
Aug 14 16:42:51 user nova-compute[73056]:         <source file='/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234'/>
Aug 14 16:42:51 user nova-compute[73056]:         <backingStore/>
Aug 14 16:42:51 user nova-compute[73056]:       </backingStore>
Aug 14 16:42:51 user nova-compute[73056]:       <target dev='vda' bus='virtio'/>
Aug 14 16:42:51 user nova-compute[73056]:       <alias name='virtio-disk0'/>
Aug 14 16:42:51 user nova-compute[73056]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 14 16:42:51 user nova-compute[73056]:     </disk>
Aug 14 16:42:51 user nova-compute[73056]:     <disk type='file' device='cdrom'>
Aug 14 16:42:51 user nova-compute[73056]:       <driver name='qemu' type='raw' cache='none'/>
Aug 14 16:42:51 user nova-compute[73056]:       <source file='/opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/disk.config' index='1'/>
Aug 14 16:42:51 user nova-compute[73056]:       <backingStore/>
Aug 14 16:42:51 user nova-compute[73056]:       <target dev='hda' bus='ide'/>
Aug 14 16:42:51 user nova-compute[73056]:       <readonly/>
Aug 14 16:42:51 user nova-compute[73056]:       <alias name='ide0-0-0'/>
Aug 14 16:42:51 user nova-compute[73056]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 14 16:42:51 user nova-compute[73056]:     </disk>
Aug 14 16:42:51 user nova-compute[73056]:     <controller type='usb' index='0' model='none'>
Aug 14 16:42:51 user nova-compute[73056]:       <alias name='usb'/>
Aug 14 16:42:51 user nova-compute[73056]:     </controller>
Aug 14 16:42:51 user nova-compute[73056]:     <controller type='pci' index='0' model='pci-root'>
Aug 14 16:42:51 user nova-compute[73056]:       <alias name='pci.0'/>
Aug 14 16:42:51 user nova-compute[73056]:     </controller>
Aug 14 16:42:51 user nova-compute[73056]:     <controller type='ide' index='0'>
Aug 14 16:42:51 user nova-compute[73056]:       <alias name='ide'/>
Aug 14 16:42:51 user nova-compute[73056]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 14 16:42:51 user nova-compute[73056]:     </controller>
Aug 14 16:42:51 user nova-compute[73056]:     <interface type='ethernet'>
Aug 14 16:42:51 user nova-compute[73056]:       <mac address='fa:16:3e:f2:46:30'/>
Aug 14 16:42:51 user nova-compute[73056]:       <target dev='tap90cb9090-53'/>
Aug 14 16:42:51 user nova-compute[73056]:       <model type='virtio'/>
Aug 14 16:42:51 user nova-compute[73056]:       <mtu size='1442'/>
Aug 14 16:42:51 user nova-compute[73056]:       <alias name='net0'/>
Aug 14 16:42:51 user nova-compute[73056]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 14 16:42:51 user nova-compute[73056]:     </interface>
Aug 14 16:42:51 user nova-compute[73056]:     <serial type='pty'>
Aug 14 16:42:51 user nova-compute[73056]:       <source path='/dev/pts/0'/>
Aug 14 16:42:51 user nova-compute[73056]:       <log file='/opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/console.log' append='off'/>
Aug 14 16:42:51 user nova-compute[73056]:       <target type='isa-serial' port='0'>
Aug 14 16:42:51 user nova-compute[73056]:         <model name='isa-serial'/>
Aug 14 16:42:51 user nova-compute[73056]:       </target>
Aug 14 16:42:51 user nova-compute[73056]:       <alias name='serial0'/>
Aug 14 16:42:51 user nova-compute[73056]:     </serial>
Aug 14 16:42:51 user nova-compute[73056]:     <console type='pty' tty='/dev/pts/0'>
Aug 14 16:42:51 user nova-compute[73056]:       <source path='/dev/pts/0'/>
Aug 14 16:42:51 user nova-compute[73056]:       <log file='/opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/console.log' append='off'/>
Aug 14 16:42:51 user nova-compute[73056]:       <target type='serial' port='0'/>
Aug 14 16:42:51 user nova-compute[73056]:       <alias name='serial0'/>
Aug 14 16:42:51 user nova-compute[73056]:     </console>
Aug 14 16:42:51 user nova-compute[73056]:     <input type='mouse' bus='ps2'>
Aug 14 16:42:51 user nova-compute[73056]:       <alias name='input0'/>
Aug 14 16:42:51 user nova-compute[73056]:     </input>
Aug 14 16:42:51 user nova-compute[73056]:     <input type='keyboard' bus='ps2'>
Aug 14 16:42:51 user nova-compute[73056]:       <alias name='input1'/>
Aug 14 16:42:51 user nova-compute[73056]:     </input>
Aug 14 16:42:51 user nova-compute[73056]:     <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0'>
Aug 14 16:42:51 user nova-compute[73056]:       <listen type='address' address='0.0.0.0'/>
Aug 14 16:42:51 user nova-compute[73056]:     </graphics>
Aug 14 16:42:51 user nova-compute[73056]:     <audio id='1' type='none'/>
Aug 14 16:42:51 user nova-compute[73056]:     <video>
Aug 14 16:42:51 user nova-compute[73056]:       <model type='virtio' heads='1' primary='yes'/>
Aug 14 16:42:51 user nova-compute[73056]:       <alias name='video0'/>
Aug 14 16:42:51 user nova-compute[73056]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 14 16:42:51 user nova-compute[73056]:     </video>
Aug 14 16:42:51 user nova-compute[73056]:     <memballoon model='virtio'>
Aug 14 16:42:51 user nova-compute[73056]:       <stats period='10'/>
Aug 14 16:42:51 user nova-compute[73056]:       <alias name='balloon0'/>
Aug 14 16:42:51 user nova-compute[73056]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 14 16:42:51 user nova-compute[73056]:     </memballoon>
Aug 14 16:42:51 user nova-compute[73056]:     <rng model='virtio'>
Aug 14 16:42:51 user nova-compute[73056]:       <backend model='random'>/dev/urandom</backend>
Aug 14 16:42:51 user nova-compute[73056]:       <alias name='rng0'/>
Aug 14 16:42:51 user nova-compute[73056]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 14 16:42:51 user nova-compute[73056]:     </rng>
Aug 14 16:42:51 user nova-compute[73056]:   </devices>
Aug 14 16:42:51 user nova-compute[73056]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 14 16:42:51 user nova-compute[73056]:     <label>libvirt-18008990-9ed6-46e5-805c-4475e58855a6</label>
Aug 14 16:42:51 user nova-compute[73056]:     <imagelabel>libvirt-18008990-9ed6-46e5-805c-4475e58855a6</imagelabel>
Aug 14 16:42:51 user nova-compute[73056]:   </seclabel>
Aug 14 16:42:51 user nova-compute[73056]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 14 16:42:51 user nova-compute[73056]:     <label>+64055:+108</label>
Aug 14 16:42:51 user nova-compute[73056]:     <imagelabel>+64055:+108</imagelabel>
Aug 14 16:42:51 user nova-compute[73056]:   </seclabel>
Aug 14 16:42:51 user nova-compute[73056]: </domain>
Aug 14 16:42:51 user nova-compute[73056]:  {{(pid=73056) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 14 16:42:51 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-4e4a6f87-80e8-43a3-adb6-f07d7cb9fe2a tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Successfully detached device tap664963e1-f4 from instance 18008990-9ed6-46e5-805c-4475e58855a6 from the live domain config.
Aug 14 16:42:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-4e4a6f87-80e8-43a3-adb6-f07d7cb9fe2a tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:40:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-208719382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-208719382',id=14,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHcJB5Em/BEdrrn+3nBSCQk8RXjQ9vXtMOi9k99zFp25ODkL4n/iUoo0VukLAcCxol9GBK/BdSObNT2aRPP96ToqXFULMlclvIpuOcZpv+502q1tzSo+JKq19K8Nkl5pQ==',key_name='tempest-keypair-370895944',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:40:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc25a4854a194e9283b568768daea226',ramdisk_id='',reservation_id='r-pde63aya',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1768493659',owner_user_name='tempest-TaggedAttachmentsTest-1768493659-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:40:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='333c53f1db334c3aad3b1c7dca862e74',uuid=18008990-9ed6-46e5-805c-4475e58855a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "664963e1-f4ab-4f68-a310-5f321a2b0a21", "address": "fa:16:3e:dc:4f:2b", "network": {"id": "bb5a8d29-6265-47e7-b3f9-bd002a8ffb53", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-354574264", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bc25a4854a194e9283b568768daea226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664963e1-f4", "ovs_interfaceid": "664963e1-f4ab-4f68-a310-5f321a2b0a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-4e4a6f87-80e8-43a3-adb6-f07d7cb9fe2a tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Converting VIF {"id": "664963e1-f4ab-4f68-a310-5f321a2b0a21", "address": "fa:16:3e:dc:4f:2b", "network": {"id": "bb5a8d29-6265-47e7-b3f9-bd002a8ffb53", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-354574264", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bc25a4854a194e9283b568768daea226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664963e1-f4", "ovs_interfaceid": "664963e1-f4ab-4f68-a310-5f321a2b0a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-4e4a6f87-80e8-43a3-adb6-f07d7cb9fe2a tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:4f:2b,bridge_name='br-int',has_traffic_filtering=True,id=664963e1-f4ab-4f68-a310-5f321a2b0a21,network=Network(bb5a8d29-6265-47e7-b3f9-bd002a8ffb53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap664963e1-f4') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG os_vif [None req-4e4a6f87-80e8-43a3-adb6-f07d7cb9fe2a tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:4f:2b,bridge_name='br-int',has_traffic_filtering=True,id=664963e1-f4ab-4f68-a310-5f321a2b0a21,network=Network(bb5a8d29-6265-47e7-b3f9-bd002a8ffb53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap664963e1-f4') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap664963e1-f4, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:51 user nova-compute[73056]: INFO os_vif [None req-4e4a6f87-80e8-43a3-adb6-f07d7cb9fe2a tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:4f:2b,bridge_name='br-int',has_traffic_filtering=True,id=664963e1-f4ab-4f68-a310-5f321a2b0a21,network=Network(bb5a8d29-6265-47e7-b3f9-bd002a8ffb53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap664963e1-f4')
Aug 14 16:42:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-4e4a6f87-80e8-43a3-adb6-f07d7cb9fe2a tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:42:51 user nova-compute[73056]:   <nova:package version="0.0.0"/>
Aug 14 16:42:51 user nova-compute[73056]:   <nova:name>tempest-device-tagging-server-208719382</nova:name>
Aug 14 16:42:51 user nova-compute[73056]:   <nova:creationTime>2023-08-14 16:42:51</nova:creationTime>
Aug 14 16:42:51 user nova-compute[73056]:   <nova:flavor name="m1.tiny">
Aug 14 16:42:51 user nova-compute[73056]:     <nova:memory>512</nova:memory>
Aug 14 16:42:51 user nova-compute[73056]:     <nova:disk>1</nova:disk>
Aug 14 16:42:51 user nova-compute[73056]:     <nova:swap>0</nova:swap>
Aug 14 16:42:51 user nova-compute[73056]:     <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:42:51 user nova-compute[73056]:     <nova:vcpus>1</nova:vcpus>
Aug 14 16:42:51 user nova-compute[73056]:   </nova:flavor>
Aug 14 16:42:51 user nova-compute[73056]:   <nova:owner>
Aug 14 16:42:51 user nova-compute[73056]:     <nova:user uuid="333c53f1db334c3aad3b1c7dca862e74">tempest-TaggedAttachmentsTest-1768493659-project-member</nova:user>
Aug 14 16:42:51 user nova-compute[73056]:     <nova:project uuid="bc25a4854a194e9283b568768daea226">tempest-TaggedAttachmentsTest-1768493659</nova:project>
Aug 14 16:42:51 user nova-compute[73056]:   </nova:owner>
Aug 14 16:42:51 user nova-compute[73056]:   <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:42:51 user nova-compute[73056]:   <nova:ports>
Aug 14 16:42:51 user nova-compute[73056]:     <nova:port uuid="90cb9090-537a-414e-ac09-1893281186c2">
Aug 14 16:42:51 user nova-compute[73056]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 14 16:42:51 user nova-compute[73056]:     </nova:port>
Aug 14 16:42:51 user nova-compute[73056]:   </nova:ports>
Aug 14 16:42:51 user nova-compute[73056]: </nova:instance>
Aug 14 16:42:51 user nova-compute[73056]:  {{(pid=73056) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-55d18d6a-3bbf-43fe-ad77-e0944c8687b7 req-f6660d40-26c2-476b-bc09-ece103c0b255 service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Received event network-vif-unplugged-664963e1-f4ab-4f68-a310-5f321a2b0a21 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-55d18d6a-3bbf-43fe-ad77-e0944c8687b7 req-f6660d40-26c2-476b-bc09-ece103c0b255 service nova] Acquiring lock "18008990-9ed6-46e5-805c-4475e58855a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-55d18d6a-3bbf-43fe-ad77-e0944c8687b7 req-f6660d40-26c2-476b-bc09-ece103c0b255 service nova] Lock "18008990-9ed6-46e5-805c-4475e58855a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-55d18d6a-3bbf-43fe-ad77-e0944c8687b7 req-f6660d40-26c2-476b-bc09-ece103c0b255 service nova] Lock "18008990-9ed6-46e5-805c-4475e58855a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-55d18d6a-3bbf-43fe-ad77-e0944c8687b7 req-f6660d40-26c2-476b-bc09-ece103c0b255 service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] No waiting events found dispatching network-vif-unplugged-664963e1-f4ab-4f68-a310-5f321a2b0a21 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:42:51 user nova-compute[73056]: WARNING nova.compute.manager [req-55d18d6a-3bbf-43fe-ad77-e0944c8687b7 req-f6660d40-26c2-476b-bc09-ece103c0b255 service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Received unexpected event network-vif-unplugged-664963e1-f4ab-4f68-a310-5f321a2b0a21 for instance with vm_state active and task_state None.
Aug 14 16:42:51 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Triggering sync for uuid 9f3a7f8a-e3b9-4918-9663-968677fe5c90 {{(pid=73056) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Triggering sync for uuid 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8 {{(pid=73056) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Triggering sync for uuid 18008990-9ed6-46e5-805c-4475e58855a6 {{(pid=73056) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Triggering sync for uuid 4731f355-9307-4176-910b-cf35beb85e75 {{(pid=73056) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Triggering sync for uuid 9c11423c-88d3-4fae-8917-c0d57021d194 {{(pid=73056) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Triggering sync for uuid b3270811-8241-47a6-aa36-0ec3feddf0fc {{(pid=73056) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Triggering sync for uuid 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a {{(pid=73056) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "9f3a7f8a-e3b9-4918-9663-968677fe5c90" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "9f3a7f8a-e3b9-4918-9663-968677fe5c90" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "18008990-9ed6-46e5-805c-4475e58855a6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "18008990-9ed6-46e5-805c-4475e58855a6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "4731f355-9307-4176-910b-cf35beb85e75" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "4731f355-9307-4176-910b-cf35beb85e75" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "9c11423c-88d3-4fae-8917-c0d57021d194" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "9c11423c-88d3-4fae-8917-c0d57021d194" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "b3270811-8241-47a6-aa36-0ec3feddf0fc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "b3270811-8241-47a6-aa36-0ec3feddf0fc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "1beaec7b-ecd0-4586-b4b2-b04588ce9e2a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "1beaec7b-ecd0-4586-b4b2-b04588ce9e2a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "9f3a7f8a-e3b9-4918-9663-968677fe5c90" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "18008990-9ed6-46e5-805c-4475e58855a6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "b3270811-8241-47a6-aa36-0ec3feddf0fc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.098s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "4731f355-9307-4176-910b-cf35beb85e75" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "9c11423c-88d3-4fae-8917-c0d57021d194" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:42:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "1beaec7b-ecd0-4586-b4b2-b04588ce9e2a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.107s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:42:52 user nova-compute[73056]: DEBUG nova.compute.manager [req-39b729e0-6d9b-4aa7-99ac-85079c404a74 req-7728d697-008c-48ee-88df-4751a01ec721 service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Received event network-vif-deleted-664963e1-f4ab-4f68-a310-5f321a2b0a21 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:42:52 user nova-compute[73056]: INFO nova.compute.manager [req-39b729e0-6d9b-4aa7-99ac-85079c404a74 req-7728d697-008c-48ee-88df-4751a01ec721 service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Neutron deleted interface 664963e1-f4ab-4f68-a310-5f321a2b0a21; detaching it from the instance and deleting it from the info cache
Aug 14 16:42:52 user nova-compute[73056]: DEBUG nova.network.neutron [req-39b729e0-6d9b-4aa7-99ac-85079c404a74 req-7728d697-008c-48ee-88df-4751a01ec721 service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Updating instance_info_cache with network_info: [{"id": "90cb9090-537a-414e-ac09-1893281186c2", "address": "fa:16:3e:f2:46:30", "network": {"id": "d4aa57ea-03bd-491a-9861-e52c142e083c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1629351750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc25a4854a194e9283b568768daea226", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90cb9090-53", "ovs_interfaceid": "90cb9090-537a-414e-ac09-1893281186c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:42:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-4e4a6f87-80e8-43a3-adb6-f07d7cb9fe2a tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Acquiring lock "refresh_cache-18008990-9ed6-46e5-805c-4475e58855a6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:42:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-4e4a6f87-80e8-43a3-adb6-f07d7cb9fe2a tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Acquired lock "refresh_cache-18008990-9ed6-46e5-805c-4475e58855a6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:42:52 user nova-compute[73056]: DEBUG nova.network.neutron [None req-4e4a6f87-80e8-43a3-adb6-f07d7cb9fe2a tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:42:52 user nova-compute[73056]: DEBUG nova.objects.instance [req-39b729e0-6d9b-4aa7-99ac-85079c404a74 req-7728d697-008c-48ee-88df-4751a01ec721 service nova] Lazy-loading 'system_metadata' on Instance uuid 18008990-9ed6-46e5-805c-4475e58855a6 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:42:52 user nova-compute[73056]: DEBUG nova.objects.instance [req-39b729e0-6d9b-4aa7-99ac-85079c404a74 req-7728d697-008c-48ee-88df-4751a01ec721 service nova] Lazy-loading 'flavor' on Instance uuid 18008990-9ed6-46e5-805c-4475e58855a6 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:42:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [req-39b729e0-6d9b-4aa7-99ac-85079c404a74 req-7728d697-008c-48ee-88df-4751a01ec721 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:40:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-208719382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-208719382',id=14,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHcJB5Em/BEdrrn+3nBSCQk8RXjQ9vXtMOi9k99zFp25ODkL4n/iUoo0VukLAcCxol9GBK/BdSObNT2aRPP96ToqXFULMlclvIpuOcZpv+502q1tzSo+JKq19K8Nkl5pQ==',key_name='tempest-keypair-370895944',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:40:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc25a4854a194e9283b568768daea226',ramdisk_id='',reservation_id='r-pde63aya',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1768493659',owner_user_name='tempest-TaggedAttachmentsTest-1768493659-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:40:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='333c53f1db334c3aad3b1c7dca862e74',uuid=18008990-9ed6-46e5-805c-4475e58855a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "664963e1-f4ab-4f68-a310-5f321a2b0a21", "address": "fa:16:3e:dc:4f:2b", "network": {"id": "bb5a8d29-6265-47e7-b3f9-bd002a8ffb53", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-354574264", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bc25a4854a194e9283b568768daea226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664963e1-f4", "ovs_interfaceid": "664963e1-f4ab-4f68-a310-5f321a2b0a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:42:52 user nova-compute[73056]: DEBUG nova.network.os_vif_util [req-39b729e0-6d9b-4aa7-99ac-85079c404a74 req-7728d697-008c-48ee-88df-4751a01ec721 service nova] Converting VIF {"id": "664963e1-f4ab-4f68-a310-5f321a2b0a21", "address": "fa:16:3e:dc:4f:2b", "network": {"id": "bb5a8d29-6265-47e7-b3f9-bd002a8ffb53", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-354574264", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bc25a4854a194e9283b568768daea226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664963e1-f4", "ovs_interfaceid": "664963e1-f4ab-4f68-a310-5f321a2b0a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:42:52 user nova-compute[73056]: DEBUG nova.network.os_vif_util [req-39b729e0-6d9b-4aa7-99ac-85079c404a74 req-7728d697-008c-48ee-88df-4751a01ec721 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:4f:2b,bridge_name='br-int',has_traffic_filtering=True,id=664963e1-f4ab-4f68-a310-5f321a2b0a21,network=Network(bb5a8d29-6265-47e7-b3f9-bd002a8ffb53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap664963e1-f4') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:42:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [req-39b729e0-6d9b-4aa7-99ac-85079c404a74 req-7728d697-008c-48ee-88df-4751a01ec721 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:dc:4f:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tap664963e1-f4"/></interface> {{(pid=73056) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 14 16:42:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [req-39b729e0-6d9b-4aa7-99ac-85079c404a74 req-7728d697-008c-48ee-88df-4751a01ec721 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:dc:4f:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tap664963e1-f4"/></interface>not found in domain: <domain type='kvm' id='16'>
Aug 14 16:42:52 user nova-compute[73056]:   <name>instance-0000000e</name>
Aug 14 16:42:52 user nova-compute[73056]:   <uuid>18008990-9ed6-46e5-805c-4475e58855a6</uuid>
Aug 14 16:42:52 user nova-compute[73056]:   <metadata>
Aug 14 16:42:52 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:42:52 user nova-compute[73056]:   <nova:package version="0.0.0"/>
Aug 14 16:42:52 user nova-compute[73056]:   <nova:name>tempest-device-tagging-server-208719382</nova:name>
Aug 14 16:42:52 user nova-compute[73056]:   <nova:creationTime>2023-08-14 16:42:51</nova:creationTime>
Aug 14 16:42:52 user nova-compute[73056]:   <nova:flavor name="m1.tiny">
Aug 14 16:42:52 user nova-compute[73056]:     <nova:memory>512</nova:memory>
Aug 14 16:42:52 user nova-compute[73056]:     <nova:disk>1</nova:disk>
Aug 14 16:42:52 user nova-compute[73056]:     <nova:swap>0</nova:swap>
Aug 14 16:42:52 user nova-compute[73056]:     <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:42:52 user nova-compute[73056]:     <nova:vcpus>1</nova:vcpus>
Aug 14 16:42:52 user nova-compute[73056]:   </nova:flavor>
Aug 14 16:42:52 user nova-compute[73056]:   <nova:owner>
Aug 14 16:42:52 user nova-compute[73056]:     <nova:user uuid="333c53f1db334c3aad3b1c7dca862e74">tempest-TaggedAttachmentsTest-1768493659-project-member</nova:user>
Aug 14 16:42:52 user nova-compute[73056]:     <nova:project uuid="bc25a4854a194e9283b568768daea226">tempest-TaggedAttachmentsTest-1768493659</nova:project>
Aug 14 16:42:52 user nova-compute[73056]:   </nova:owner>
Aug 14 16:42:52 user nova-compute[73056]:   <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:42:52 user nova-compute[73056]:   <nova:ports>
Aug 14 16:42:52 user nova-compute[73056]:     <nova:port uuid="90cb9090-537a-414e-ac09-1893281186c2">
Aug 14 16:42:52 user nova-compute[73056]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 14 16:42:52 user nova-compute[73056]:     </nova:port>
Aug 14 16:42:52 user nova-compute[73056]:   </nova:ports>
Aug 14 16:42:52 user nova-compute[73056]: </nova:instance>
Aug 14 16:42:52 user nova-compute[73056]:   </metadata>
Aug 14 16:42:52 user nova-compute[73056]:   <memory unit='KiB'>524288</memory>
Aug 14 16:42:52 user nova-compute[73056]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 14 16:42:52 user nova-compute[73056]:   <vcpu placement='static'>1</vcpu>
Aug 14 16:42:52 user nova-compute[73056]:   <resource>
Aug 14 16:42:52 user nova-compute[73056]:     <partition>/machine</partition>
Aug 14 16:42:52 user nova-compute[73056]:   </resource>
Aug 14 16:42:52 user nova-compute[73056]:   <sysinfo type='smbios'>
Aug 14 16:42:52 user nova-compute[73056]:     <system>
Aug 14 16:42:52 user nova-compute[73056]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 14 16:42:52 user nova-compute[73056]:       <entry name='product'>OpenStack Nova</entry>
Aug 14 16:42:52 user nova-compute[73056]:       <entry name='version'>0.0.0</entry>
Aug 14 16:42:52 user nova-compute[73056]:       <entry name='serial'>18008990-9ed6-46e5-805c-4475e58855a6</entry>
Aug 14 16:42:52 user nova-compute[73056]:       <entry name='uuid'>18008990-9ed6-46e5-805c-4475e58855a6</entry>
Aug 14 16:42:52 user nova-compute[73056]:       <entry name='family'>Virtual Machine</entry>
Aug 14 16:42:52 user nova-compute[73056]:     </system>
Aug 14 16:42:52 user nova-compute[73056]:   </sysinfo>
Aug 14 16:42:52 user nova-compute[73056]:   <os>
Aug 14 16:42:52 user nova-compute[73056]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 14 16:42:52 user nova-compute[73056]:     <boot dev='hd'/>
Aug 14 16:42:52 user nova-compute[73056]:     <smbios mode='sysinfo'/>
Aug 14 16:42:52 user nova-compute[73056]:   </os>
Aug 14 16:42:52 user nova-compute[73056]:   <features>
Aug 14 16:42:52 user nova-compute[73056]:     <acpi/>
Aug 14 16:42:52 user nova-compute[73056]:     <apic/>
Aug 14 16:42:52 user nova-compute[73056]:     <vmcoreinfo state='on'/>
Aug 14 16:42:52 user nova-compute[73056]:   </features>
Aug 14 16:42:52 user nova-compute[73056]:   <cpu mode='custom' match='exact' check='full'>
Aug 14 16:42:52 user nova-compute[73056]:     <model fallback='forbid'>Nehalem</model>
Aug 14 16:42:52 user nova-compute[73056]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 14 16:42:52 user nova-compute[73056]:     <feature policy='require' name='vme'/>
Aug 14 16:42:52 user nova-compute[73056]:     <feature policy='require' name='x2apic'/>
Aug 14 16:42:52 user nova-compute[73056]:     <feature policy='require' name='hypervisor'/>
Aug 14 16:42:52 user nova-compute[73056]:   </cpu>
Aug 14 16:42:52 user nova-compute[73056]:   <clock offset='utc'>
Aug 14 16:42:52 user nova-compute[73056]:     <timer name='pit' tickpolicy='delay'/>
Aug 14 16:42:52 user nova-compute[73056]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 14 16:42:52 user nova-compute[73056]:     <timer name='hpet' present='no'/>
Aug 14 16:42:52 user nova-compute[73056]:   </clock>
Aug 14 16:42:52 user nova-compute[73056]:   <on_poweroff>destroy</on_poweroff>
Aug 14 16:42:52 user nova-compute[73056]:   <on_reboot>restart</on_reboot>
Aug 14 16:42:52 user nova-compute[73056]:   <on_crash>destroy</on_crash>
Aug 14 16:42:52 user nova-compute[73056]:   <devices>
Aug 14 16:42:52 user nova-compute[73056]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 14 16:42:52 user nova-compute[73056]:     <disk type='file' device='disk'>
Aug 14 16:42:52 user nova-compute[73056]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 14 16:42:52 user nova-compute[73056]:       <source file='/opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/disk' index='2'/>
Aug 14 16:42:52 user nova-compute[73056]:       <backingStore type='file' index='3'>
Aug 14 16:42:52 user nova-compute[73056]:         <format type='raw'/>
Aug 14 16:42:52 user nova-compute[73056]:         <source file='/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234'/>
Aug 14 16:42:52 user nova-compute[73056]:         <backingStore/>
Aug 14 16:42:52 user nova-compute[73056]:       </backingStore>
Aug 14 16:42:52 user nova-compute[73056]:       <target dev='vda' bus='virtio'/>
Aug 14 16:42:52 user nova-compute[73056]:       <alias name='virtio-disk0'/>
Aug 14 16:42:52 user nova-compute[73056]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 14 16:42:52 user nova-compute[73056]:     </disk>
Aug 14 16:42:52 user nova-compute[73056]:     <disk type='file' device='cdrom'>
Aug 14 16:42:52 user nova-compute[73056]:       <driver name='qemu' type='raw' cache='none'/>
Aug 14 16:42:52 user nova-compute[73056]:       <source file='/opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/disk.config' index='1'/>
Aug 14 16:42:52 user nova-compute[73056]:       <backingStore/>
Aug 14 16:42:52 user nova-compute[73056]:       <target dev='hda' bus='ide'/>
Aug 14 16:42:52 user nova-compute[73056]:       <readonly/>
Aug 14 16:42:52 user nova-compute[73056]:       <alias name='ide0-0-0'/>
Aug 14 16:42:52 user nova-compute[73056]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 14 16:42:52 user nova-compute[73056]:     </disk>
Aug 14 16:42:52 user nova-compute[73056]:     <controller type='usb' index='0' model='none'>
Aug 14 16:42:52 user nova-compute[73056]:       <alias name='usb'/>
Aug 14 16:42:52 user nova-compute[73056]:     </controller>
Aug 14 16:42:52 user nova-compute[73056]:     <controller type='pci' index='0' model='pci-root'>
Aug 14 16:42:52 user nova-compute[73056]:       <alias name='pci.0'/>
Aug 14 16:42:52 user nova-compute[73056]:     </controller>
Aug 14 16:42:52 user nova-compute[73056]:     <controller type='ide' index='0'>
Aug 14 16:42:52 user nova-compute[73056]:       <alias name='ide'/>
Aug 14 16:42:52 user nova-compute[73056]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 14 16:42:52 user nova-compute[73056]:     </controller>
Aug 14 16:42:52 user nova-compute[73056]:     <interface type='ethernet'>
Aug 14 16:42:52 user nova-compute[73056]:       <mac address='fa:16:3e:f2:46:30'/>
Aug 14 16:42:52 user nova-compute[73056]:       <target dev='tap90cb9090-53'/>
Aug 14 16:42:52 user nova-compute[73056]:       <model type='virtio'/>
Aug 14 16:42:52 user nova-compute[73056]:       <mtu size='1442'/>
Aug 14 16:42:52 user nova-compute[73056]:       <alias name='net0'/>
Aug 14 16:42:52 user nova-compute[73056]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 14 16:42:52 user nova-compute[73056]:     </interface>
Aug 14 16:42:52 user nova-compute[73056]:     <serial type='pty'>
Aug 14 16:42:52 user nova-compute[73056]:       <source path='/dev/pts/0'/>
Aug 14 16:42:52 user nova-compute[73056]:       <log file='/opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/console.log' append='off'/>
Aug 14 16:42:52 user nova-compute[73056]:       <target type='isa-serial' port='0'>
Aug 14 16:42:52 user nova-compute[73056]:         <model name='isa-serial'/>
Aug 14 16:42:52 user nova-compute[73056]:       </target>
Aug 14 16:42:52 user nova-compute[73056]:       <alias name='serial0'/>
Aug 14 16:42:52 user nova-compute[73056]:     </serial>
Aug 14 16:42:52 user nova-compute[73056]:     <console type='pty' tty='/dev/pts/0'>
Aug 14 16:42:52 user nova-compute[73056]:       <source path='/dev/pts/0'/>
Aug 14 16:42:52 user nova-compute[73056]:       <log file='/opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/console.log' append='off'/>
Aug 14 16:42:52 user nova-compute[73056]:       <target type='serial' port='0'/>
Aug 14 16:42:52 user nova-compute[73056]:       <alias name='serial0'/>
Aug 14 16:42:52 user nova-compute[73056]:     </console>
Aug 14 16:42:52 user nova-compute[73056]:     <input type='mouse' bus='ps2'>
Aug 14 16:42:52 user nova-compute[73056]:       <alias name='input0'/>
Aug 14 16:42:52 user nova-compute[73056]:     </input>
Aug 14 16:42:52 user nova-compute[73056]:     <input type='keyboard' bus='ps2'>
Aug 14 16:42:52 user nova-compute[73056]:       <alias name='input1'/>
Aug 14 16:42:52 user nova-compute[73056]:     </input>
Aug 14 16:42:52 user nova-compute[73056]:     <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0'>
Aug 14 16:42:52 user nova-compute[73056]:       <listen type='address' address='0.0.0.0'/>
Aug 14 16:42:52 user nova-compute[73056]:     </graphics>
Aug 14 16:42:52 user nova-compute[73056]:     <audio id='1' type='none'/>
Aug 14 16:42:52 user nova-compute[73056]:     <video>
Aug 14 16:42:52 user nova-compute[73056]:       <model type='virtio' heads='1' primary='yes'/>
Aug 14 16:42:52 user nova-compute[73056]:       <alias name='video0'/>
Aug 14 16:42:52 user nova-compute[73056]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 14 16:42:52 user nova-compute[73056]:     </video>
Aug 14 16:42:52 user nova-compute[73056]:     <memballoon model='virtio'>
Aug 14 16:42:52 user nova-compute[73056]:       <stats period='10'/>
Aug 14 16:42:52 user nova-compute[73056]:       <alias name='balloon0'/>
Aug 14 16:42:52 user nova-compute[73056]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 14 16:42:52 user nova-compute[73056]:     </memballoon>
Aug 14 16:42:52 user nova-compute[73056]:     <rng model='virtio'>
Aug 14 16:42:52 user nova-compute[73056]:       <backend model='random'>/dev/urandom</backend>
Aug 14 16:42:52 user nova-compute[73056]:       <alias name='rng0'/>
Aug 14 16:42:52 user nova-compute[73056]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 14 16:42:52 user nova-compute[73056]:     </rng>
Aug 14 16:42:52 user nova-compute[73056]:   </devices>
Aug 14 16:42:52 user nova-compute[73056]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 14 16:42:52 user nova-compute[73056]:     <label>libvirt-18008990-9ed6-46e5-805c-4475e58855a6</label>
Aug 14 16:42:52 user nova-compute[73056]:     <imagelabel>libvirt-18008990-9ed6-46e5-805c-4475e58855a6</imagelabel>
Aug 14 16:42:52 user nova-compute[73056]:   </seclabel>
Aug 14 16:42:52 user nova-compute[73056]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 14 16:42:52 user nova-compute[73056]:     <label>+64055:+108</label>
Aug 14 16:42:52 user nova-compute[73056]:     <imagelabel>+64055:+108</imagelabel>
Aug 14 16:42:52 user nova-compute[73056]:   </seclabel>
Aug 14 16:42:52 user nova-compute[73056]: </domain>
Aug 14 16:42:52 user nova-compute[73056]:  {{(pid=73056) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 14 16:42:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [req-39b729e0-6d9b-4aa7-99ac-85079c404a74 req-7728d697-008c-48ee-88df-4751a01ec721 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:dc:4f:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tap664963e1-f4"/></interface> {{(pid=73056) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 14 16:42:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [req-39b729e0-6d9b-4aa7-99ac-85079c404a74 req-7728d697-008c-48ee-88df-4751a01ec721 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:dc:4f:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tap664963e1-f4"/></interface>not found in domain: <domain type='kvm' id='16'>
Aug 14 16:42:52 user nova-compute[73056]:   <name>instance-0000000e</name>
Aug 14 16:42:52 user nova-compute[73056]:   <uuid>18008990-9ed6-46e5-805c-4475e58855a6</uuid>
Aug 14 16:42:52 user nova-compute[73056]:   <metadata>
Aug 14 16:42:52 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:42:52 user nova-compute[73056]:   <nova:package version="0.0.0"/>
Aug 14 16:42:52 user nova-compute[73056]:   <nova:name>tempest-device-tagging-server-208719382</nova:name>
Aug 14 16:42:52 user nova-compute[73056]:   <nova:creationTime>2023-08-14 16:42:51</nova:creationTime>
Aug 14 16:42:52 user nova-compute[73056]:   <nova:flavor name="m1.tiny">
Aug 14 16:42:52 user nova-compute[73056]:     <nova:memory>512</nova:memory>
Aug 14 16:42:52 user nova-compute[73056]:     <nova:disk>1</nova:disk>
Aug 14 16:42:52 user nova-compute[73056]:     <nova:swap>0</nova:swap>
Aug 14 16:42:52 user nova-compute[73056]:     <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:42:52 user nova-compute[73056]:     <nova:vcpus>1</nova:vcpus>
Aug 14 16:42:52 user nova-compute[73056]:   </nova:flavor>
Aug 14 16:42:52 user nova-compute[73056]:   <nova:owner>
Aug 14 16:42:52 user nova-compute[73056]:     <nova:user uuid="333c53f1db334c3aad3b1c7dca862e74">tempest-TaggedAttachmentsTest-1768493659-project-member</nova:user>
Aug 14 16:42:52 user nova-compute[73056]:     <nova:project uuid="bc25a4854a194e9283b568768daea226">tempest-TaggedAttachmentsTest-1768493659</nova:project>
Aug 14 16:42:52 user nova-compute[73056]:   </nova:owner>
Aug 14 16:42:52 user nova-compute[73056]:   <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:42:52 user nova-compute[73056]:   <nova:ports>
Aug 14 16:42:52 user nova-compute[73056]:     <nova:port uuid="90cb9090-537a-414e-ac09-1893281186c2">
Aug 14 16:42:52 user nova-compute[73056]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 14 16:42:52 user nova-compute[73056]:     </nova:port>
Aug 14 16:42:52 user nova-compute[73056]:   </nova:ports>
Aug 14 16:42:52 user nova-compute[73056]: </nova:instance>
Aug 14 16:42:52 user nova-compute[73056]:   </metadata>
Aug 14 16:42:52 user nova-compute[73056]:   <memory unit='KiB'>524288</memory>
Aug 14 16:42:52 user nova-compute[73056]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 14 16:42:52 user nova-compute[73056]:   <vcpu placement='static'>1</vcpu>
Aug 14 16:42:52 user nova-compute[73056]:   <resource>
Aug 14 16:42:52 user nova-compute[73056]:     <partition>/machine</partition>
Aug 14 16:42:52 user nova-compute[73056]:   </resource>
Aug 14 16:42:52 user nova-compute[73056]:   <sysinfo type='smbios'>
Aug 14 16:42:52 user nova-compute[73056]:     <system>
Aug 14 16:42:52 user nova-compute[73056]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 14 16:42:52 user nova-compute[73056]:       <entry name='product'>OpenStack Nova</entry>
Aug 14 16:42:52 user nova-compute[73056]:       <entry name='version'>0.0.0</entry>
Aug 14 16:42:52 user nova-compute[73056]:       <entry name='serial'>18008990-9ed6-46e5-805c-4475e58855a6</entry>
Aug 14 16:42:52 user nova-compute[73056]:       <entry name='uuid'>18008990-9ed6-46e5-805c-4475e58855a6</entry>
Aug 14 16:42:52 user nova-compute[73056]:       <entry name='family'>Virtual Machine</entry>
Aug 14 16:42:52 user nova-compute[73056]:     </system>
Aug 14 16:42:52 user nova-compute[73056]:   </sysinfo>
Aug 14 16:42:52 user nova-compute[73056]:   <os>
Aug 14 16:42:52 user nova-compute[73056]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 14 16:42:52 user nova-compute[73056]:     <boot dev='hd'/>
Aug 14 16:42:52 user nova-compute[73056]:     <smbios mode='sysinfo'/>
Aug 14 16:42:52 user nova-compute[73056]:   </os>
Aug 14 16:42:52 user nova-compute[73056]:   <features>
Aug 14 16:42:52 user nova-compute[73056]:     <acpi/>
Aug 14 16:42:52 user nova-compute[73056]:     <apic/>
Aug 14 16:42:52 user nova-compute[73056]:     <vmcoreinfo state='on'/>
Aug 14 16:42:52 user nova-compute[73056]:   </features>
Aug 14 16:42:52 user nova-compute[73056]:   <cpu mode='custom' match='exact' check='full'>
Aug 14 16:42:52 user nova-compute[73056]:     <model fallback='forbid'>Nehalem</model>
Aug 14 16:42:52 user nova-compute[73056]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 14 16:42:52 user nova-compute[73056]:     <feature policy='require' name='vme'/>
Aug 14 16:42:52 user nova-compute[73056]:     <feature policy='require' name='x2apic'/>
Aug 14 16:42:52 user nova-compute[73056]:     <feature policy='require' name='hypervisor'/>
Aug 14 16:42:52 user nova-compute[73056]:   </cpu>
Aug 14 16:42:52 user nova-compute[73056]:   <clock offset='utc'>
Aug 14 16:42:52 user nova-compute[73056]:     <timer name='pit' tickpolicy='delay'/>
Aug 14 16:42:52 user nova-compute[73056]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 14 16:42:52 user nova-compute[73056]:     <timer name='hpet' present='no'/>
Aug 14 16:42:52 user nova-compute[73056]:   </clock>
Aug 14 16:42:52 user nova-compute[73056]:   <on_poweroff>destroy</on_poweroff>
Aug 14 16:42:52 user nova-compute[73056]:   <on_reboot>restart</on_reboot>
Aug 14 16:42:52 user nova-compute[73056]:   <on_crash>destroy</on_crash>
Aug 14 16:42:52 user nova-compute[73056]:   <devices>
Aug 14 16:42:52 user nova-compute[73056]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 14 16:42:52 user nova-compute[73056]:     <disk type='file' device='disk'>
Aug 14 16:42:52 user nova-compute[73056]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 14 16:42:52 user nova-compute[73056]:       <source file='/opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/disk' index='2'/>
Aug 14 16:42:52 user nova-compute[73056]:       <backingStore type='file' index='3'>
Aug 14 16:42:52 user nova-compute[73056]:         <format type='raw'/>
Aug 14 16:42:52 user nova-compute[73056]:         <source file='/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234'/>
Aug 14 16:42:52 user nova-compute[73056]:         <backingStore/>
Aug 14 16:42:52 user nova-compute[73056]:       </backingStore>
Aug 14 16:42:52 user nova-compute[73056]:       <target dev='vda' bus='virtio'/>
Aug 14 16:42:52 user nova-compute[73056]:       <alias name='virtio-disk0'/>
Aug 14 16:42:52 user nova-compute[73056]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 14 16:42:52 user nova-compute[73056]:     </disk>
Aug 14 16:42:52 user nova-compute[73056]:     <disk type='file' device='cdrom'>
Aug 14 16:42:52 user nova-compute[73056]:       <driver name='qemu' type='raw' cache='none'/>
Aug 14 16:42:52 user nova-compute[73056]:       <source file='/opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/disk.config' index='1'/>
Aug 14 16:42:52 user nova-compute[73056]:       <backingStore/>
Aug 14 16:42:52 user nova-compute[73056]:       <target dev='hda' bus='ide'/>
Aug 14 16:42:52 user nova-compute[73056]:       <readonly/>
Aug 14 16:42:52 user nova-compute[73056]:       <alias name='ide0-0-0'/>
Aug 14 16:42:52 user nova-compute[73056]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 14 16:42:52 user nova-compute[73056]:     </disk>
Aug 14 16:42:52 user nova-compute[73056]:     <controller type='usb' index='0' model='none'>
Aug 14 16:42:52 user nova-compute[73056]:       <alias name='usb'/>
Aug 14 16:42:52 user nova-compute[73056]:     </controller>
Aug 14 16:42:52 user nova-compute[73056]:     <controller type='pci' index='0' model='pci-root'>
Aug 14 16:42:52 user nova-compute[73056]:       <alias name='pci.0'/>
Aug 14 16:42:52 user nova-compute[73056]:     </controller>
Aug 14 16:42:52 user nova-compute[73056]:     <controller type='ide' index='0'>
Aug 14 16:42:52 user nova-compute[73056]:       <alias name='ide'/>
Aug 14 16:42:52 user nova-compute[73056]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 14 16:42:52 user nova-compute[73056]:     </controller>
Aug 14 16:42:52 user nova-compute[73056]:     <interface type='ethernet'>
Aug 14 16:42:52 user nova-compute[73056]:       <mac address='fa:16:3e:f2:46:30'/>
Aug 14 16:42:52 user nova-compute[73056]:       <target dev='tap90cb9090-53'/>
Aug 14 16:42:52 user nova-compute[73056]:       <model type='virtio'/>
Aug 14 16:42:52 user nova-compute[73056]:       <mtu size='1442'/>
Aug 14 16:42:52 user nova-compute[73056]:       <alias name='net0'/>
Aug 14 16:42:52 user nova-compute[73056]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 14 16:42:52 user nova-compute[73056]:     </interface>
Aug 14 16:42:52 user nova-compute[73056]:     <serial type='pty'>
Aug 14 16:42:52 user nova-compute[73056]:       <source path='/dev/pts/0'/>
Aug 14 16:42:52 user nova-compute[73056]:       <log file='/opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/console.log' append='off'/>
Aug 14 16:42:52 user nova-compute[73056]:       <target type='isa-serial' port='0'>
Aug 14 16:42:52 user nova-compute[73056]:         <model name='isa-serial'/>
Aug 14 16:42:52 user nova-compute[73056]:       </target>
Aug 14 16:42:52 user nova-compute[73056]:       <alias name='serial0'/>
Aug 14 16:42:52 user nova-compute[73056]:     </serial>
Aug 14 16:42:52 user nova-compute[73056]:     <console type='pty' tty='/dev/pts/0'>
Aug 14 16:42:52 user nova-compute[73056]:       <source path='/dev/pts/0'/>
Aug 14 16:42:52 user nova-compute[73056]:       <log file='/opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/console.log' append='off'/>
Aug 14 16:42:52 user nova-compute[73056]:       <target type='serial' port='0'/>
Aug 14 16:42:52 user nova-compute[73056]:       <alias name='serial0'/>
Aug 14 16:42:52 user nova-compute[73056]:     </console>
Aug 14 16:42:52 user nova-compute[73056]:     <input type='mouse' bus='ps2'>
Aug 14 16:42:52 user nova-compute[73056]:       <alias name='input0'/>
Aug 14 16:42:52 user nova-compute[73056]:     </input>
Aug 14 16:42:52 user nova-compute[73056]:     <input type='keyboard' bus='ps2'>
Aug 14 16:42:52 user nova-compute[73056]:       <alias name='input1'/>
Aug 14 16:42:52 user nova-compute[73056]:     </input>
Aug 14 16:42:52 user nova-compute[73056]:     <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0'>
Aug 14 16:42:52 user nova-compute[73056]:       <listen type='address' address='0.0.0.0'/>
Aug 14 16:42:52 user nova-compute[73056]:     </graphics>
Aug 14 16:42:52 user nova-compute[73056]:     <audio id='1' type='none'/>
Aug 14 16:42:52 user nova-compute[73056]:     <video>
Aug 14 16:42:52 user nova-compute[73056]:       <model type='virtio' heads='1' primary='yes'/>
Aug 14 16:42:52 user nova-compute[73056]:       <alias name='video0'/>
Aug 14 16:42:52 user nova-compute[73056]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 14 16:42:52 user nova-compute[73056]:     </video>
Aug 14 16:42:52 user nova-compute[73056]:     <memballoon model='virtio'>
Aug 14 16:42:52 user nova-compute[73056]:       <stats period='10'/>
Aug 14 16:42:52 user nova-compute[73056]:       <alias name='balloon0'/>
Aug 14 16:42:52 user nova-compute[73056]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 14 16:42:52 user nova-compute[73056]:     </memballoon>
Aug 14 16:42:52 user nova-compute[73056]:     <rng model='virtio'>
Aug 14 16:42:52 user nova-compute[73056]:       <backend model='random'>/dev/urandom</backend>
Aug 14 16:42:52 user nova-compute[73056]:       <alias name='rng0'/>
Aug 14 16:42:52 user nova-compute[73056]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 14 16:42:52 user nova-compute[73056]:     </rng>
Aug 14 16:42:52 user nova-compute[73056]:   </devices>
Aug 14 16:42:52 user nova-compute[73056]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 14 16:42:52 user nova-compute[73056]:     <label>libvirt-18008990-9ed6-46e5-805c-4475e58855a6</label>
Aug 14 16:42:52 user nova-compute[73056]:     <imagelabel>libvirt-18008990-9ed6-46e5-805c-4475e58855a6</imagelabel>
Aug 14 16:42:52 user nova-compute[73056]:   </seclabel>
Aug 14 16:42:52 user nova-compute[73056]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 14 16:42:52 user nova-compute[73056]:     <label>+64055:+108</label>
Aug 14 16:42:52 user nova-compute[73056]:     <imagelabel>+64055:+108</imagelabel>
Aug 14 16:42:52 user nova-compute[73056]:   </seclabel>
Aug 14 16:42:52 user nova-compute[73056]: </domain>
Aug 14 16:42:52 user nova-compute[73056]:  {{(pid=73056) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 14 16:42:52 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [req-39b729e0-6d9b-4aa7-99ac-85079c404a74 req-7728d697-008c-48ee-88df-4751a01ec721 service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Detaching interface fa:16:3e:dc:4f:2b failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap664963e1-f4' not found.
Aug 14 16:42:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [req-39b729e0-6d9b-4aa7-99ac-85079c404a74 req-7728d697-008c-48ee-88df-4751a01ec721 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:40:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-208719382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-208719382',id=14,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHcJB5Em/BEdrrn+3nBSCQk8RXjQ9vXtMOi9k99zFp25ODkL4n/iUoo0VukLAcCxol9GBK/BdSObNT2aRPP96ToqXFULMlclvIpuOcZpv+502q1tzSo+JKq19K8Nkl5pQ==',key_name='tempest-keypair-370895944',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:40:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc25a4854a194e9283b568768daea226',ramdisk_id='',reservation_id='r-pde63aya',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1768493659',owner_user_name='tempest-TaggedAttachmentsTest-1768493659-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:40:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='333c53f1db334c3aad3b1c7dca862e74',uuid=18008990-9ed6-46e5-805c-4475e58855a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "664963e1-f4ab-4f68-a310-5f321a2b0a21", "address": "fa:16:3e:dc:4f:2b", "network": {"id": "bb5a8d29-6265-47e7-b3f9-bd002a8ffb53", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-354574264", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bc25a4854a194e9283b568768daea226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664963e1-f4", "ovs_interfaceid": "664963e1-f4ab-4f68-a310-5f321a2b0a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:42:52 user nova-compute[73056]: DEBUG nova.network.os_vif_util [req-39b729e0-6d9b-4aa7-99ac-85079c404a74 req-7728d697-008c-48ee-88df-4751a01ec721 service nova] Converting VIF {"id": "664963e1-f4ab-4f68-a310-5f321a2b0a21", "address": "fa:16:3e:dc:4f:2b", "network": {"id": "bb5a8d29-6265-47e7-b3f9-bd002a8ffb53", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-354574264", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bc25a4854a194e9283b568768daea226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664963e1-f4", "ovs_interfaceid": "664963e1-f4ab-4f68-a310-5f321a2b0a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:42:52 user nova-compute[73056]: DEBUG nova.network.os_vif_util [req-39b729e0-6d9b-4aa7-99ac-85079c404a74 req-7728d697-008c-48ee-88df-4751a01ec721 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:4f:2b,bridge_name='br-int',has_traffic_filtering=True,id=664963e1-f4ab-4f68-a310-5f321a2b0a21,network=Network(bb5a8d29-6265-47e7-b3f9-bd002a8ffb53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap664963e1-f4') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:42:52 user nova-compute[73056]: DEBUG os_vif [req-39b729e0-6d9b-4aa7-99ac-85079c404a74 req-7728d697-008c-48ee-88df-4751a01ec721 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:4f:2b,bridge_name='br-int',has_traffic_filtering=True,id=664963e1-f4ab-4f68-a310-5f321a2b0a21,network=Network(bb5a8d29-6265-47e7-b3f9-bd002a8ffb53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap664963e1-f4') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:42:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap664963e1-f4, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:42:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:42:52 user nova-compute[73056]: INFO os_vif [req-39b729e0-6d9b-4aa7-99ac-85079c404a74 req-7728d697-008c-48ee-88df-4751a01ec721 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:4f:2b,bridge_name='br-int',has_traffic_filtering=True,id=664963e1-f4ab-4f68-a310-5f321a2b0a21,network=Network(bb5a8d29-6265-47e7-b3f9-bd002a8ffb53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap664963e1-f4')
Aug 14 16:42:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [req-39b729e0-6d9b-4aa7-99ac-85079c404a74 req-7728d697-008c-48ee-88df-4751a01ec721 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:42:52 user nova-compute[73056]:   <nova:package version="0.0.0"/>
Aug 14 16:42:52 user nova-compute[73056]:   <nova:name>tempest-device-tagging-server-208719382</nova:name>
Aug 14 16:42:52 user nova-compute[73056]:   <nova:creationTime>2023-08-14 16:42:52</nova:creationTime>
Aug 14 16:42:52 user nova-compute[73056]:   <nova:flavor name="m1.tiny">
Aug 14 16:42:52 user nova-compute[73056]:     <nova:memory>512</nova:memory>
Aug 14 16:42:52 user nova-compute[73056]:     <nova:disk>1</nova:disk>
Aug 14 16:42:52 user nova-compute[73056]:     <nova:swap>0</nova:swap>
Aug 14 16:42:52 user nova-compute[73056]:     <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:42:52 user nova-compute[73056]:     <nova:vcpus>1</nova:vcpus>
Aug 14 16:42:52 user nova-compute[73056]:   </nova:flavor>
Aug 14 16:42:52 user nova-compute[73056]:   <nova:owner>
Aug 14 16:42:52 user nova-compute[73056]:     <nova:user uuid="333c53f1db334c3aad3b1c7dca862e74">tempest-TaggedAttachmentsTest-1768493659-project-member</nova:user>
Aug 14 16:42:52 user nova-compute[73056]:     <nova:project uuid="bc25a4854a194e9283b568768daea226">tempest-TaggedAttachmentsTest-1768493659</nova:project>
Aug 14 16:42:52 user nova-compute[73056]:   </nova:owner>
Aug 14 16:42:52 user nova-compute[73056]:   <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:42:52 user nova-compute[73056]:   <nova:ports>
Aug 14 16:42:52 user nova-compute[73056]:     <nova:port uuid="90cb9090-537a-414e-ac09-1893281186c2">
Aug 14 16:42:52 user nova-compute[73056]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 14 16:42:52 user nova-compute[73056]:     </nova:port>
Aug 14 16:42:52 user nova-compute[73056]:   </nova:ports>
Aug 14 16:42:52 user nova-compute[73056]: </nova:instance>
Aug 14 16:42:52 user nova-compute[73056]:  {{(pid=73056) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 14 16:42:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:53 user nova-compute[73056]: DEBUG nova.network.neutron [None req-4e4a6f87-80e8-43a3-adb6-f07d7cb9fe2a tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Updating instance_info_cache with network_info: [{"id": "90cb9090-537a-414e-ac09-1893281186c2", "address": "fa:16:3e:f2:46:30", "network": {"id": "d4aa57ea-03bd-491a-9861-e52c142e083c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1629351750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc25a4854a194e9283b568768daea226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90cb9090-53", "ovs_interfaceid": "90cb9090-537a-414e-ac09-1893281186c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:42:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-4e4a6f87-80e8-43a3-adb6-f07d7cb9fe2a tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Releasing lock "refresh_cache-18008990-9ed6-46e5-805c-4475e58855a6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:42:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-4e4a6f87-80e8-43a3-adb6-f07d7cb9fe2a tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lock "interface-18008990-9ed6-46e5-805c-4475e58855a6-664963e1-f4ab-4f68-a310-5f321a2b0a21" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.347s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:42:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-6bfdc8a9-68e2-461e-8f26-9960a144f86d req-0a246c35-cfa3-467c-b0cd-0f0cdab24a89 service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Received event network-vif-plugged-664963e1-f4ab-4f68-a310-5f321a2b0a21 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:42:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6bfdc8a9-68e2-461e-8f26-9960a144f86d req-0a246c35-cfa3-467c-b0cd-0f0cdab24a89 service nova] Acquiring lock "18008990-9ed6-46e5-805c-4475e58855a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:42:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6bfdc8a9-68e2-461e-8f26-9960a144f86d req-0a246c35-cfa3-467c-b0cd-0f0cdab24a89 service nova] Lock "18008990-9ed6-46e5-805c-4475e58855a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:42:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6bfdc8a9-68e2-461e-8f26-9960a144f86d req-0a246c35-cfa3-467c-b0cd-0f0cdab24a89 service nova] Lock "18008990-9ed6-46e5-805c-4475e58855a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:42:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-6bfdc8a9-68e2-461e-8f26-9960a144f86d req-0a246c35-cfa3-467c-b0cd-0f0cdab24a89 service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] No waiting events found dispatching network-vif-plugged-664963e1-f4ab-4f68-a310-5f321a2b0a21 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:42:53 user nova-compute[73056]: WARNING nova.compute.manager [req-6bfdc8a9-68e2-461e-8f26-9960a144f86d req-0a246c35-cfa3-467c-b0cd-0f0cdab24a89 service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Received unexpected event network-vif-plugged-664963e1-f4ab-4f68-a310-5f321a2b0a21 for instance with vm_state active and task_state None.
Aug 14 16:42:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:54 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:42:54 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:42:54 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:42:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:42:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:42:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:42:54 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 16:42:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:42:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1beaec7b-ecd0-4586-b4b2-b04588ce9e2a/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1beaec7b-ecd0-4586-b4b2-b04588ce9e2a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1beaec7b-ecd0-4586-b4b2-b04588ce9e2a/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1beaec7b-ecd0-4586-b4b2-b04588ce9e2a/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:56 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692031361.031124, 0fd5ba83-0612-4ce2-bd44-3ab55820022f => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:42:56 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] VM Stopped (Lifecycle Event)
Aug 14 16:42:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:56 user nova-compute[73056]: DEBUG nova.compute.manager [None req-2e510751-40bc-44b9-9d7d-01256d0fb2f3 None None] [instance: 0fd5ba83-0612-4ce2-bd44-3ab55820022f] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:42:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:56 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:56 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3270811-8241-47a6-aa36-0ec3feddf0fc/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3270811-8241-47a6-aa36-0ec3feddf0fc/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3270811-8241-47a6-aa36-0ec3feddf0fc/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3270811-8241-47a6-aa36-0ec3feddf0fc/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:42:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:42:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:42:58 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:42:58 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:42:58 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=7529MB free_disk=25.495216369628906GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 16:42:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:42:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:42:58 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 9f3a7f8a-e3b9-4918-9663-968677fe5c90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:42:58 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:42:58 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 18008990-9ed6-46e5-805c-4475e58855a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:42:58 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 4731f355-9307-4176-910b-cf35beb85e75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:42:58 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 9c11423c-88d3-4fae-8917-c0d57021d194 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:42:58 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance b3270811-8241-47a6-aa36-0ec3feddf0fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:42:58 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:42:58 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 16:42:58 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 16:42:58 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:42:58 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:42:58 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 16:42:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.450s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:42:59 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:42:59 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 16:42:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:42:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:42:59 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 16:43:00 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Updating instance_info_cache with network_info: [{"id": "c2e32544-47df-43ff-ae83-c30388d9d618", "address": "fa:16:3e:9d:43:1e", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2e32544-47", "ovs_interfaceid": "c2e32544-47df-43ff-ae83-c30388d9d618", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:43:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:43:00 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 16:43:00 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:43:00 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:43:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:11 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:11 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Acquiring lock "a6108d44-11ef-4414-889b-35a105195b8e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Lock "a6108d44-11ef-4414-889b-35a105195b8e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:14 user nova-compute[73056]: DEBUG nova.compute.manager [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:43:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:14 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:43:14 user nova-compute[73056]: INFO nova.compute.claims [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Claim successful on node user
Aug 14 16:43:14 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:43:14 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:43:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.377s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:15 user nova-compute[73056]: DEBUG nova.compute.manager [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:43:15 user nova-compute[73056]: DEBUG nova.compute.manager [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:43:15 user nova-compute[73056]: DEBUG nova.network.neutron [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:43:15 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:43:15 user nova-compute[73056]: DEBUG nova.compute.manager [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:43:15 user nova-compute[73056]: DEBUG nova.policy [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '302b84a0d2ec4bddb2e3ccbeeb853747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcccd44594f64557856a1d64fc7f0a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:43:15 user nova-compute[73056]: DEBUG nova.compute.manager [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:43:15 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:43:15 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Creating image(s)
Aug 14 16:43:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Acquiring lock "/opt/stack/data/nova/instances/a6108d44-11ef-4414-889b-35a105195b8e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Lock "/opt/stack/data/nova/instances/a6108d44-11ef-4414-889b-35a105195b8e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Lock "/opt/stack/data/nova/instances/a6108d44-11ef-4414-889b-35a105195b8e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.176s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Acquiring lock "c889592ab94cd0b0ce896f27a2af0323771db234" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.169s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/a6108d44-11ef-4414-889b-35a105195b8e/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/a6108d44-11ef-4414-889b-35a105195b8e/disk 1073741824" returned: 0 in 0.048s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.184s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:15 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a6108d44-11ef-4414-889b-35a105195b8e/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 16:43:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6108d44-11ef-4414-889b-35a105195b8e/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:15 user nova-compute[73056]: DEBUG nova.network.neutron [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Successfully created port: 4fc1f417-10f1-4ebc-a065-0933dbd1863d {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:43:16 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6108d44-11ef-4414-889b-35a105195b8e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:16 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Cannot resize image /opt/stack/data/nova/instances/a6108d44-11ef-4414-889b-35a105195b8e/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 16:43:16 user nova-compute[73056]: DEBUG nova.objects.instance [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Lazy-loading 'migration_context' on Instance uuid a6108d44-11ef-4414-889b-35a105195b8e {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:43:16 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 16:43:16 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Ensure instance console log exists: /opt/stack/data/nova/instances/a6108d44-11ef-4414-889b-35a105195b8e/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:43:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:16 user nova-compute[73056]: DEBUG nova.network.neutron [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Successfully updated port: 4fc1f417-10f1-4ebc-a065-0933dbd1863d {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:43:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Acquiring lock "refresh_cache-a6108d44-11ef-4414-889b-35a105195b8e" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:43:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Acquired lock "refresh_cache-a6108d44-11ef-4414-889b-35a105195b8e" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:43:16 user nova-compute[73056]: DEBUG nova.network.neutron [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:43:16 user nova-compute[73056]: DEBUG nova.compute.manager [req-e2b912c0-0d4f-400b-a81f-e06a24e8df32 req-b5efa63c-a17d-400f-b016-723c64ea6f8f service nova] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Received event network-changed-4fc1f417-10f1-4ebc-a065-0933dbd1863d {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:43:16 user nova-compute[73056]: DEBUG nova.compute.manager [req-e2b912c0-0d4f-400b-a81f-e06a24e8df32 req-b5efa63c-a17d-400f-b016-723c64ea6f8f service nova] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Refreshing instance network info cache due to event network-changed-4fc1f417-10f1-4ebc-a065-0933dbd1863d. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:43:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e2b912c0-0d4f-400b-a81f-e06a24e8df32 req-b5efa63c-a17d-400f-b016-723c64ea6f8f service nova] Acquiring lock "refresh_cache-a6108d44-11ef-4414-889b-35a105195b8e" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:43:16 user nova-compute[73056]: DEBUG nova.network.neutron [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG nova.network.neutron [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Updating instance_info_cache with network_info: [{"id": "4fc1f417-10f1-4ebc-a065-0933dbd1863d", "address": "fa:16:3e:a0:4c:46", "network": {"id": "f32dab76-cccd-47e6-9a3a-86c15eec31ec", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1998522699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcccd44594f64557856a1d64fc7f0a11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc1f417-10", "ovs_interfaceid": "4fc1f417-10f1-4ebc-a065-0933dbd1863d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Releasing lock "refresh_cache-a6108d44-11ef-4414-889b-35a105195b8e" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG nova.compute.manager [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Instance network_info: |[{"id": "4fc1f417-10f1-4ebc-a065-0933dbd1863d", "address": "fa:16:3e:a0:4c:46", "network": {"id": "f32dab76-cccd-47e6-9a3a-86c15eec31ec", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1998522699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcccd44594f64557856a1d64fc7f0a11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc1f417-10", "ovs_interfaceid": "4fc1f417-10f1-4ebc-a065-0933dbd1863d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e2b912c0-0d4f-400b-a81f-e06a24e8df32 req-b5efa63c-a17d-400f-b016-723c64ea6f8f service nova] Acquired lock "refresh_cache-a6108d44-11ef-4414-889b-35a105195b8e" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG nova.network.neutron [req-e2b912c0-0d4f-400b-a81f-e06a24e8df32 req-b5efa63c-a17d-400f-b016-723c64ea6f8f service nova] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Refreshing network info cache for port 4fc1f417-10f1-4ebc-a065-0933dbd1863d {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Start _get_guest_xml network_info=[{"id": "4fc1f417-10f1-4ebc-a065-0933dbd1863d", "address": "fa:16:3e:a0:4c:46", "network": {"id": "f32dab76-cccd-47e6-9a3a-86c15eec31ec", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1998522699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcccd44594f64557856a1d64fc7f0a11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc1f417-10", "ovs_interfaceid": "4fc1f417-10f1-4ebc-a065-0933dbd1863d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:43:17 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:43:17 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:43:17 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:43:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1136724839',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1136724839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1136724',id=19,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWnHvIQCO52FVUf+EAhkXbM8jo8Tcslaz4JHRYbpp+cmKAIQEkxWR7ZK6ZiRhDOOk35KrIbV1W+rpdZkq18fkiYWBlj68hhk2fxwFDtu2lZuySXZNsHQhbeIeaOjlHtug==',key_name='tempest-keypair-810595386',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dcccd44594f64557856a1d64fc7f0a11',ramdisk_id='',reservation_id='r-7zurb1oy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1453299050',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:43:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='302b84a0d2ec4bddb2e3ccbeeb853747',uuid=a6108d44-11ef-4414-889b-35a105195b8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fc1f417-10f1-4ebc-a065-0933dbd1863d", "address": "fa:16:3e:a0:4c:46", "network": {"id": "f32dab76-cccd-47e6-9a3a-86c15eec31ec", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1998522699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcccd44594f64557856a1d64fc7f0a11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc1f417-10", "ovs_interfaceid": "4fc1f417-10f1-4ebc-a065-0933dbd1863d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Converting VIF {"id": "4fc1f417-10f1-4ebc-a065-0933dbd1863d", "address": "fa:16:3e:a0:4c:46", "network": {"id": "f32dab76-cccd-47e6-9a3a-86c15eec31ec", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1998522699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcccd44594f64557856a1d64fc7f0a11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc1f417-10", "ovs_interfaceid": "4fc1f417-10f1-4ebc-a065-0933dbd1863d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:4c:46,bridge_name='br-int',has_traffic_filtering=True,id=4fc1f417-10f1-4ebc-a065-0933dbd1863d,network=Network(f32dab76-cccd-47e6-9a3a-86c15eec31ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fc1f417-10') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG nova.objects.instance [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Lazy-loading 'pci_devices' on Instance uuid a6108d44-11ef-4414-889b-35a105195b8e {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:43:17 user nova-compute[73056]:   <uuid>a6108d44-11ef-4414-889b-35a105195b8e</uuid>
Aug 14 16:43:17 user nova-compute[73056]:   <name>instance-00000013</name>
Aug 14 16:43:17 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:43:17 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:43:17 user nova-compute[73056]:   <metadata>
Aug 14 16:43:17 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:43:17 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:43:17 user nova-compute[73056]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1136724839</nova:name>
Aug 14 16:43:17 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:43:17</nova:creationTime>
Aug 14 16:43:17 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:43:17 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:43:17 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:43:17 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:43:17 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:43:17 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:43:17 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:43:17 user nova-compute[73056]:       <nova:owner>
Aug 14 16:43:17 user nova-compute[73056]:         <nova:user uuid="302b84a0d2ec4bddb2e3ccbeeb853747">tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member</nova:user>
Aug 14 16:43:17 user nova-compute[73056]:         <nova:project uuid="dcccd44594f64557856a1d64fc7f0a11">tempest-TestServerVolumeAttachScenarioOldVersion-1453299050</nova:project>
Aug 14 16:43:17 user nova-compute[73056]:       </nova:owner>
Aug 14 16:43:17 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:43:17 user nova-compute[73056]:       <nova:ports>
Aug 14 16:43:17 user nova-compute[73056]:         <nova:port uuid="4fc1f417-10f1-4ebc-a065-0933dbd1863d">
Aug 14 16:43:17 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 16:43:17 user nova-compute[73056]:         </nova:port>
Aug 14 16:43:17 user nova-compute[73056]:       </nova:ports>
Aug 14 16:43:17 user nova-compute[73056]:     </nova:instance>
Aug 14 16:43:17 user nova-compute[73056]:   </metadata>
Aug 14 16:43:17 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:43:17 user nova-compute[73056]:     <system>
Aug 14 16:43:17 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:43:17 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:43:17 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:43:17 user nova-compute[73056]:       <entry name="serial">a6108d44-11ef-4414-889b-35a105195b8e</entry>
Aug 14 16:43:17 user nova-compute[73056]:       <entry name="uuid">a6108d44-11ef-4414-889b-35a105195b8e</entry>
Aug 14 16:43:17 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:43:17 user nova-compute[73056]:     </system>
Aug 14 16:43:17 user nova-compute[73056]:   </sysinfo>
Aug 14 16:43:17 user nova-compute[73056]:   <os>
Aug 14 16:43:17 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:43:17 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:43:17 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:43:17 user nova-compute[73056]:   </os>
Aug 14 16:43:17 user nova-compute[73056]:   <features>
Aug 14 16:43:17 user nova-compute[73056]:     <acpi/>
Aug 14 16:43:17 user nova-compute[73056]:     <apic/>
Aug 14 16:43:17 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:43:17 user nova-compute[73056]:   </features>
Aug 14 16:43:17 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:43:17 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:43:17 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:43:17 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:43:17 user nova-compute[73056]:   </clock>
Aug 14 16:43:17 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:43:17 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:43:17 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:43:17 user nova-compute[73056]:   </cpu>
Aug 14 16:43:17 user nova-compute[73056]:   <devices>
Aug 14 16:43:17 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:43:17 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:43:17 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/a6108d44-11ef-4414-889b-35a105195b8e/disk"/>
Aug 14 16:43:17 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:43:17 user nova-compute[73056]:     </disk>
Aug 14 16:43:17 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:43:17 user nova-compute[73056]:       <mac address="fa:16:3e:a0:4c:46"/>
Aug 14 16:43:17 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:43:17 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:43:17 user nova-compute[73056]:       <target dev="tap4fc1f417-10"/>
Aug 14 16:43:17 user nova-compute[73056]:     </interface>
Aug 14 16:43:17 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:43:17 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/a6108d44-11ef-4414-889b-35a105195b8e/console.log" append="off"/>
Aug 14 16:43:17 user nova-compute[73056]:     </serial>
Aug 14 16:43:17 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:43:17 user nova-compute[73056]:     <video>
Aug 14 16:43:17 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:43:17 user nova-compute[73056]:     </video>
Aug 14 16:43:17 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:43:17 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:43:17 user nova-compute[73056]:     </rng>
Aug 14 16:43:17 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:43:17 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:43:17 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:43:17 user nova-compute[73056]:     </memballoon>
Aug 14 16:43:17 user nova-compute[73056]:   </devices>
Aug 14 16:43:17 user nova-compute[73056]: </domain>
Aug 14 16:43:17 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:43:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1136724839',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1136724839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1136724',id=19,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWnHvIQCO52FVUf+EAhkXbM8jo8Tcslaz4JHRYbpp+cmKAIQEkxWR7ZK6ZiRhDOOk35KrIbV1W+rpdZkq18fkiYWBlj68hhk2fxwFDtu2lZuySXZNsHQhbeIeaOjlHtug==',key_name='tempest-keypair-810595386',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dcccd44594f64557856a1d64fc7f0a11',ramdisk_id='',reservation_id='r-7zurb1oy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1453299050',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:43:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='302b84a0d2ec4bddb2e3ccbeeb853747',uuid=a6108d44-11ef-4414-889b-35a105195b8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fc1f417-10f1-4ebc-a065-0933dbd1863d", "address": "fa:16:3e:a0:4c:46", "network": {"id": "f32dab76-cccd-47e6-9a3a-86c15eec31ec", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1998522699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcccd44594f64557856a1d64fc7f0a11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc1f417-10", "ovs_interfaceid": "4fc1f417-10f1-4ebc-a065-0933dbd1863d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Converting VIF {"id": "4fc1f417-10f1-4ebc-a065-0933dbd1863d", "address": "fa:16:3e:a0:4c:46", "network": {"id": "f32dab76-cccd-47e6-9a3a-86c15eec31ec", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1998522699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcccd44594f64557856a1d64fc7f0a11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc1f417-10", "ovs_interfaceid": "4fc1f417-10f1-4ebc-a065-0933dbd1863d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:4c:46,bridge_name='br-int',has_traffic_filtering=True,id=4fc1f417-10f1-4ebc-a065-0933dbd1863d,network=Network(f32dab76-cccd-47e6-9a3a-86c15eec31ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fc1f417-10') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG os_vif [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:4c:46,bridge_name='br-int',has_traffic_filtering=True,id=4fc1f417-10f1-4ebc-a065-0933dbd1863d,network=Network(f32dab76-cccd-47e6-9a3a-86c15eec31ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fc1f417-10') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4fc1f417-10, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4fc1f417-10, col_values=(('external_ids', {'iface-id': '4fc1f417-10f1-4ebc-a065-0933dbd1863d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:4c:46', 'vm-uuid': 'a6108d44-11ef-4414-889b-35a105195b8e'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:17 user nova-compute[73056]: INFO os_vif [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:4c:46,bridge_name='br-int',has_traffic_filtering=True,id=4fc1f417-10f1-4ebc-a065-0933dbd1863d,network=Network(f32dab76-cccd-47e6-9a3a-86c15eec31ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fc1f417-10')
Aug 14 16:43:17 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] No VIF found with MAC fa:16:3e:a0:4c:46, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG nova.network.neutron [req-e2b912c0-0d4f-400b-a81f-e06a24e8df32 req-b5efa63c-a17d-400f-b016-723c64ea6f8f service nova] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Updated VIF entry in instance network info cache for port 4fc1f417-10f1-4ebc-a065-0933dbd1863d. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG nova.network.neutron [req-e2b912c0-0d4f-400b-a81f-e06a24e8df32 req-b5efa63c-a17d-400f-b016-723c64ea6f8f service nova] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Updating instance_info_cache with network_info: [{"id": "4fc1f417-10f1-4ebc-a065-0933dbd1863d", "address": "fa:16:3e:a0:4c:46", "network": {"id": "f32dab76-cccd-47e6-9a3a-86c15eec31ec", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1998522699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcccd44594f64557856a1d64fc7f0a11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc1f417-10", "ovs_interfaceid": "4fc1f417-10f1-4ebc-a065-0933dbd1863d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e2b912c0-0d4f-400b-a81f-e06a24e8df32 req-b5efa63c-a17d-400f-b016-723c64ea6f8f service nova] Releasing lock "refresh_cache-a6108d44-11ef-4414-889b-35a105195b8e" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:43:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:18 user nova-compute[73056]: DEBUG nova.compute.manager [req-2e157355-5829-488a-a561-0fffdb4f64f9 req-82c51eb1-37a9-40a1-a81f-2df909ee0b15 service nova] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Received event network-vif-plugged-4fc1f417-10f1-4ebc-a065-0933dbd1863d {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:43:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2e157355-5829-488a-a561-0fffdb4f64f9 req-82c51eb1-37a9-40a1-a81f-2df909ee0b15 service nova] Acquiring lock "a6108d44-11ef-4414-889b-35a105195b8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2e157355-5829-488a-a561-0fffdb4f64f9 req-82c51eb1-37a9-40a1-a81f-2df909ee0b15 service nova] Lock "a6108d44-11ef-4414-889b-35a105195b8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2e157355-5829-488a-a561-0fffdb4f64f9 req-82c51eb1-37a9-40a1-a81f-2df909ee0b15 service nova] Lock "a6108d44-11ef-4414-889b-35a105195b8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:18 user nova-compute[73056]: DEBUG nova.compute.manager [req-2e157355-5829-488a-a561-0fffdb4f64f9 req-82c51eb1-37a9-40a1-a81f-2df909ee0b15 service nova] [instance: a6108d44-11ef-4414-889b-35a105195b8e] No waiting events found dispatching network-vif-plugged-4fc1f417-10f1-4ebc-a065-0933dbd1863d {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:43:18 user nova-compute[73056]: WARNING nova.compute.manager [req-2e157355-5829-488a-a561-0fffdb4f64f9 req-82c51eb1-37a9-40a1-a81f-2df909ee0b15 service nova] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Received unexpected event network-vif-plugged-4fc1f417-10f1-4ebc-a065-0933dbd1863d for instance with vm_state building and task_state spawning.
Aug 14 16:43:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:20 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031400.6509392, a6108d44-11ef-4414-889b-35a105195b8e => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:43:20 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: a6108d44-11ef-4414-889b-35a105195b8e] VM Resumed (Lifecycle Event)
Aug 14 16:43:20 user nova-compute[73056]: DEBUG nova.compute.manager [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:43:20 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:43:20 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Instance spawned successfully.
Aug 14 16:43:20 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:43:20 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:43:20 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:43:20 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:43:20 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:43:20 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:43:20 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:43:20 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:43:20 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:43:20 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: a6108d44-11ef-4414-889b-35a105195b8e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:43:20 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031400.6547616, a6108d44-11ef-4414-889b-35a105195b8e => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:43:20 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: a6108d44-11ef-4414-889b-35a105195b8e] VM Started (Lifecycle Event)
Aug 14 16:43:20 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:43:20 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:43:20 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: a6108d44-11ef-4414-889b-35a105195b8e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:43:20 user nova-compute[73056]: INFO nova.compute.manager [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Took 5.51 seconds to spawn the instance on the hypervisor.
Aug 14 16:43:20 user nova-compute[73056]: DEBUG nova.compute.manager [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:43:20 user nova-compute[73056]: INFO nova.compute.manager [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Took 6.22 seconds to build instance.
Aug 14 16:43:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b56faf9e-1d75-48bc-b0f6-20c2f4e04d9b tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Lock "a6108d44-11ef-4414-889b-35a105195b8e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.315s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:20 user nova-compute[73056]: DEBUG nova.compute.manager [req-c6ffb28f-0e2b-426b-9f32-16a179008004 req-569b67c4-6229-4433-8059-670b834b4fa1 service nova] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Received event network-vif-plugged-4fc1f417-10f1-4ebc-a065-0933dbd1863d {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:43:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c6ffb28f-0e2b-426b-9f32-16a179008004 req-569b67c4-6229-4433-8059-670b834b4fa1 service nova] Acquiring lock "a6108d44-11ef-4414-889b-35a105195b8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c6ffb28f-0e2b-426b-9f32-16a179008004 req-569b67c4-6229-4433-8059-670b834b4fa1 service nova] Lock "a6108d44-11ef-4414-889b-35a105195b8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c6ffb28f-0e2b-426b-9f32-16a179008004 req-569b67c4-6229-4433-8059-670b834b4fa1 service nova] Lock "a6108d44-11ef-4414-889b-35a105195b8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:20 user nova-compute[73056]: DEBUG nova.compute.manager [req-c6ffb28f-0e2b-426b-9f32-16a179008004 req-569b67c4-6229-4433-8059-670b834b4fa1 service nova] [instance: a6108d44-11ef-4414-889b-35a105195b8e] No waiting events found dispatching network-vif-plugged-4fc1f417-10f1-4ebc-a065-0933dbd1863d {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:43:20 user nova-compute[73056]: WARNING nova.compute.manager [req-c6ffb28f-0e2b-426b-9f32-16a179008004 req-569b67c4-6229-4433-8059-670b834b4fa1 service nova] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Received unexpected event network-vif-plugged-4fc1f417-10f1-4ebc-a065-0933dbd1863d for instance with vm_state active and task_state None.
Aug 14 16:43:22 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:22 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "10b527b0-a7f1-4149-9859-69dac9f481e3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "10b527b0-a7f1-4149-9859-69dac9f481e3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:28 user nova-compute[73056]: DEBUG nova.compute.manager [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:43:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:28 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:43:28 user nova-compute[73056]: INFO nova.compute.claims [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Claim successful on node user
Aug 14 16:43:28 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:43:28 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:43:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:28 user nova-compute[73056]: DEBUG nova.compute.manager [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:43:28 user nova-compute[73056]: DEBUG nova.compute.manager [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:43:28 user nova-compute[73056]: DEBUG nova.network.neutron [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:43:28 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:43:28 user nova-compute[73056]: DEBUG nova.compute.manager [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:43:28 user nova-compute[73056]: INFO nova.virt.block_device [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Booting with volume snapshot 9c6ce68d-c998-4626-861c-ab0c0accd174 at /dev/vda
Aug 14 16:43:28 user nova-compute[73056]: DEBUG nova.policy [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2be1b098ca9f4232bd198b515630f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffb5203b9284500b8add8a6586cad49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:43:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquiring lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:29 user nova-compute[73056]: DEBUG nova.compute.manager [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:43:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:29 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:43:29 user nova-compute[73056]: INFO nova.compute.claims [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Claim successful on node user
Aug 14 16:43:29 user nova-compute[73056]: DEBUG nova.network.neutron [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Successfully created port: b97ec96e-9506-4427-b9b1-38f2233a320c {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:43:29 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:43:29 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:43:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.514s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:29 user nova-compute[73056]: DEBUG nova.compute.manager [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:43:29 user nova-compute[73056]: DEBUG nova.compute.manager [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:43:29 user nova-compute[73056]: DEBUG nova.network.neutron [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:43:29 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:43:29 user nova-compute[73056]: DEBUG nova.compute.manager [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:43:29 user nova-compute[73056]: DEBUG nova.policy [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '78a1ab88047b4199bb611c0d7c8d6dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e6131531ab4553b55ea090d5e7f47d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:43:29 user nova-compute[73056]: DEBUG nova.compute.manager [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:43:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:43:29 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Creating image(s)
Aug 14 16:43:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5dbfa63-5061-4304-b8eb-4565ad9f0a96/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "/opt/stack/data/nova/instances/d5dbfa63-5061-4304-b8eb-4565ad9f0a96/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "/opt/stack/data/nova/instances/d5dbfa63-5061-4304-b8eb-4565ad9f0a96/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquiring lock "b93d781dfbec47a3093bbda995328a2a54025a4d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "b93d781dfbec47a3093bbda995328a2a54025a4d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b93d781dfbec47a3093bbda995328a2a54025a4d.part --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:30 user nova-compute[73056]: DEBUG nova.network.neutron [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Successfully updated port: b97ec96e-9506-4427-b9b1-38f2233a320c {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:43:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "refresh_cache-10b527b0-a7f1-4149-9859-69dac9f481e3" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:43:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquired lock "refresh_cache-10b527b0-a7f1-4149-9859-69dac9f481e3" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:43:30 user nova-compute[73056]: DEBUG nova.network.neutron [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:43:30 user nova-compute[73056]: DEBUG nova.compute.manager [req-8dec3074-a92a-4ffe-a28e-559234028afe req-5934df85-3161-44c5-8968-420370cfd888 service nova] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Received event network-changed-b97ec96e-9506-4427-b9b1-38f2233a320c {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:43:30 user nova-compute[73056]: DEBUG nova.compute.manager [req-8dec3074-a92a-4ffe-a28e-559234028afe req-5934df85-3161-44c5-8968-420370cfd888 service nova] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Refreshing instance network info cache due to event network-changed-b97ec96e-9506-4427-b9b1-38f2233a320c. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:43:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8dec3074-a92a-4ffe-a28e-559234028afe req-5934df85-3161-44c5-8968-420370cfd888 service nova] Acquiring lock "refresh_cache-10b527b0-a7f1-4149-9859-69dac9f481e3" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:43:30 user nova-compute[73056]: DEBUG nova.network.neutron [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:43:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b93d781dfbec47a3093bbda995328a2a54025a4d.part --force-share --output=json" returned: 0 in 0.398s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:30 user nova-compute[73056]: DEBUG nova.virt.images [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] b4b1c783-2e7d-4b82-ad1f-dd57d51115a1 was qcow2, converting to raw {{(pid=73056) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 16:43:30 user nova-compute[73056]: DEBUG nova.privsep.utils [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73056) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 16:43:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b93d781dfbec47a3093bbda995328a2a54025a4d.part /opt/stack/data/nova/instances/_base/b93d781dfbec47a3093bbda995328a2a54025a4d.converted {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:30 user nova-compute[73056]: DEBUG nova.network.neutron [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Successfully created port: 4d2af65d-3317-4411-a99d-13f81c27cc4c {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:43:31 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b93d781dfbec47a3093bbda995328a2a54025a4d.part /opt/stack/data/nova/instances/_base/b93d781dfbec47a3093bbda995328a2a54025a4d.converted" returned: 0 in 0.415s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:31 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b93d781dfbec47a3093bbda995328a2a54025a4d.converted --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:31 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b93d781dfbec47a3093bbda995328a2a54025a4d.converted --force-share --output=json" returned: 0 in 0.197s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "b93d781dfbec47a3093bbda995328a2a54025a4d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.569s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:31 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b93d781dfbec47a3093bbda995328a2a54025a4d --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:31 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b93d781dfbec47a3093bbda995328a2a54025a4d --force-share --output=json" returned: 0 in 0.240s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquiring lock "b93d781dfbec47a3093bbda995328a2a54025a4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "b93d781dfbec47a3093bbda995328a2a54025a4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:31 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b93d781dfbec47a3093bbda995328a2a54025a4d --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:31 user nova-compute[73056]: DEBUG nova.network.neutron [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Updating instance_info_cache with network_info: [{"id": "b97ec96e-9506-4427-b9b1-38f2233a320c", "address": "fa:16:3e:46:16:7c", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97ec96e-95", "ovs_interfaceid": "b97ec96e-9506-4427-b9b1-38f2233a320c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:43:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Releasing lock "refresh_cache-10b527b0-a7f1-4149-9859-69dac9f481e3" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:43:31 user nova-compute[73056]: DEBUG nova.compute.manager [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Instance network_info: |[{"id": "b97ec96e-9506-4427-b9b1-38f2233a320c", "address": "fa:16:3e:46:16:7c", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97ec96e-95", "ovs_interfaceid": "b97ec96e-9506-4427-b9b1-38f2233a320c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:43:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8dec3074-a92a-4ffe-a28e-559234028afe req-5934df85-3161-44c5-8968-420370cfd888 service nova] Acquired lock "refresh_cache-10b527b0-a7f1-4149-9859-69dac9f481e3" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:43:31 user nova-compute[73056]: DEBUG nova.network.neutron [req-8dec3074-a92a-4ffe-a28e-559234028afe req-5934df85-3161-44c5-8968-420370cfd888 service nova] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Refreshing network info cache for port b97ec96e-9506-4427-b9b1-38f2233a320c {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:43:31 user nova-compute[73056]: DEBUG nova.network.neutron [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Successfully updated port: 4d2af65d-3317-4411-a99d-13f81c27cc4c {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:43:31 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b93d781dfbec47a3093bbda995328a2a54025a4d --force-share --output=json" returned: 0 in 0.223s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:31 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b93d781dfbec47a3093bbda995328a2a54025a4d,backing_fmt=raw /opt/stack/data/nova/instances/d5dbfa63-5061-4304-b8eb-4565ad9f0a96/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquiring lock "refresh_cache-d5dbfa63-5061-4304-b8eb-4565ad9f0a96" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:43:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquired lock "refresh_cache-d5dbfa63-5061-4304-b8eb-4565ad9f0a96" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:43:31 user nova-compute[73056]: DEBUG nova.network.neutron [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:43:31 user nova-compute[73056]: DEBUG nova.compute.manager [req-ff67fd16-55e1-4771-807c-0ae449ba16dc req-f1801a6b-cd21-41ce-9ef7-d1d360334cc7 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Received event network-changed-4d2af65d-3317-4411-a99d-13f81c27cc4c {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:43:31 user nova-compute[73056]: DEBUG nova.compute.manager [req-ff67fd16-55e1-4771-807c-0ae449ba16dc req-f1801a6b-cd21-41ce-9ef7-d1d360334cc7 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Refreshing instance network info cache due to event network-changed-4d2af65d-3317-4411-a99d-13f81c27cc4c. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:43:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ff67fd16-55e1-4771-807c-0ae449ba16dc req-f1801a6b-cd21-41ce-9ef7-d1d360334cc7 service nova] Acquiring lock "refresh_cache-d5dbfa63-5061-4304-b8eb-4565ad9f0a96" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:43:31 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b93d781dfbec47a3093bbda995328a2a54025a4d,backing_fmt=raw /opt/stack/data/nova/instances/d5dbfa63-5061-4304-b8eb-4565ad9f0a96/disk 1073741824" returned: 0 in 0.068s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "b93d781dfbec47a3093bbda995328a2a54025a4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:31 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b93d781dfbec47a3093bbda995328a2a54025a4d --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG nova.network.neutron [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b93d781dfbec47a3093bbda995328a2a54025a4d --force-share --output=json" returned: 0 in 0.191s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d5dbfa63-5061-4304-b8eb-4565ad9f0a96/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dbfa63-5061-4304-b8eb-4565ad9f0a96/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dbfa63-5061-4304-b8eb-4565ad9f0a96/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Cannot resize image /opt/stack/data/nova/instances/d5dbfa63-5061-4304-b8eb-4565ad9f0a96/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG nova.objects.instance [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lazy-loading 'migration_context' on Instance uuid d5dbfa63-5061-4304-b8eb-4565ad9f0a96 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Ensure instance console log exists: /opt/stack/data/nova/instances/d5dbfa63-5061-4304-b8eb-4565ad9f0a96/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG nova.network.neutron [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Updating instance_info_cache with network_info: [{"id": "4d2af65d-3317-4411-a99d-13f81c27cc4c", "address": "fa:16:3e:fa:9c:91", "network": {"id": "dd844e8d-9264-4868-819d-0b01ad3b1d41", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-568480417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e6131531ab4553b55ea090d5e7f47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2af65d-33", "ovs_interfaceid": "4d2af65d-3317-4411-a99d-13f81c27cc4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Releasing lock "refresh_cache-d5dbfa63-5061-4304-b8eb-4565ad9f0a96" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG nova.compute.manager [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Instance network_info: |[{"id": "4d2af65d-3317-4411-a99d-13f81c27cc4c", "address": "fa:16:3e:fa:9c:91", "network": {"id": "dd844e8d-9264-4868-819d-0b01ad3b1d41", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-568480417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e6131531ab4553b55ea090d5e7f47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2af65d-33", "ovs_interfaceid": "4d2af65d-3317-4411-a99d-13f81c27cc4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ff67fd16-55e1-4771-807c-0ae449ba16dc req-f1801a6b-cd21-41ce-9ef7-d1d360334cc7 service nova] Acquired lock "refresh_cache-d5dbfa63-5061-4304-b8eb-4565ad9f0a96" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG nova.network.neutron [req-ff67fd16-55e1-4771-807c-0ae449ba16dc req-f1801a6b-cd21-41ce-9ef7-d1d360334cc7 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Refreshing network info cache for port 4d2af65d-3317-4411-a99d-13f81c27cc4c {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Start _get_guest_xml network_info=[{"id": "4d2af65d-3317-4411-a99d-13f81c27cc4c", "address": "fa:16:3e:fa:9c:91", "network": {"id": "dd844e8d-9264-4868-819d-0b01ad3b1d41", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-568480417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e6131531ab4553b55ea090d5e7f47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2af65d-33", "ovs_interfaceid": "4d2af65d-3317-4411-a99d-13f81c27cc4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:43:26Z,direct_url=<?>,disk_format='qcow2',id=b4b1c783-2e7d-4b82-ad1f-dd57d51115a1,min_disk=0,min_ram=0,name='tempest-scenario-img--1592998639',owner='95e6131531ab4553b55ea090d5e7f47d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:43:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': 'b4b1c783-2e7d-4b82-ad1f-dd57d51115a1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:43:32 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:43:32 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:43:32 user nova-compute[73056]: DEBUG nova.network.neutron [req-8dec3074-a92a-4ffe-a28e-559234028afe req-5934df85-3161-44c5-8968-420370cfd888 service nova] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Updated VIF entry in instance network info cache for port b97ec96e-9506-4427-b9b1-38f2233a320c. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG nova.network.neutron [req-8dec3074-a92a-4ffe-a28e-559234028afe req-5934df85-3161-44c5-8968-420370cfd888 service nova] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Updating instance_info_cache with network_info: [{"id": "b97ec96e-9506-4427-b9b1-38f2233a320c", "address": "fa:16:3e:46:16:7c", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97ec96e-95", "ovs_interfaceid": "b97ec96e-9506-4427-b9b1-38f2233a320c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:43:26Z,direct_url=<?>,disk_format='qcow2',id=b4b1c783-2e7d-4b82-ad1f-dd57d51115a1,min_disk=0,min_ram=0,name='tempest-scenario-img--1592998639',owner='95e6131531ab4553b55ea090d5e7f47d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:43:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:43:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1430322653',display_name='tempest-TestMinimumBasicScenario-server-1430322653',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1430322653',id=21,image_ref='b4b1c783-2e7d-4b82-ad1f-dd57d51115a1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPr36qhIGV026oMXZ/deTnGUJrZ4P/BPR1eRuV6pEMGbEhN8j/TRy7CsVq6xtn88VGXXM14VL4xKD2cZQoImUolaSBHKjXBiIx7Zbxmdq4HS9risqkOjPU6plwsML5Xevg==',key_name='tempest-TestMinimumBasicScenario-101642207',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95e6131531ab4553b55ea090d5e7f47d',ramdisk_id='',reservation_id='r-tqh2kwhh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b4b1c783-2e7d-4b82-ad1f-dd57d51115a1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2039952053',owner_user_name='tempest-TestMinimumBasicScenario-2039952053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:43:30Z,user_data=None,user_id='78a1ab88047b4199bb611c0d7c8d6dee',uuid=d5dbfa63-5061-4304-b8eb-4565ad9f0a96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d2af65d-3317-4411-a99d-13f81c27cc4c", "address": "fa:16:3e:fa:9c:91", "network": {"id": "dd844e8d-9264-4868-819d-0b01ad3b1d41", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-568480417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e6131531ab4553b55ea090d5e7f47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2af65d-33", "ovs_interfaceid": "4d2af65d-3317-4411-a99d-13f81c27cc4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Converting VIF {"id": "4d2af65d-3317-4411-a99d-13f81c27cc4c", "address": "fa:16:3e:fa:9c:91", "network": {"id": "dd844e8d-9264-4868-819d-0b01ad3b1d41", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-568480417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e6131531ab4553b55ea090d5e7f47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2af65d-33", "ovs_interfaceid": "4d2af65d-3317-4411-a99d-13f81c27cc4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:9c:91,bridge_name='br-int',has_traffic_filtering=True,id=4d2af65d-3317-4411-a99d-13f81c27cc4c,network=Network(dd844e8d-9264-4868-819d-0b01ad3b1d41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d2af65d-33') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG nova.objects.instance [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lazy-loading 'pci_devices' on Instance uuid d5dbfa63-5061-4304-b8eb-4565ad9f0a96 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8dec3074-a92a-4ffe-a28e-559234028afe req-5934df85-3161-44c5-8968-420370cfd888 service nova] Releasing lock "refresh_cache-10b527b0-a7f1-4149-9859-69dac9f481e3" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:43:32 user nova-compute[73056]:   <uuid>d5dbfa63-5061-4304-b8eb-4565ad9f0a96</uuid>
Aug 14 16:43:32 user nova-compute[73056]:   <name>instance-00000015</name>
Aug 14 16:43:32 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:43:32 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:43:32 user nova-compute[73056]:   <metadata>
Aug 14 16:43:32 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:43:32 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:43:32 user nova-compute[73056]:       <nova:name>tempest-TestMinimumBasicScenario-server-1430322653</nova:name>
Aug 14 16:43:32 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:43:32</nova:creationTime>
Aug 14 16:43:32 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:43:32 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:43:32 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:43:32 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:43:32 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:43:32 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:43:32 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:43:32 user nova-compute[73056]:       <nova:owner>
Aug 14 16:43:32 user nova-compute[73056]:         <nova:user uuid="78a1ab88047b4199bb611c0d7c8d6dee">tempest-TestMinimumBasicScenario-2039952053-project-member</nova:user>
Aug 14 16:43:32 user nova-compute[73056]:         <nova:project uuid="95e6131531ab4553b55ea090d5e7f47d">tempest-TestMinimumBasicScenario-2039952053</nova:project>
Aug 14 16:43:32 user nova-compute[73056]:       </nova:owner>
Aug 14 16:43:32 user nova-compute[73056]:       <nova:root type="image" uuid="b4b1c783-2e7d-4b82-ad1f-dd57d51115a1"/>
Aug 14 16:43:32 user nova-compute[73056]:       <nova:ports>
Aug 14 16:43:32 user nova-compute[73056]:         <nova:port uuid="4d2af65d-3317-4411-a99d-13f81c27cc4c">
Aug 14 16:43:32 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 14 16:43:32 user nova-compute[73056]:         </nova:port>
Aug 14 16:43:32 user nova-compute[73056]:       </nova:ports>
Aug 14 16:43:32 user nova-compute[73056]:     </nova:instance>
Aug 14 16:43:32 user nova-compute[73056]:   </metadata>
Aug 14 16:43:32 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:43:32 user nova-compute[73056]:     <system>
Aug 14 16:43:32 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:43:32 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:43:32 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:43:32 user nova-compute[73056]:       <entry name="serial">d5dbfa63-5061-4304-b8eb-4565ad9f0a96</entry>
Aug 14 16:43:32 user nova-compute[73056]:       <entry name="uuid">d5dbfa63-5061-4304-b8eb-4565ad9f0a96</entry>
Aug 14 16:43:32 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:43:32 user nova-compute[73056]:     </system>
Aug 14 16:43:32 user nova-compute[73056]:   </sysinfo>
Aug 14 16:43:32 user nova-compute[73056]:   <os>
Aug 14 16:43:32 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:43:32 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:43:32 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:43:32 user nova-compute[73056]:   </os>
Aug 14 16:43:32 user nova-compute[73056]:   <features>
Aug 14 16:43:32 user nova-compute[73056]:     <acpi/>
Aug 14 16:43:32 user nova-compute[73056]:     <apic/>
Aug 14 16:43:32 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:43:32 user nova-compute[73056]:   </features>
Aug 14 16:43:32 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:43:32 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:43:32 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:43:32 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:43:32 user nova-compute[73056]:   </clock>
Aug 14 16:43:32 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:43:32 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:43:32 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:43:32 user nova-compute[73056]:   </cpu>
Aug 14 16:43:32 user nova-compute[73056]:   <devices>
Aug 14 16:43:32 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:43:32 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:43:32 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/d5dbfa63-5061-4304-b8eb-4565ad9f0a96/disk"/>
Aug 14 16:43:32 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:43:32 user nova-compute[73056]:     </disk>
Aug 14 16:43:32 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:43:32 user nova-compute[73056]:       <mac address="fa:16:3e:fa:9c:91"/>
Aug 14 16:43:32 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:43:32 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:43:32 user nova-compute[73056]:       <target dev="tap4d2af65d-33"/>
Aug 14 16:43:32 user nova-compute[73056]:     </interface>
Aug 14 16:43:32 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:43:32 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/d5dbfa63-5061-4304-b8eb-4565ad9f0a96/console.log" append="off"/>
Aug 14 16:43:32 user nova-compute[73056]:     </serial>
Aug 14 16:43:32 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:43:32 user nova-compute[73056]:     <video>
Aug 14 16:43:32 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:43:32 user nova-compute[73056]:     </video>
Aug 14 16:43:32 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:43:32 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:43:32 user nova-compute[73056]:     </rng>
Aug 14 16:43:32 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:43:32 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:43:32 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:43:32 user nova-compute[73056]:     </memballoon>
Aug 14 16:43:32 user nova-compute[73056]:   </devices>
Aug 14 16:43:32 user nova-compute[73056]: </domain>
Aug 14 16:43:32 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:43:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1430322653',display_name='tempest-TestMinimumBasicScenario-server-1430322653',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1430322653',id=21,image_ref='b4b1c783-2e7d-4b82-ad1f-dd57d51115a1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPr36qhIGV026oMXZ/deTnGUJrZ4P/BPR1eRuV6pEMGbEhN8j/TRy7CsVq6xtn88VGXXM14VL4xKD2cZQoImUolaSBHKjXBiIx7Zbxmdq4HS9risqkOjPU6plwsML5Xevg==',key_name='tempest-TestMinimumBasicScenario-101642207',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95e6131531ab4553b55ea090d5e7f47d',ramdisk_id='',reservation_id='r-tqh2kwhh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b4b1c783-2e7d-4b82-ad1f-dd57d51115a1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2039952053',owner_user_name='tempest-TestMinimumBasicScenario-2039952053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:43:30Z,user_data=None,user_id='78a1ab88047b4199bb611c0d7c8d6dee',uuid=d5dbfa63-5061-4304-b8eb-4565ad9f0a96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d2af65d-3317-4411-a99d-13f81c27cc4c", "address": "fa:16:3e:fa:9c:91", "network": {"id": "dd844e8d-9264-4868-819d-0b01ad3b1d41", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-568480417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e6131531ab4553b55ea090d5e7f47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2af65d-33", "ovs_interfaceid": "4d2af65d-3317-4411-a99d-13f81c27cc4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Converting VIF {"id": "4d2af65d-3317-4411-a99d-13f81c27cc4c", "address": "fa:16:3e:fa:9c:91", "network": {"id": "dd844e8d-9264-4868-819d-0b01ad3b1d41", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-568480417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e6131531ab4553b55ea090d5e7f47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2af65d-33", "ovs_interfaceid": "4d2af65d-3317-4411-a99d-13f81c27cc4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:9c:91,bridge_name='br-int',has_traffic_filtering=True,id=4d2af65d-3317-4411-a99d-13f81c27cc4c,network=Network(dd844e8d-9264-4868-819d-0b01ad3b1d41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d2af65d-33') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG os_vif [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:9c:91,bridge_name='br-int',has_traffic_filtering=True,id=4d2af65d-3317-4411-a99d-13f81c27cc4c,network=Network(dd844e8d-9264-4868-819d-0b01ad3b1d41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d2af65d-33') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d2af65d-33, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4d2af65d-33, col_values=(('external_ids', {'iface-id': '4d2af65d-3317-4411-a99d-13f81c27cc4c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:9c:91', 'vm-uuid': 'd5dbfa63-5061-4304-b8eb-4565ad9f0a96'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:32 user nova-compute[73056]: INFO os_vif [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:9c:91,bridge_name='br-int',has_traffic_filtering=True,id=4d2af65d-3317-4411-a99d-13f81c27cc4c,network=Network(dd844e8d-9264-4868-819d-0b01ad3b1d41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d2af65d-33')
Aug 14 16:43:32 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:43:32 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] No VIF found with MAC fa:16:3e:fa:9c:91, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:43:33 user nova-compute[73056]: DEBUG nova.network.neutron [req-ff67fd16-55e1-4771-807c-0ae449ba16dc req-f1801a6b-cd21-41ce-9ef7-d1d360334cc7 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Updated VIF entry in instance network info cache for port 4d2af65d-3317-4411-a99d-13f81c27cc4c. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:43:33 user nova-compute[73056]: DEBUG nova.network.neutron [req-ff67fd16-55e1-4771-807c-0ae449ba16dc req-f1801a6b-cd21-41ce-9ef7-d1d360334cc7 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Updating instance_info_cache with network_info: [{"id": "4d2af65d-3317-4411-a99d-13f81c27cc4c", "address": "fa:16:3e:fa:9c:91", "network": {"id": "dd844e8d-9264-4868-819d-0b01ad3b1d41", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-568480417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e6131531ab4553b55ea090d5e7f47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2af65d-33", "ovs_interfaceid": "4d2af65d-3317-4411-a99d-13f81c27cc4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:43:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ff67fd16-55e1-4771-807c-0ae449ba16dc req-f1801a6b-cd21-41ce-9ef7-d1d360334cc7 service nova] Releasing lock "refresh_cache-d5dbfa63-5061-4304-b8eb-4565ad9f0a96" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:43:33 user nova-compute[73056]: DEBUG nova.compute.manager [req-d77c3bc7-aee5-4d43-ac55-0adf380f255b req-640b7a63-09a0-4f6e-ad99-793f5571ffbd service nova] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Received event network-changed-3bbc228a-d2bb-4b9f-a6d0-66b15010acdb {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:43:33 user nova-compute[73056]: DEBUG nova.compute.manager [req-d77c3bc7-aee5-4d43-ac55-0adf380f255b req-640b7a63-09a0-4f6e-ad99-793f5571ffbd service nova] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Refreshing instance network info cache due to event network-changed-3bbc228a-d2bb-4b9f-a6d0-66b15010acdb. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:43:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-d77c3bc7-aee5-4d43-ac55-0adf380f255b req-640b7a63-09a0-4f6e-ad99-793f5571ffbd service nova] Acquiring lock "refresh_cache-b3270811-8241-47a6-aa36-0ec3feddf0fc" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:43:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-d77c3bc7-aee5-4d43-ac55-0adf380f255b req-640b7a63-09a0-4f6e-ad99-793f5571ffbd service nova] Acquired lock "refresh_cache-b3270811-8241-47a6-aa36-0ec3feddf0fc" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:43:33 user nova-compute[73056]: DEBUG nova.network.neutron [req-d77c3bc7-aee5-4d43-ac55-0adf380f255b req-640b7a63-09a0-4f6e-ad99-793f5571ffbd service nova] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Refreshing network info cache for port 3bbc228a-d2bb-4b9f-a6d0-66b15010acdb {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:43:34 user nova-compute[73056]: DEBUG nova.network.neutron [req-d77c3bc7-aee5-4d43-ac55-0adf380f255b req-640b7a63-09a0-4f6e-ad99-793f5571ffbd service nova] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Updated VIF entry in instance network info cache for port 3bbc228a-d2bb-4b9f-a6d0-66b15010acdb. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:43:34 user nova-compute[73056]: DEBUG nova.network.neutron [req-d77c3bc7-aee5-4d43-ac55-0adf380f255b req-640b7a63-09a0-4f6e-ad99-793f5571ffbd service nova] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Updating instance_info_cache with network_info: [{"id": "3bbc228a-d2bb-4b9f-a6d0-66b15010acdb", "address": "fa:16:3e:59:b3:5d", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bbc228a-d2", "ovs_interfaceid": "3bbc228a-d2bb-4b9f-a6d0-66b15010acdb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:43:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-d77c3bc7-aee5-4d43-ac55-0adf380f255b req-640b7a63-09a0-4f6e-ad99-793f5571ffbd service nova] Releasing lock "refresh_cache-b3270811-8241-47a6-aa36-0ec3feddf0fc" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:43:34 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:34 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:34 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:34 user nova-compute[73056]: DEBUG os_brick.utils [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:43:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.027s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:34 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e96f11-b632-4c61-a58e-409574879da5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:34 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[850c4ca7-f7fb-4842-88cc-9dbbfde23806]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:34 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[93dc03cd-242e-4048-a3e0-73245ba7d712]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:34 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d3a8d3-8faf-43f2-856a-09900552c27f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:43:34 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:43:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:43:34 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:43:34 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d329383-abb8-42ee-b8e2-fa2b54a34e17]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:34 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:43:34 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:43:34 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:43:34 user nova-compute[73056]: DEBUG os_brick.utils [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:43:34 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Updating existing volume attachment record: 5c36dd96-a2b2-4da5-b455-f52fa4404981 {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 16:43:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:35 user nova-compute[73056]: DEBUG nova.compute.manager [req-66b2a2d7-7408-44d6-aa74-e6cfe88ef085 req-3d04c00d-6fd5-43fe-a6e0-65742760391c service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Received event network-vif-plugged-4d2af65d-3317-4411-a99d-13f81c27cc4c {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:43:35 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-66b2a2d7-7408-44d6-aa74-e6cfe88ef085 req-3d04c00d-6fd5-43fe-a6e0-65742760391c service nova] Acquiring lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:35 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-66b2a2d7-7408-44d6-aa74-e6cfe88ef085 req-3d04c00d-6fd5-43fe-a6e0-65742760391c service nova] Lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:35 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-66b2a2d7-7408-44d6-aa74-e6cfe88ef085 req-3d04c00d-6fd5-43fe-a6e0-65742760391c service nova] Lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:35 user nova-compute[73056]: DEBUG nova.compute.manager [req-66b2a2d7-7408-44d6-aa74-e6cfe88ef085 req-3d04c00d-6fd5-43fe-a6e0-65742760391c service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] No waiting events found dispatching network-vif-plugged-4d2af65d-3317-4411-a99d-13f81c27cc4c {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:43:35 user nova-compute[73056]: WARNING nova.compute.manager [req-66b2a2d7-7408-44d6-aa74-e6cfe88ef085 req-3d04c00d-6fd5-43fe-a6e0-65742760391c service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Received unexpected event network-vif-plugged-4d2af65d-3317-4411-a99d-13f81c27cc4c for instance with vm_state building and task_state spawning.
Aug 14 16:43:35 user nova-compute[73056]: DEBUG nova.compute.manager [req-66b2a2d7-7408-44d6-aa74-e6cfe88ef085 req-3d04c00d-6fd5-43fe-a6e0-65742760391c service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Received event network-vif-plugged-4d2af65d-3317-4411-a99d-13f81c27cc4c {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:43:35 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-66b2a2d7-7408-44d6-aa74-e6cfe88ef085 req-3d04c00d-6fd5-43fe-a6e0-65742760391c service nova] Acquiring lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:35 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-66b2a2d7-7408-44d6-aa74-e6cfe88ef085 req-3d04c00d-6fd5-43fe-a6e0-65742760391c service nova] Lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:35 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-66b2a2d7-7408-44d6-aa74-e6cfe88ef085 req-3d04c00d-6fd5-43fe-a6e0-65742760391c service nova] Lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:35 user nova-compute[73056]: DEBUG nova.compute.manager [req-66b2a2d7-7408-44d6-aa74-e6cfe88ef085 req-3d04c00d-6fd5-43fe-a6e0-65742760391c service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] No waiting events found dispatching network-vif-plugged-4d2af65d-3317-4411-a99d-13f81c27cc4c {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:43:35 user nova-compute[73056]: WARNING nova.compute.manager [req-66b2a2d7-7408-44d6-aa74-e6cfe88ef085 req-3d04c00d-6fd5-43fe-a6e0-65742760391c service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Received unexpected event network-vif-plugged-4d2af65d-3317-4411-a99d-13f81c27cc4c for instance with vm_state building and task_state spawning.
Aug 14 16:43:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:36 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031416.9582906, d5dbfa63-5061-4304-b8eb-4565ad9f0a96 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:43:36 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] VM Resumed (Lifecycle Event)
Aug 14 16:43:36 user nova-compute[73056]: DEBUG nova.compute.manager [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:43:36 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:43:36 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Instance spawned successfully.
Aug 14 16:43:36 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:43:36 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:43:37 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:43:37 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:43:37 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:43:37 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:43:37 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:43:37 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:43:37 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:43:37 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:43:37 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031416.965032, d5dbfa63-5061-4304-b8eb-4565ad9f0a96 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:43:37 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] VM Started (Lifecycle Event)
Aug 14 16:43:37 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:43:37 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:43:37 user nova-compute[73056]: INFO nova.compute.manager [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Took 7.25 seconds to spawn the instance on the hypervisor.
Aug 14 16:43:37 user nova-compute[73056]: DEBUG nova.compute.manager [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:43:37 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:43:37 user nova-compute[73056]: INFO nova.compute.manager [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Took 8.19 seconds to build instance.
Aug 14 16:43:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7de9bea6-a904-4388-bb35-1e9688f66a87 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.304s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:37 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:37 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "b3270811-8241-47a6-aa36-0ec3feddf0fc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "b3270811-8241-47a6-aa36-0ec3feddf0fc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:38 user nova-compute[73056]: DEBUG nova.objects.instance [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lazy-loading 'flavor' on Instance uuid b3270811-8241-47a6-aa36-0ec3feddf0fc {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:43:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "b3270811-8241-47a6-aa36-0ec3feddf0fc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "b3270811-8241-47a6-aa36-0ec3feddf0fc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "b3270811-8241-47a6-aa36-0ec3feddf0fc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:39 user nova-compute[73056]: INFO nova.compute.manager [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Attaching volume 8508e582-59c1-4b34-8cb9-6954a3d6c14b to /dev/vdb
Aug 14 16:43:39 user nova-compute[73056]: DEBUG os_brick.utils [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:43:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cb47e2-698d-4916-a886-327205ab6e3b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fff91f-b457-4d3f-a55d-c20418f49e67]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[260d56f0-ec16-422b-b924-4dcfc60d8ab6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc61b52-7027-4427-ae02-588ef5eb96d4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:43:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:43:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:43:39 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:43:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a72535-a6a0-4154-89dd-2178dbc8be9d]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:43:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:43:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:43:39 user nova-compute[73056]: DEBUG os_brick.utils [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:43:39 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Updating existing volume attachment record: f38110d9-8102-4bb5-bb75-1491015c28c5 {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 16:43:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2d896e28-9151-4305-9599-36799c9996f5 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Acquiring lock "18008990-9ed6-46e5-805c-4475e58855a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2d896e28-9151-4305-9599-36799c9996f5 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lock "18008990-9ed6-46e5-805c-4475e58855a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2d896e28-9151-4305-9599-36799c9996f5 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Acquiring lock "18008990-9ed6-46e5-805c-4475e58855a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2d896e28-9151-4305-9599-36799c9996f5 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lock "18008990-9ed6-46e5-805c-4475e58855a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2d896e28-9151-4305-9599-36799c9996f5 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lock "18008990-9ed6-46e5-805c-4475e58855a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:41 user nova-compute[73056]: INFO nova.compute.manager [None req-2d896e28-9151-4305-9599-36799c9996f5 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Terminating instance
Aug 14 16:43:41 user nova-compute[73056]: DEBUG nova.compute.manager [None req-2d896e28-9151-4305-9599-36799c9996f5 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 16:43:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:42 user nova-compute[73056]: DEBUG nova.compute.manager [req-bf4aa2fa-f074-4965-a051-76696296a49d req-05438266-31d0-435b-8f2c-89bb6a01aa0f service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Received event network-vif-unplugged-90cb9090-537a-414e-ac09-1893281186c2 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:43:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-bf4aa2fa-f074-4965-a051-76696296a49d req-05438266-31d0-435b-8f2c-89bb6a01aa0f service nova] Acquiring lock "18008990-9ed6-46e5-805c-4475e58855a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-bf4aa2fa-f074-4965-a051-76696296a49d req-05438266-31d0-435b-8f2c-89bb6a01aa0f service nova] Lock "18008990-9ed6-46e5-805c-4475e58855a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-bf4aa2fa-f074-4965-a051-76696296a49d req-05438266-31d0-435b-8f2c-89bb6a01aa0f service nova] Lock "18008990-9ed6-46e5-805c-4475e58855a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:42 user nova-compute[73056]: DEBUG nova.compute.manager [req-bf4aa2fa-f074-4965-a051-76696296a49d req-05438266-31d0-435b-8f2c-89bb6a01aa0f service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] No waiting events found dispatching network-vif-unplugged-90cb9090-537a-414e-ac09-1893281186c2 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:43:42 user nova-compute[73056]: DEBUG nova.compute.manager [req-bf4aa2fa-f074-4965-a051-76696296a49d req-05438266-31d0-435b-8f2c-89bb6a01aa0f service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Received event network-vif-unplugged-90cb9090-537a-414e-ac09-1893281186c2 for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:43:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:42 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Instance destroyed successfully.
Aug 14 16:43:42 user nova-compute[73056]: DEBUG nova.objects.instance [None req-2d896e28-9151-4305-9599-36799c9996f5 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lazy-loading 'resources' on Instance uuid 18008990-9ed6-46e5-805c-4475e58855a6 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:43:42 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-2d896e28-9151-4305-9599-36799c9996f5 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T16:40:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-208719382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-208719382',id=14,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHcJB5Em/BEdrrn+3nBSCQk8RXjQ9vXtMOi9k99zFp25ODkL4n/iUoo0VukLAcCxol9GBK/BdSObNT2aRPP96ToqXFULMlclvIpuOcZpv+502q1tzSo+JKq19K8Nkl5pQ==',key_name='tempest-keypair-370895944',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:40:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc25a4854a194e9283b568768daea226',ramdisk_id='',reservation_id='r-pde63aya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1768493659',owner_user_name='tempest-TaggedAttachmentsTest-1768493659-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:40:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='333c53f1db334c3aad3b1c7dca862e74',uuid=18008990-9ed6-46e5-805c-4475e58855a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90cb9090-537a-414e-ac09-1893281186c2", "address": "fa:16:3e:f2:46:30", "network": {"id": "d4aa57ea-03bd-491a-9861-e52c142e083c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1629351750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc25a4854a194e9283b568768daea226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90cb9090-53", "ovs_interfaceid": "90cb9090-537a-414e-ac09-1893281186c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:43:42 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-2d896e28-9151-4305-9599-36799c9996f5 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Converting VIF {"id": "90cb9090-537a-414e-ac09-1893281186c2", "address": "fa:16:3e:f2:46:30", "network": {"id": "d4aa57ea-03bd-491a-9861-e52c142e083c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1629351750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc25a4854a194e9283b568768daea226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90cb9090-53", "ovs_interfaceid": "90cb9090-537a-414e-ac09-1893281186c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:43:42 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-2d896e28-9151-4305-9599-36799c9996f5 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:46:30,bridge_name='br-int',has_traffic_filtering=True,id=90cb9090-537a-414e-ac09-1893281186c2,network=Network(d4aa57ea-03bd-491a-9861-e52c142e083c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90cb9090-53') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:43:42 user nova-compute[73056]: DEBUG os_vif [None req-2d896e28-9151-4305-9599-36799c9996f5 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:46:30,bridge_name='br-int',has_traffic_filtering=True,id=90cb9090-537a-414e-ac09-1893281186c2,network=Network(d4aa57ea-03bd-491a-9861-e52c142e083c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90cb9090-53') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:43:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90cb9090-53, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:43:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:43:42 user nova-compute[73056]: INFO os_vif [None req-2d896e28-9151-4305-9599-36799c9996f5 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:46:30,bridge_name='br-int',has_traffic_filtering=True,id=90cb9090-537a-414e-ac09-1893281186c2,network=Network(d4aa57ea-03bd-491a-9861-e52c142e083c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90cb9090-53')
Aug 14 16:43:42 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-2d896e28-9151-4305-9599-36799c9996f5 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Deleting instance files /opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6_del
Aug 14 16:43:42 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-2d896e28-9151-4305-9599-36799c9996f5 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Deletion of /opt/stack/data/nova/instances/18008990-9ed6-46e5-805c-4475e58855a6_del complete
Aug 14 16:43:42 user nova-compute[73056]: INFO nova.compute.manager [None req-2d896e28-9151-4305-9599-36799c9996f5 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Took 1.02 seconds to destroy the instance on the hypervisor.
Aug 14 16:43:42 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-2d896e28-9151-4305-9599-36799c9996f5 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 16:43:42 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 16:43:42 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 16:43:44 user nova-compute[73056]: DEBUG nova.compute.manager [req-3618f604-712e-453f-a0b7-9c3f1075e80a req-00d4af73-83b5-4c70-8bb2-a8100ce8d53d service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Received event network-vif-plugged-90cb9090-537a-414e-ac09-1893281186c2 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:43:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3618f604-712e-453f-a0b7-9c3f1075e80a req-00d4af73-83b5-4c70-8bb2-a8100ce8d53d service nova] Acquiring lock "18008990-9ed6-46e5-805c-4475e58855a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3618f604-712e-453f-a0b7-9c3f1075e80a req-00d4af73-83b5-4c70-8bb2-a8100ce8d53d service nova] Lock "18008990-9ed6-46e5-805c-4475e58855a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3618f604-712e-453f-a0b7-9c3f1075e80a req-00d4af73-83b5-4c70-8bb2-a8100ce8d53d service nova] Lock "18008990-9ed6-46e5-805c-4475e58855a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:44 user nova-compute[73056]: DEBUG nova.compute.manager [req-3618f604-712e-453f-a0b7-9c3f1075e80a req-00d4af73-83b5-4c70-8bb2-a8100ce8d53d service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] No waiting events found dispatching network-vif-plugged-90cb9090-537a-414e-ac09-1893281186c2 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:43:44 user nova-compute[73056]: WARNING nova.compute.manager [req-3618f604-712e-453f-a0b7-9c3f1075e80a req-00d4af73-83b5-4c70-8bb2-a8100ce8d53d service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Received unexpected event network-vif-plugged-90cb9090-537a-414e-ac09-1893281186c2 for instance with vm_state active and task_state deleting.
Aug 14 16:43:44 user nova-compute[73056]: DEBUG nova.compute.manager [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:43:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:43:44 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Creating image(s)
Aug 14 16:43:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Did not create local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 16:43:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Ensure instance console log exists: /opt/stack/data/nova/instances/10b527b0-a7f1-4149-9859-69dac9f481e3/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:43:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Start _get_guest_xml network_info=[{"id": "b97ec96e-9506-4427-b9b1-38f2233a320c", "address": "fa:16:3e:46:16:7c", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97ec96e-95", "ovs_interfaceid": "b97ec96e-9506-4427-b9b1-38f2233a320c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNXdBVTo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '10b527b0-a7f1-4149-9859-69dac9f481e3', 'attached_at': '', 'detached_at': '', 'volume_id': 'a60d4a30-00f7-4874-8488-716b466b4b3a', 'serial': 'a60d4a30-00f7-4874-8488-716b466b4b3a'}, 'attachment_id': '5c36dd96-a2b2-4da5-b455-f52fa4404981', 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:43:44 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:43:44 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:43:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:43:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:43:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:43:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:43:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:43:44 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:43:44 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:43:44 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:43:44 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:43:44 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:43:44 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:43:44 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:43:44 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:43:44 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:43:44 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:43:44 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:43:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:43:44 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNXdBVTo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:43:44 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:43:44 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:43:44 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:43:44 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:43:44 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:43:44 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:43:44 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:43:44 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:43:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:44 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Took 1.99 seconds to deallocate network for instance.
Aug 14 16:43:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:44 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a13d6f5-26c4-4761-bade-011ac1609302]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:44 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:43:44 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:43:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[49254bcb-4130-4a73-8336-b90a339a56f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a] added
Aug 14 16:43:45 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee4e0be-0914-4cb0-9455-d140c63875fa]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2d896e28-9151-4305-9599-36799c9996f5 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2d896e28-9151-4305-9599-36799c9996f5 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd773bf0-5671-4b7c-b102-deb3d54d1ea9]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kNXdBVTo {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kNXdBVTo" returned: 0 in 0.026s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3bdbf57-e03f-49cc-bb63-7cffdec96bf2]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kNXdBVTo'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e5ef13-ff0d-4488-bcb8-d25d97905733]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d646d2-e276-4970-bbab-adddee2deddc]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 (non-flash)
Aug 14 16:43:45 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 (non-flash)
Aug 14 16:43:45 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae67b24-a151-4206-95a0-cfd0049ba75d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a, portal: 172.16.0.220,3260]
Aug 14 16:43:45 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a, portal: 172.16.0.220,3260] successful.
Aug 14 16:43:45 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f63e10-695b-40e3-a54b-6ce5f423c62d]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb6262a-f26c-4d6e-acd3-5a703ae8adf7]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 (non-flash)
Aug 14 16:43:45 user nova-compute[73056]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a (non-flash)
Aug 14 16:43:45 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 (non-flash)
Aug 14 16:43:45 user nova-compute[73056]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a (non-flash)
Aug 14 16:43:45 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.032s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[306d85ca-b152-49b9-8bdd-455c134281a1]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNXdBVTo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-2d896e28-9151-4305-9599-36799c9996f5 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-2d896e28-9151-4305-9599-36799c9996f5 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:43:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2d896e28-9151-4305-9599-36799c9996f5 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.404s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:45 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-2d896e28-9151-4305-9599-36799c9996f5 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Deleted allocations for instance 18008990-9ed6-46e5-805c-4475e58855a6
Aug 14 16:43:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2d896e28-9151-4305-9599-36799c9996f5 tempest-TaggedAttachmentsTest-1768493659 tempest-TaggedAttachmentsTest-1768493659-project-member] Lock "18008990-9ed6-46e5-805c-4475e58855a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.658s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:46 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:43:46 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '23935376561653033', 'path': '/dev/sdb'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:43:46 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935376561653033', 'path': '/dev/sdb'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:43:46 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:43:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1808496566',display_name='tempest-TestVolumeBootPattern-server-1808496566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1808496566',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cffb5203b9284500b8add8a6586cad49',ramdisk_id='',reservation_id='r-u0z9umzg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1676214558',owner_user_name='tempest-TestVolumeBootPattern-1676214558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:43:29Z,user_data=None,user_id='2be1b098ca9f4232bd198b515630f6ad',uuid=10b527b0-a7f1-4149-9859-69dac9f481e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b97ec96e-9506-4427-b9b1-38f2233a320c", "address": "fa:16:3e:46:16:7c", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97ec96e-95", "ovs_interfaceid": "b97ec96e-9506-4427-b9b1-38f2233a320c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:43:46 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Converting VIF {"id": "b97ec96e-9506-4427-b9b1-38f2233a320c", "address": "fa:16:3e:46:16:7c", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97ec96e-95", "ovs_interfaceid": "b97ec96e-9506-4427-b9b1-38f2233a320c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:43:46 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:16:7c,bridge_name='br-int',has_traffic_filtering=True,id=b97ec96e-9506-4427-b9b1-38f2233a320c,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb97ec96e-95') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:43:46 user nova-compute[73056]: DEBUG nova.objects.instance [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lazy-loading 'pci_devices' on Instance uuid 10b527b0-a7f1-4149-9859-69dac9f481e3 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:43:46 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:43:46 user nova-compute[73056]:   <uuid>10b527b0-a7f1-4149-9859-69dac9f481e3</uuid>
Aug 14 16:43:46 user nova-compute[73056]:   <name>instance-00000014</name>
Aug 14 16:43:46 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:43:46 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:43:46 user nova-compute[73056]:   <metadata>
Aug 14 16:43:46 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:43:46 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:43:46 user nova-compute[73056]:       <nova:name>tempest-TestVolumeBootPattern-server-1808496566</nova:name>
Aug 14 16:43:46 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:43:44</nova:creationTime>
Aug 14 16:43:46 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:43:46 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:43:46 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:43:46 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:43:46 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:43:46 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:43:46 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:43:46 user nova-compute[73056]:       <nova:owner>
Aug 14 16:43:46 user nova-compute[73056]:         <nova:user uuid="2be1b098ca9f4232bd198b515630f6ad">tempest-TestVolumeBootPattern-1676214558-project-member</nova:user>
Aug 14 16:43:46 user nova-compute[73056]:         <nova:project uuid="cffb5203b9284500b8add8a6586cad49">tempest-TestVolumeBootPattern-1676214558</nova:project>
Aug 14 16:43:46 user nova-compute[73056]:       </nova:owner>
Aug 14 16:43:46 user nova-compute[73056]:       <nova:ports>
Aug 14 16:43:46 user nova-compute[73056]:         <nova:port uuid="b97ec96e-9506-4427-b9b1-38f2233a320c">
Aug 14 16:43:46 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 16:43:46 user nova-compute[73056]:         </nova:port>
Aug 14 16:43:46 user nova-compute[73056]:       </nova:ports>
Aug 14 16:43:46 user nova-compute[73056]:     </nova:instance>
Aug 14 16:43:46 user nova-compute[73056]:   </metadata>
Aug 14 16:43:46 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:43:46 user nova-compute[73056]:     <system>
Aug 14 16:43:46 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:43:46 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:43:46 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:43:46 user nova-compute[73056]:       <entry name="serial">10b527b0-a7f1-4149-9859-69dac9f481e3</entry>
Aug 14 16:43:46 user nova-compute[73056]:       <entry name="uuid">10b527b0-a7f1-4149-9859-69dac9f481e3</entry>
Aug 14 16:43:46 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:43:46 user nova-compute[73056]:     </system>
Aug 14 16:43:46 user nova-compute[73056]:   </sysinfo>
Aug 14 16:43:46 user nova-compute[73056]:   <os>
Aug 14 16:43:46 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:43:46 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:43:46 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:43:46 user nova-compute[73056]:   </os>
Aug 14 16:43:46 user nova-compute[73056]:   <features>
Aug 14 16:43:46 user nova-compute[73056]:     <acpi/>
Aug 14 16:43:46 user nova-compute[73056]:     <apic/>
Aug 14 16:43:46 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:43:46 user nova-compute[73056]:   </features>
Aug 14 16:43:46 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:43:46 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:43:46 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:43:46 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:43:46 user nova-compute[73056]:   </clock>
Aug 14 16:43:46 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:43:46 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:43:46 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:43:46 user nova-compute[73056]:   </cpu>
Aug 14 16:43:46 user nova-compute[73056]:   <devices>
Aug 14 16:43:46 user nova-compute[73056]:     <disk type="block" device="disk">
Aug 14 16:43:46 user nova-compute[73056]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:43:46 user nova-compute[73056]:       <source dev="/dev/sdb"/>
Aug 14 16:43:46 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:43:46 user nova-compute[73056]:       <serial>a60d4a30-00f7-4874-8488-716b466b4b3a</serial>
Aug 14 16:43:46 user nova-compute[73056]:     </disk>
Aug 14 16:43:46 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:43:46 user nova-compute[73056]:       <mac address="fa:16:3e:46:16:7c"/>
Aug 14 16:43:46 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:43:46 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:43:46 user nova-compute[73056]:       <target dev="tapb97ec96e-95"/>
Aug 14 16:43:46 user nova-compute[73056]:     </interface>
Aug 14 16:43:46 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:43:46 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/10b527b0-a7f1-4149-9859-69dac9f481e3/console.log" append="off"/>
Aug 14 16:43:46 user nova-compute[73056]:     </serial>
Aug 14 16:43:46 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:43:46 user nova-compute[73056]:     <video>
Aug 14 16:43:46 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:43:46 user nova-compute[73056]:     </video>
Aug 14 16:43:46 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:43:46 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:43:46 user nova-compute[73056]:     </rng>
Aug 14 16:43:46 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:43:46 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:43:46 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:43:46 user nova-compute[73056]:     </memballoon>
Aug 14 16:43:46 user nova-compute[73056]:   </devices>
Aug 14 16:43:46 user nova-compute[73056]: </domain>
Aug 14 16:43:46 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:43:46 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:43:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1808496566',display_name='tempest-TestVolumeBootPattern-server-1808496566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1808496566',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cffb5203b9284500b8add8a6586cad49',ramdisk_id='',reservation_id='r-u0z9umzg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1676214558',owner_user_name='tempest-TestVolumeBootPattern-1676214558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:43:29Z,user_data=None,user_id='2be1b098ca9f4232bd198b515630f6ad',uuid=10b527b0-a7f1-4149-9859-69dac9f481e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b97ec96e-9506-4427-b9b1-38f2233a320c", "address": "fa:16:3e:46:16:7c", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97ec96e-95", "ovs_interfaceid": "b97ec96e-9506-4427-b9b1-38f2233a320c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:43:46 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Converting VIF {"id": "b97ec96e-9506-4427-b9b1-38f2233a320c", "address": "fa:16:3e:46:16:7c", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97ec96e-95", "ovs_interfaceid": "b97ec96e-9506-4427-b9b1-38f2233a320c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:43:46 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:16:7c,bridge_name='br-int',has_traffic_filtering=True,id=b97ec96e-9506-4427-b9b1-38f2233a320c,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb97ec96e-95') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:43:46 user nova-compute[73056]: DEBUG os_vif [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:16:7c,bridge_name='br-int',has_traffic_filtering=True,id=b97ec96e-9506-4427-b9b1-38f2233a320c,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb97ec96e-95') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:43:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:43:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:43:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb97ec96e-95, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:43:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb97ec96e-95, col_values=(('external_ids', {'iface-id': 'b97ec96e-9506-4427-b9b1-38f2233a320c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:16:7c', 'vm-uuid': '10b527b0-a7f1-4149-9859-69dac9f481e3'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:43:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:43:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:46 user nova-compute[73056]: INFO os_vif [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:16:7c,bridge_name='br-int',has_traffic_filtering=True,id=b97ec96e-9506-4427-b9b1-38f2233a320c,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb97ec96e-95')
Aug 14 16:43:46 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:43:46 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] No VIF found with MAC fa:16:3e:46:16:7c, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:43:46 user nova-compute[73056]: DEBUG nova.compute.manager [req-7393d087-82de-4f20-ab6c-2ee8ace888aa req-590d1cd5-59b7-4be8-9c37-bbb47ca86153 service nova] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Received event network-vif-deleted-90cb9090-537a-414e-ac09-1893281186c2 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:43:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:48 user nova-compute[73056]: DEBUG nova.compute.manager [req-f94adfea-99e8-4686-b166-b884508245a4 req-fa906e2c-7ad6-4b93-8f3f-ca3ae958a982 service nova] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Received event network-vif-plugged-b97ec96e-9506-4427-b9b1-38f2233a320c {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:43:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f94adfea-99e8-4686-b166-b884508245a4 req-fa906e2c-7ad6-4b93-8f3f-ca3ae958a982 service nova] Acquiring lock "10b527b0-a7f1-4149-9859-69dac9f481e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f94adfea-99e8-4686-b166-b884508245a4 req-fa906e2c-7ad6-4b93-8f3f-ca3ae958a982 service nova] Lock "10b527b0-a7f1-4149-9859-69dac9f481e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f94adfea-99e8-4686-b166-b884508245a4 req-fa906e2c-7ad6-4b93-8f3f-ca3ae958a982 service nova] Lock "10b527b0-a7f1-4149-9859-69dac9f481e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:48 user nova-compute[73056]: DEBUG nova.compute.manager [req-f94adfea-99e8-4686-b166-b884508245a4 req-fa906e2c-7ad6-4b93-8f3f-ca3ae958a982 service nova] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] No waiting events found dispatching network-vif-plugged-b97ec96e-9506-4427-b9b1-38f2233a320c {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:43:48 user nova-compute[73056]: WARNING nova.compute.manager [req-f94adfea-99e8-4686-b166-b884508245a4 req-fa906e2c-7ad6-4b93-8f3f-ca3ae958a982 service nova] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Received unexpected event network-vif-plugged-b97ec96e-9506-4427-b9b1-38f2233a320c for instance with vm_state building and task_state spawning.
Aug 14 16:43:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:43:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmCWShAp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:43:48 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:43:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:43:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:43:48 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:43:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:43:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:43:48 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:43:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:48 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7c8cd4-2217-4b68-92b1-47795bd8435a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:43:48 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:43:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:48 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7a18d5-3057-426c-a86e-e190a96f73a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b] added
Aug 14 16:43:48 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:43:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:48 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b13dc3f-15b6-4909-bc0d-764085363602]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:43:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:48 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a25566-0ea7-497b-a5d4-f84f4ef2a778]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:43:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HmCWShAp {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HmCWShAp" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:48 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99421bd-7276-4483-b338-81f66e004b99]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HmCWShAp'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:43:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:48 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb010d6-90b8-4f10-a274-77c437b9b359]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:43:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:49 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dade241-813f-47e6-b307-ec3b1bea7df7]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 (non-flash)
Aug 14 16:43:49 user nova-compute[73056]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a (non-flash)
Aug 14 16:43:49 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:43:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 (non-flash)
Aug 14 16:43:49 user nova-compute[73056]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a (non-flash)
Aug 14 16:43:49 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:43:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:49 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[15990ba5-af4b-485f-9ffa-79a7a5408946]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b, portal: 172.16.0.220,3260]
Aug 14 16:43:49 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b, portal: 172.16.0.220,3260] successful.
Aug 14 16:43:49 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:43:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:49 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5237180e-c48b-4784-a2ad-680ddcac5fe2]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:43:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:49 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bc9e9a-5040-4e46-8eca-6504f6281e5c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 (non-flash)
Aug 14 16:43:49 user nova-compute[73056]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a (non-flash)
Aug 14 16:43:49 user nova-compute[73056]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)
Aug 14 16:43:49 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:43:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 (non-flash)
Aug 14 16:43:49 user nova-compute[73056]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a (non-flash)
Aug 14 16:43:49 user nova-compute[73056]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)
Aug 14 16:43:49 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:43:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:43:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:43:49 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:43:49 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:43:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:49 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d889197c-330a-4041-b13a-be526de2f785]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:49 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:43:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmCWShAp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:43:50 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:43:50 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '23034613230626662', 'path': '/dev/sdd'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:43:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034613230626662', 'path': '/dev/sdd'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:43:50 user nova-compute[73056]: DEBUG nova.objects.instance [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lazy-loading 'flavor' on Instance uuid b3270811-8241-47a6-aa36-0ec3feddf0fc {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:43:50 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031430.2105622, 10b527b0-a7f1-4149-9859-69dac9f481e3 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:43:50 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] VM Resumed (Lifecycle Event)
Aug 14 16:43:50 user nova-compute[73056]: DEBUG nova.compute.manager [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:43:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:43:50 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Instance spawned successfully.
Aug 14 16:43:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:43:50 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:43:50 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:43:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 16:43:50 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:43:50 user nova-compute[73056]:   <source dev="/dev/sdd"/>
Aug 14 16:43:50 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:43:50 user nova-compute[73056]:   <serial>8508e582-59c1-4b34-8cb9-6954a3d6c14b</serial>
Aug 14 16:43:50 user nova-compute[73056]: </disk>
Aug 14 16:43:50 user nova-compute[73056]:  {{(pid=73056) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 16:43:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:43:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:43:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:43:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:43:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:43:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:43:50 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:43:50 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031430.2157629, 10b527b0-a7f1-4149-9859-69dac9f481e3 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:43:50 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] VM Started (Lifecycle Event)
Aug 14 16:43:50 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:43:50 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:43:50 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:43:50 user nova-compute[73056]: INFO nova.compute.manager [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Took 5.50 seconds to spawn the instance on the hypervisor.
Aug 14 16:43:50 user nova-compute[73056]: DEBUG nova.compute.manager [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:43:50 user nova-compute[73056]: DEBUG nova.compute.manager [req-3d690dde-bdc5-48e1-99e4-d5ac6e9e573c req-46358090-6ab2-466f-859e-b53ca63c228e service nova] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Received event network-vif-plugged-b97ec96e-9506-4427-b9b1-38f2233a320c {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:43:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3d690dde-bdc5-48e1-99e4-d5ac6e9e573c req-46358090-6ab2-466f-859e-b53ca63c228e service nova] Acquiring lock "10b527b0-a7f1-4149-9859-69dac9f481e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3d690dde-bdc5-48e1-99e4-d5ac6e9e573c req-46358090-6ab2-466f-859e-b53ca63c228e service nova] Lock "10b527b0-a7f1-4149-9859-69dac9f481e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3d690dde-bdc5-48e1-99e4-d5ac6e9e573c req-46358090-6ab2-466f-859e-b53ca63c228e service nova] Lock "10b527b0-a7f1-4149-9859-69dac9f481e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:50 user nova-compute[73056]: DEBUG nova.compute.manager [req-3d690dde-bdc5-48e1-99e4-d5ac6e9e573c req-46358090-6ab2-466f-859e-b53ca63c228e service nova] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] No waiting events found dispatching network-vif-plugged-b97ec96e-9506-4427-b9b1-38f2233a320c {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:43:50 user nova-compute[73056]: WARNING nova.compute.manager [req-3d690dde-bdc5-48e1-99e4-d5ac6e9e573c req-46358090-6ab2-466f-859e-b53ca63c228e service nova] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Received unexpected event network-vif-plugged-b97ec96e-9506-4427-b9b1-38f2233a320c for instance with vm_state building and task_state spawning.
Aug 14 16:43:50 user nova-compute[73056]: INFO nova.compute.manager [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Took 22.33 seconds to build instance.
Aug 14 16:43:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9f1abb1d-5965-453c-8fa1-aff2dc435307 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "10b527b0-a7f1-4149-9859-69dac9f481e3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.427s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:43:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:43:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] No VIF found with MAC fa:16:3e:59:b3:5d, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:43:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-300fea1c-162e-428a-8195-bc3af91931c4 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "b3270811-8241-47a6-aa36-0ec3feddf0fc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.961s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:51 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:43:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:52 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:43:52 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:43:52 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 16:43:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "b580e3d0-88b5-42a3-a953-84b94c088f41" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "b580e3d0-88b5-42a3-a953-84b94c088f41" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:52 user nova-compute[73056]: DEBUG nova.compute.manager [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:43:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:52 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:43:52 user nova-compute[73056]: INFO nova.compute.claims [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Claim successful on node user
Aug 14 16:43:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:53 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:43:53 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:43:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:53 user nova-compute[73056]: DEBUG nova.compute.manager [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:43:53 user nova-compute[73056]: DEBUG nova.compute.manager [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:43:53 user nova-compute[73056]: DEBUG nova.network.neutron [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:43:53 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:43:53 user nova-compute[73056]: DEBUG nova.compute.manager [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:43:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:53 user nova-compute[73056]: DEBUG nova.compute.manager [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:43:53 user nova-compute[73056]: DEBUG nova.policy [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e9f89462f2734ec48d78921ab3d654b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b7b0f153a945ac9ce96fe462b17fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:43:53 user nova-compute[73056]: DEBUG nova.compute.manager [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:43:53 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:43:53 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Creating image(s)
Aug 14 16:43:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "/opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "/opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "/opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:53 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:43:53 user nova-compute[73056]: INFO nova.compute.claims [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Claim successful on node user
Aug 14 16:43:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.189s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "c889592ab94cd0b0ce896f27a2af0323771db234" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.191s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk 1073741824" returned: 0 in 0.056s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "e07cfc63-1ce9-466b-aa01-d967be383f45" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "e07cfc63-1ce9-466b-aa01-d967be383f45" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG nova.compute.manager [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.235s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG nova.network.neutron [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Successfully created port: b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.854s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG nova.compute.manager [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.105s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:43:54 user nova-compute[73056]: INFO nova.compute.claims [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Claim successful on node user
Aug 14 16:43:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Cannot resize image /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG nova.objects.instance [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lazy-loading 'migration_context' on Instance uuid b580e3d0-88b5-42a3-a953-84b94c088f41 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Ensure instance console log exists: /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG nova.compute.manager [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG nova.network.neutron [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:43:54 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:43:54 user nova-compute[73056]: DEBUG nova.compute.manager [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG nova.policy [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e9f89462f2734ec48d78921ab3d654b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b7b0f153a945ac9ce96fe462b17fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG nova.compute.manager [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:43:54 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Creating image(s)
Aug 14 16:43:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "/opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "/opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "/opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.212s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "c889592ab94cd0b0ce896f27a2af0323771db234" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.657s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG nova.compute.manager [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.210s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.compute.manager [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.network.neutron [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk 1073741824" returned: 0 in 0.080s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:55 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:43:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.compute.manager [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.network.neutron [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Successfully created port: 2a57f016-2b33-46f4-a885-51c4ac8658bb {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.policy [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3dad45adee1047bda7350d8a3f8a2f54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d5a8e599b3141339ed0ae6729031b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.network.neutron [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Successfully updated port: b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "refresh_cache-b580e3d0-88b5-42a3-a953-84b94c088f41" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquired lock "refresh_cache-b580e3d0-88b5-42a3-a953-84b94c088f41" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.network.neutron [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.compute.manager [req-c233855d-d820-4c92-9362-26a1a81c2d46 req-77eba2aa-01d3-41a4-b221-5e4eaabae626 service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Received event network-changed-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.compute.manager [req-c233855d-d820-4c92-9362-26a1a81c2d46 req-77eba2aa-01d3-41a4-b221-5e4eaabae626 service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Refreshing instance network info cache due to event network-changed-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c233855d-d820-4c92-9362-26a1a81c2d46 req-77eba2aa-01d3-41a4-b221-5e4eaabae626 service nova] Acquiring lock "refresh_cache-b580e3d0-88b5-42a3-a953-84b94c088f41" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.215s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Checking if we can resize image /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.network.neutron [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.compute.manager [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:43:55 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Creating image(s)
Aug 14 16:43:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "/opt/stack/data/nova/instances/e07cfc63-1ce9-466b-aa01-d967be383f45/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "/opt/stack/data/nova/instances/e07cfc63-1ce9-466b-aa01-d967be383f45/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "/opt/stack/data/nova/instances/e07cfc63-1ce9-466b-aa01-d967be383f45/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Cannot resize image /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.objects.instance [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lazy-loading 'migration_context' on Instance uuid 92c34cf0-fd39-49fc-9244-4da8ccae6eec {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Ensure instance console log exists: /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.198s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "c889592ab94cd0b0ce896f27a2af0323771db234" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.network.neutron [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Updating instance_info_cache with network_info: [{"id": "b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0", "address": "fa:16:3e:f9:ca:00", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb006576a-8b", "ovs_interfaceid": "b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Releasing lock "refresh_cache-b580e3d0-88b5-42a3-a953-84b94c088f41" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.compute.manager [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Instance network_info: |[{"id": "b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0", "address": "fa:16:3e:f9:ca:00", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb006576a-8b", "ovs_interfaceid": "b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c233855d-d820-4c92-9362-26a1a81c2d46 req-77eba2aa-01d3-41a4-b221-5e4eaabae626 service nova] Acquired lock "refresh_cache-b580e3d0-88b5-42a3-a953-84b94c088f41" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.network.neutron [req-c233855d-d820-4c92-9362-26a1a81c2d46 req-77eba2aa-01d3-41a4-b221-5e4eaabae626 service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Refreshing network info cache for port b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Start _get_guest_xml network_info=[{"id": "b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0", "address": "fa:16:3e:f9:ca:00", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb006576a-8b", "ovs_interfaceid": "b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:43:55 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:43:55 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:43:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1690624150',display_name='tempest-ServerRescueNegativeTestJSON-server-1690624150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1690624150',id=22,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09b7b0f153a945ac9ce96fe462b17fd5',ramdisk_id='',reservation_id='r-s8wct4sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-201205905',owner_user_name='tempest-ServerRescueNegativeTestJSON-201205905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:43:53Z,user_data=None,user_id='e9f89462f2734ec48d78921ab3d654b2',uuid=b580e3d0-88b5-42a3-a953-84b94c088f41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0", "address": "fa:16:3e:f9:ca:00", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb006576a-8b", "ovs_interfaceid": "b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Converting VIF {"id": "b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0", "address": "fa:16:3e:f9:ca:00", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb006576a-8b", "ovs_interfaceid": "b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ca:00,bridge_name='br-int',has_traffic_filtering=True,id=b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0,network=Network(9f4305e9-4b75-4f5d-b1b2-f1184c408739),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb006576a-8b') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.objects.instance [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lazy-loading 'pci_devices' on Instance uuid b580e3d0-88b5-42a3-a953-84b94c088f41 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.272s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/e07cfc63-1ce9-466b-aa01-d967be383f45/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-4731f355-9307-4176-910b-cf35beb85e75" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-4731f355-9307-4176-910b-cf35beb85e75" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:43:55 user nova-compute[73056]:   <uuid>b580e3d0-88b5-42a3-a953-84b94c088f41</uuid>
Aug 14 16:43:55 user nova-compute[73056]:   <name>instance-00000016</name>
Aug 14 16:43:55 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:43:55 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:43:55 user nova-compute[73056]:   <metadata>
Aug 14 16:43:55 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:43:55 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:43:55 user nova-compute[73056]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1690624150</nova:name>
Aug 14 16:43:55 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:43:55</nova:creationTime>
Aug 14 16:43:55 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:43:55 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:43:55 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:43:55 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:43:55 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:43:55 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:43:55 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:43:55 user nova-compute[73056]:       <nova:owner>
Aug 14 16:43:55 user nova-compute[73056]:         <nova:user uuid="e9f89462f2734ec48d78921ab3d654b2">tempest-ServerRescueNegativeTestJSON-201205905-project-member</nova:user>
Aug 14 16:43:55 user nova-compute[73056]:         <nova:project uuid="09b7b0f153a945ac9ce96fe462b17fd5">tempest-ServerRescueNegativeTestJSON-201205905</nova:project>
Aug 14 16:43:55 user nova-compute[73056]:       </nova:owner>
Aug 14 16:43:55 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:43:55 user nova-compute[73056]:       <nova:ports>
Aug 14 16:43:55 user nova-compute[73056]:         <nova:port uuid="b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0">
Aug 14 16:43:55 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 14 16:43:55 user nova-compute[73056]:         </nova:port>
Aug 14 16:43:55 user nova-compute[73056]:       </nova:ports>
Aug 14 16:43:55 user nova-compute[73056]:     </nova:instance>
Aug 14 16:43:55 user nova-compute[73056]:   </metadata>
Aug 14 16:43:55 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:43:55 user nova-compute[73056]:     <system>
Aug 14 16:43:55 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:43:55 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:43:55 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:43:55 user nova-compute[73056]:       <entry name="serial">b580e3d0-88b5-42a3-a953-84b94c088f41</entry>
Aug 14 16:43:55 user nova-compute[73056]:       <entry name="uuid">b580e3d0-88b5-42a3-a953-84b94c088f41</entry>
Aug 14 16:43:55 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:43:55 user nova-compute[73056]:     </system>
Aug 14 16:43:55 user nova-compute[73056]:   </sysinfo>
Aug 14 16:43:55 user nova-compute[73056]:   <os>
Aug 14 16:43:55 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:43:55 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:43:55 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:43:55 user nova-compute[73056]:   </os>
Aug 14 16:43:55 user nova-compute[73056]:   <features>
Aug 14 16:43:55 user nova-compute[73056]:     <acpi/>
Aug 14 16:43:55 user nova-compute[73056]:     <apic/>
Aug 14 16:43:55 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:43:55 user nova-compute[73056]:   </features>
Aug 14 16:43:55 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:43:55 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:43:55 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:43:55 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:43:55 user nova-compute[73056]:   </clock>
Aug 14 16:43:55 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:43:55 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:43:55 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:43:55 user nova-compute[73056]:   </cpu>
Aug 14 16:43:55 user nova-compute[73056]:   <devices>
Aug 14 16:43:55 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:43:55 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:43:55 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk"/>
Aug 14 16:43:55 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:43:55 user nova-compute[73056]:     </disk>
Aug 14 16:43:55 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:43:55 user nova-compute[73056]:       <mac address="fa:16:3e:f9:ca:00"/>
Aug 14 16:43:55 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:43:55 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:43:55 user nova-compute[73056]:       <target dev="tapb006576a-8b"/>
Aug 14 16:43:55 user nova-compute[73056]:     </interface>
Aug 14 16:43:55 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:43:55 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/console.log" append="off"/>
Aug 14 16:43:55 user nova-compute[73056]:     </serial>
Aug 14 16:43:55 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:43:55 user nova-compute[73056]:     <video>
Aug 14 16:43:55 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:43:55 user nova-compute[73056]:     </video>
Aug 14 16:43:55 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:43:55 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:43:55 user nova-compute[73056]:     </rng>
Aug 14 16:43:55 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:43:55 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:43:55 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:43:55 user nova-compute[73056]:     </memballoon>
Aug 14 16:43:55 user nova-compute[73056]:   </devices>
Aug 14 16:43:55 user nova-compute[73056]: </domain>
Aug 14 16:43:55 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:43:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1690624150',display_name='tempest-ServerRescueNegativeTestJSON-server-1690624150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1690624150',id=22,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09b7b0f153a945ac9ce96fe462b17fd5',ramdisk_id='',reservation_id='r-s8wct4sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-201205905',owner_user_name='tempest-ServerRescueNegativeTestJSON-201205905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:43:53Z,user_data=None,user_id='e9f89462f2734ec48d78921ab3d654b2',uuid=b580e3d0-88b5-42a3-a953-84b94c088f41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0", "address": "fa:16:3e:f9:ca:00", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb006576a-8b", "ovs_interfaceid": "b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Converting VIF {"id": "b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0", "address": "fa:16:3e:f9:ca:00", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb006576a-8b", "ovs_interfaceid": "b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ca:00,bridge_name='br-int',has_traffic_filtering=True,id=b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0,network=Network(9f4305e9-4b75-4f5d-b1b2-f1184c408739),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb006576a-8b') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG os_vif [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ca:00,bridge_name='br-int',has_traffic_filtering=True,id=b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0,network=Network(9f4305e9-4b75-4f5d-b1b2-f1184c408739),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb006576a-8b') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/e07cfc63-1ce9-466b-aa01-d967be383f45/disk 1073741824" returned: 0 in 0.091s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.368s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:56 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:56 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb006576a-8b, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:43:56 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb006576a-8b, col_values=(('external_ids', {'iface-id': 'b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:ca:00', 'vm-uuid': 'b580e3d0-88b5-42a3-a953-84b94c088f41'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:43:56 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:43:56 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:56 user nova-compute[73056]: INFO os_vif [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ca:00,bridge_name='br-int',has_traffic_filtering=True,id=b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0,network=Network(9f4305e9-4b75-4f5d-b1b2-f1184c408739),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb006576a-8b')
Aug 14 16:43:56 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:43:56 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] No VIF found with MAC fa:16:3e:f9:ca:00, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:43:56 user nova-compute[73056]: DEBUG nova.network.neutron [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Successfully created port: 82102e20-784e-4435-9c32-381ae24600f4 {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:43:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.204s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:56 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e07cfc63-1ce9-466b-aa01-d967be383f45/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 16:43:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07cfc63-1ce9-466b-aa01-d967be383f45/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07cfc63-1ce9-466b-aa01-d967be383f45/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:56 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Cannot resize image /opt/stack/data/nova/instances/e07cfc63-1ce9-466b-aa01-d967be383f45/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 16:43:56 user nova-compute[73056]: DEBUG nova.objects.instance [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lazy-loading 'migration_context' on Instance uuid e07cfc63-1ce9-466b-aa01-d967be383f45 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:43:56 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 16:43:56 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Ensure instance console log exists: /opt/stack/data/nova/instances/e07cfc63-1ce9-466b-aa01-d967be383f45/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:43:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:56 user nova-compute[73056]: DEBUG nova.network.neutron [req-c233855d-d820-4c92-9362-26a1a81c2d46 req-77eba2aa-01d3-41a4-b221-5e4eaabae626 service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Updated VIF entry in instance network info cache for port b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:43:56 user nova-compute[73056]: DEBUG nova.network.neutron [req-c233855d-d820-4c92-9362-26a1a81c2d46 req-77eba2aa-01d3-41a4-b221-5e4eaabae626 service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Updating instance_info_cache with network_info: [{"id": "b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0", "address": "fa:16:3e:f9:ca:00", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb006576a-8b", "ovs_interfaceid": "b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:43:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c233855d-d820-4c92-9362-26a1a81c2d46 req-77eba2aa-01d3-41a4-b221-5e4eaabae626 service nova] Releasing lock "refresh_cache-b580e3d0-88b5-42a3-a953-84b94c088f41" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:43:56 user nova-compute[73056]: DEBUG nova.network.neutron [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Successfully updated port: 2a57f016-2b33-46f4-a885-51c4ac8658bb {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:43:56 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Updating instance_info_cache with network_info: [{"id": "83386dcc-c4f0-49aa-8bd0-43fd3b202c46", "address": "fa:16:3e:2d:f9:8e", "network": {"id": "cf5d30f2-97c6-4785-83d2-549eeb6eca88", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1151628801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd5d50a2601044b5aef50a0d0c6e311a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83386dcc-c4", "ovs_interfaceid": "83386dcc-c4f0-49aa-8bd0-43fd3b202c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:43:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "refresh_cache-92c34cf0-fd39-49fc-9244-4da8ccae6eec" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:43:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquired lock "refresh_cache-92c34cf0-fd39-49fc-9244-4da8ccae6eec" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:43:56 user nova-compute[73056]: DEBUG nova.network.neutron [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:43:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-4731f355-9307-4176-910b-cf35beb85e75" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:43:56 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 16:43:56 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:43:56 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:43:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:56 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 16:43:56 user nova-compute[73056]: DEBUG nova.compute.manager [req-0e2b2e83-c311-49b4-8e85-42b64f24e623 req-d6df0fc3-db69-492e-9274-78c6c129b4b1 service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Received event network-changed-2a57f016-2b33-46f4-a885-51c4ac8658bb {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:43:56 user nova-compute[73056]: DEBUG nova.compute.manager [req-0e2b2e83-c311-49b4-8e85-42b64f24e623 req-d6df0fc3-db69-492e-9274-78c6c129b4b1 service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Refreshing instance network info cache due to event network-changed-2a57f016-2b33-46f4-a885-51c4ac8658bb. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:43:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0e2b2e83-c311-49b4-8e85-42b64f24e623 req-d6df0fc3-db69-492e-9274-78c6c129b4b1 service nova] Acquiring lock "refresh_cache-92c34cf0-fd39-49fc-9244-4da8ccae6eec" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:43:56 user nova-compute[73056]: DEBUG nova.network.neutron [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.network.neutron [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Successfully updated port: 82102e20-784e-4435-9c32-381ae24600f4 {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "refresh_cache-e07cfc63-1ce9-466b-aa01-d967be383f45" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquired lock "refresh_cache-e07cfc63-1ce9-466b-aa01-d967be383f45" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.network.neutron [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.compute.manager [req-f0c9e1f6-a9ff-462d-9929-29701b3c8c75 req-e5aabacd-f252-4e70-a0e0-c640e5d6fb30 service nova] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Received event network-changed-82102e20-784e-4435-9c32-381ae24600f4 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.compute.manager [req-f0c9e1f6-a9ff-462d-9929-29701b3c8c75 req-e5aabacd-f252-4e70-a0e0-c640e5d6fb30 service nova] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Refreshing instance network info cache due to event network-changed-82102e20-784e-4435-9c32-381ae24600f4. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f0c9e1f6-a9ff-462d-9929-29701b3c8c75 req-e5aabacd-f252-4e70-a0e0-c640e5d6fb30 service nova] Acquiring lock "refresh_cache-e07cfc63-1ce9-466b-aa01-d967be383f45" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.network.neutron [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Updating instance_info_cache with network_info: [{"id": "2a57f016-2b33-46f4-a885-51c4ac8658bb", "address": "fa:16:3e:11:b2:3a", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a57f016-2b", "ovs_interfaceid": "2a57f016-2b33-46f4-a885-51c4ac8658bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Releasing lock "refresh_cache-92c34cf0-fd39-49fc-9244-4da8ccae6eec" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.compute.manager [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Instance network_info: |[{"id": "2a57f016-2b33-46f4-a885-51c4ac8658bb", "address": "fa:16:3e:11:b2:3a", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a57f016-2b", "ovs_interfaceid": "2a57f016-2b33-46f4-a885-51c4ac8658bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0e2b2e83-c311-49b4-8e85-42b64f24e623 req-d6df0fc3-db69-492e-9274-78c6c129b4b1 service nova] Acquired lock "refresh_cache-92c34cf0-fd39-49fc-9244-4da8ccae6eec" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.network.neutron [req-0e2b2e83-c311-49b4-8e85-42b64f24e623 req-d6df0fc3-db69-492e-9274-78c6c129b4b1 service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Refreshing network info cache for port 2a57f016-2b33-46f4-a885-51c4ac8658bb {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Start _get_guest_xml network_info=[{"id": "2a57f016-2b33-46f4-a885-51c4ac8658bb", "address": "fa:16:3e:11:b2:3a", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a57f016-2b", "ovs_interfaceid": "2a57f016-2b33-46f4-a885-51c4ac8658bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:43:57 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:43:57 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.network.neutron [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:43:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1644142487',display_name='tempest-ServerRescueNegativeTestJSON-server-1644142487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1644142487',id=23,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09b7b0f153a945ac9ce96fe462b17fd5',ramdisk_id='',reservation_id='r-sdr5vmlk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-201205905',owner_user_name='tempest-ServerRescueNegativeTestJSON-201205905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:43:54Z,user_data=None,user_id='e9f89462f2734ec48d78921ab3d654b2',uuid=92c34cf0-fd39-49fc-9244-4da8ccae6eec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a57f016-2b33-46f4-a885-51c4ac8658bb", "address": "fa:16:3e:11:b2:3a", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a57f016-2b", "ovs_interfaceid": "2a57f016-2b33-46f4-a885-51c4ac8658bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Converting VIF {"id": "2a57f016-2b33-46f4-a885-51c4ac8658bb", "address": "fa:16:3e:11:b2:3a", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a57f016-2b", "ovs_interfaceid": "2a57f016-2b33-46f4-a885-51c4ac8658bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:b2:3a,bridge_name='br-int',has_traffic_filtering=True,id=2a57f016-2b33-46f4-a885-51c4ac8658bb,network=Network(9f4305e9-4b75-4f5d-b1b2-f1184c408739),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a57f016-2b') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.objects.instance [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lazy-loading 'pci_devices' on Instance uuid 92c34cf0-fd39-49fc-9244-4da8ccae6eec {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:43:57 user nova-compute[73056]:   <uuid>92c34cf0-fd39-49fc-9244-4da8ccae6eec</uuid>
Aug 14 16:43:57 user nova-compute[73056]:   <name>instance-00000017</name>
Aug 14 16:43:57 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:43:57 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:43:57 user nova-compute[73056]:   <metadata>
Aug 14 16:43:57 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:43:57 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:43:57 user nova-compute[73056]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1644142487</nova:name>
Aug 14 16:43:57 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:43:57</nova:creationTime>
Aug 14 16:43:57 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:43:57 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:43:57 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:43:57 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:43:57 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:43:57 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:43:57 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:43:57 user nova-compute[73056]:       <nova:owner>
Aug 14 16:43:57 user nova-compute[73056]:         <nova:user uuid="e9f89462f2734ec48d78921ab3d654b2">tempest-ServerRescueNegativeTestJSON-201205905-project-member</nova:user>
Aug 14 16:43:57 user nova-compute[73056]:         <nova:project uuid="09b7b0f153a945ac9ce96fe462b17fd5">tempest-ServerRescueNegativeTestJSON-201205905</nova:project>
Aug 14 16:43:57 user nova-compute[73056]:       </nova:owner>
Aug 14 16:43:57 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:43:57 user nova-compute[73056]:       <nova:ports>
Aug 14 16:43:57 user nova-compute[73056]:         <nova:port uuid="2a57f016-2b33-46f4-a885-51c4ac8658bb">
Aug 14 16:43:57 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 16:43:57 user nova-compute[73056]:         </nova:port>
Aug 14 16:43:57 user nova-compute[73056]:       </nova:ports>
Aug 14 16:43:57 user nova-compute[73056]:     </nova:instance>
Aug 14 16:43:57 user nova-compute[73056]:   </metadata>
Aug 14 16:43:57 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:43:57 user nova-compute[73056]:     <system>
Aug 14 16:43:57 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:43:57 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:43:57 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:43:57 user nova-compute[73056]:       <entry name="serial">92c34cf0-fd39-49fc-9244-4da8ccae6eec</entry>
Aug 14 16:43:57 user nova-compute[73056]:       <entry name="uuid">92c34cf0-fd39-49fc-9244-4da8ccae6eec</entry>
Aug 14 16:43:57 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:43:57 user nova-compute[73056]:     </system>
Aug 14 16:43:57 user nova-compute[73056]:   </sysinfo>
Aug 14 16:43:57 user nova-compute[73056]:   <os>
Aug 14 16:43:57 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:43:57 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:43:57 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:43:57 user nova-compute[73056]:   </os>
Aug 14 16:43:57 user nova-compute[73056]:   <features>
Aug 14 16:43:57 user nova-compute[73056]:     <acpi/>
Aug 14 16:43:57 user nova-compute[73056]:     <apic/>
Aug 14 16:43:57 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:43:57 user nova-compute[73056]:   </features>
Aug 14 16:43:57 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:43:57 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:43:57 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:43:57 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:43:57 user nova-compute[73056]:   </clock>
Aug 14 16:43:57 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:43:57 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:43:57 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:43:57 user nova-compute[73056]:   </cpu>
Aug 14 16:43:57 user nova-compute[73056]:   <devices>
Aug 14 16:43:57 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:43:57 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:43:57 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk"/>
Aug 14 16:43:57 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:43:57 user nova-compute[73056]:     </disk>
Aug 14 16:43:57 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:43:57 user nova-compute[73056]:       <mac address="fa:16:3e:11:b2:3a"/>
Aug 14 16:43:57 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:43:57 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:43:57 user nova-compute[73056]:       <target dev="tap2a57f016-2b"/>
Aug 14 16:43:57 user nova-compute[73056]:     </interface>
Aug 14 16:43:57 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:43:57 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/console.log" append="off"/>
Aug 14 16:43:57 user nova-compute[73056]:     </serial>
Aug 14 16:43:57 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:43:57 user nova-compute[73056]:     <video>
Aug 14 16:43:57 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:43:57 user nova-compute[73056]:     </video>
Aug 14 16:43:57 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:43:57 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:43:57 user nova-compute[73056]:     </rng>
Aug 14 16:43:57 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:43:57 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:43:57 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:43:57 user nova-compute[73056]:     </memballoon>
Aug 14 16:43:57 user nova-compute[73056]:   </devices>
Aug 14 16:43:57 user nova-compute[73056]: </domain>
Aug 14 16:43:57 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:43:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1644142487',display_name='tempest-ServerRescueNegativeTestJSON-server-1644142487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1644142487',id=23,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09b7b0f153a945ac9ce96fe462b17fd5',ramdisk_id='',reservation_id='r-sdr5vmlk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-201205905',owner_user_name='tempest-ServerRescueNegativeTestJSON-201205905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:43:54Z,user_data=None,user_id='e9f89462f2734ec48d78921ab3d654b2',uuid=92c34cf0-fd39-49fc-9244-4da8ccae6eec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a57f016-2b33-46f4-a885-51c4ac8658bb", "address": "fa:16:3e:11:b2:3a", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a57f016-2b", "ovs_interfaceid": "2a57f016-2b33-46f4-a885-51c4ac8658bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Converting VIF {"id": "2a57f016-2b33-46f4-a885-51c4ac8658bb", "address": "fa:16:3e:11:b2:3a", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a57f016-2b", "ovs_interfaceid": "2a57f016-2b33-46f4-a885-51c4ac8658bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:b2:3a,bridge_name='br-int',has_traffic_filtering=True,id=2a57f016-2b33-46f4-a885-51c4ac8658bb,network=Network(9f4305e9-4b75-4f5d-b1b2-f1184c408739),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a57f016-2b') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG os_vif [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:b2:3a,bridge_name='br-int',has_traffic_filtering=True,id=2a57f016-2b33-46f4-a885-51c4ac8658bb,network=Network(9f4305e9-4b75-4f5d-b1b2-f1184c408739),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a57f016-2b') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a57f016-2b, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2a57f016-2b, col_values=(('external_ids', {'iface-id': '2a57f016-2b33-46f4-a885-51c4ac8658bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:b2:3a', 'vm-uuid': '92c34cf0-fd39-49fc-9244-4da8ccae6eec'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:57 user nova-compute[73056]: INFO os_vif [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:b2:3a,bridge_name='br-int',has_traffic_filtering=True,id=2a57f016-2b33-46f4-a885-51c4ac8658bb,network=Network(9f4305e9-4b75-4f5d-b1b2-f1184c408739),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a57f016-2b')
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] No VIF found with MAC fa:16:3e:11:b2:3a, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.network.neutron [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Updating instance_info_cache with network_info: [{"id": "82102e20-784e-4435-9c32-381ae24600f4", "address": "fa:16:3e:a7:27:9a", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82102e20-78", "ovs_interfaceid": "82102e20-784e-4435-9c32-381ae24600f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Releasing lock "refresh_cache-e07cfc63-1ce9-466b-aa01-d967be383f45" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.compute.manager [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Instance network_info: |[{"id": "82102e20-784e-4435-9c32-381ae24600f4", "address": "fa:16:3e:a7:27:9a", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82102e20-78", "ovs_interfaceid": "82102e20-784e-4435-9c32-381ae24600f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f0c9e1f6-a9ff-462d-9929-29701b3c8c75 req-e5aabacd-f252-4e70-a0e0-c640e5d6fb30 service nova] Acquired lock "refresh_cache-e07cfc63-1ce9-466b-aa01-d967be383f45" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.network.neutron [req-f0c9e1f6-a9ff-462d-9929-29701b3c8c75 req-e5aabacd-f252-4e70-a0e0-c640e5d6fb30 service nova] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Refreshing network info cache for port 82102e20-784e-4435-9c32-381ae24600f4 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Start _get_guest_xml network_info=[{"id": "82102e20-784e-4435-9c32-381ae24600f4", "address": "fa:16:3e:a7:27:9a", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82102e20-78", "ovs_interfaceid": "82102e20-784e-4435-9c32-381ae24600f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:43:57 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:43:57 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:43:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-553857250',display_name='tempest-AttachVolumeNegativeTest-server-553857250',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-553857250',id=24,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIe3182qMidWG86P4SQvq7Inq83ggFpuOR/R5zHMZ1p+W02VIcyEqOfjD/R7QVMksSnkBWrRqPR18S1znRVa3ooRtWQ9nDAnF9XNBneY3h9KQY+7rdSx6S9T2Z397Suhig==',key_name='tempest-keypair-1409094913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d5a8e599b3141339ed0ae6729031b36',ramdisk_id='',reservation_id='r-74p70b5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-860464885',owner_user_name='tempest-AttachVolumeNegativeTest-860464885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:43:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dad45adee1047bda7350d8a3f8a2f54',uuid=e07cfc63-1ce9-466b-aa01-d967be383f45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82102e20-784e-4435-9c32-381ae24600f4", "address": "fa:16:3e:a7:27:9a", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82102e20-78", "ovs_interfaceid": "82102e20-784e-4435-9c32-381ae24600f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Converting VIF {"id": "82102e20-784e-4435-9c32-381ae24600f4", "address": "fa:16:3e:a7:27:9a", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82102e20-78", "ovs_interfaceid": "82102e20-784e-4435-9c32-381ae24600f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:27:9a,bridge_name='br-int',has_traffic_filtering=True,id=82102e20-784e-4435-9c32-381ae24600f4,network=Network(ad323a8d-7318-46f5-8af4-cbc61ae589b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82102e20-78') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.objects.instance [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lazy-loading 'pci_devices' on Instance uuid e07cfc63-1ce9-466b-aa01-d967be383f45 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:43:57 user nova-compute[73056]:   <uuid>e07cfc63-1ce9-466b-aa01-d967be383f45</uuid>
Aug 14 16:43:57 user nova-compute[73056]:   <name>instance-00000018</name>
Aug 14 16:43:57 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:43:57 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:43:57 user nova-compute[73056]:   <metadata>
Aug 14 16:43:57 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:43:57 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:43:57 user nova-compute[73056]:       <nova:name>tempest-AttachVolumeNegativeTest-server-553857250</nova:name>
Aug 14 16:43:57 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:43:57</nova:creationTime>
Aug 14 16:43:57 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:43:57 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:43:57 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:43:57 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:43:57 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:43:57 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:43:57 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:43:57 user nova-compute[73056]:       <nova:owner>
Aug 14 16:43:57 user nova-compute[73056]:         <nova:user uuid="3dad45adee1047bda7350d8a3f8a2f54">tempest-AttachVolumeNegativeTest-860464885-project-member</nova:user>
Aug 14 16:43:57 user nova-compute[73056]:         <nova:project uuid="9d5a8e599b3141339ed0ae6729031b36">tempest-AttachVolumeNegativeTest-860464885</nova:project>
Aug 14 16:43:57 user nova-compute[73056]:       </nova:owner>
Aug 14 16:43:57 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:43:57 user nova-compute[73056]:       <nova:ports>
Aug 14 16:43:57 user nova-compute[73056]:         <nova:port uuid="82102e20-784e-4435-9c32-381ae24600f4">
Aug 14 16:43:57 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 14 16:43:57 user nova-compute[73056]:         </nova:port>
Aug 14 16:43:57 user nova-compute[73056]:       </nova:ports>
Aug 14 16:43:57 user nova-compute[73056]:     </nova:instance>
Aug 14 16:43:57 user nova-compute[73056]:   </metadata>
Aug 14 16:43:57 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:43:57 user nova-compute[73056]:     <system>
Aug 14 16:43:57 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:43:57 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:43:57 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:43:57 user nova-compute[73056]:       <entry name="serial">e07cfc63-1ce9-466b-aa01-d967be383f45</entry>
Aug 14 16:43:57 user nova-compute[73056]:       <entry name="uuid">e07cfc63-1ce9-466b-aa01-d967be383f45</entry>
Aug 14 16:43:57 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:43:57 user nova-compute[73056]:     </system>
Aug 14 16:43:57 user nova-compute[73056]:   </sysinfo>
Aug 14 16:43:57 user nova-compute[73056]:   <os>
Aug 14 16:43:57 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:43:57 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:43:57 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:43:57 user nova-compute[73056]:   </os>
Aug 14 16:43:57 user nova-compute[73056]:   <features>
Aug 14 16:43:57 user nova-compute[73056]:     <acpi/>
Aug 14 16:43:57 user nova-compute[73056]:     <apic/>
Aug 14 16:43:57 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:43:57 user nova-compute[73056]:   </features>
Aug 14 16:43:57 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:43:57 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:43:57 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:43:57 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:43:57 user nova-compute[73056]:   </clock>
Aug 14 16:43:57 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:43:57 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:43:57 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:43:57 user nova-compute[73056]:   </cpu>
Aug 14 16:43:57 user nova-compute[73056]:   <devices>
Aug 14 16:43:57 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:43:57 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:43:57 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/e07cfc63-1ce9-466b-aa01-d967be383f45/disk"/>
Aug 14 16:43:57 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:43:57 user nova-compute[73056]:     </disk>
Aug 14 16:43:57 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:43:57 user nova-compute[73056]:       <mac address="fa:16:3e:a7:27:9a"/>
Aug 14 16:43:57 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:43:57 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:43:57 user nova-compute[73056]:       <target dev="tap82102e20-78"/>
Aug 14 16:43:57 user nova-compute[73056]:     </interface>
Aug 14 16:43:57 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:43:57 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/e07cfc63-1ce9-466b-aa01-d967be383f45/console.log" append="off"/>
Aug 14 16:43:57 user nova-compute[73056]:     </serial>
Aug 14 16:43:57 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:43:57 user nova-compute[73056]:     <video>
Aug 14 16:43:57 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:43:57 user nova-compute[73056]:     </video>
Aug 14 16:43:57 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:43:57 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:43:57 user nova-compute[73056]:     </rng>
Aug 14 16:43:57 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:43:57 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:43:57 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:43:57 user nova-compute[73056]:     </memballoon>
Aug 14 16:43:57 user nova-compute[73056]:   </devices>
Aug 14 16:43:57 user nova-compute[73056]: </domain>
Aug 14 16:43:57 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:43:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-553857250',display_name='tempest-AttachVolumeNegativeTest-server-553857250',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-553857250',id=24,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIe3182qMidWG86P4SQvq7Inq83ggFpuOR/R5zHMZ1p+W02VIcyEqOfjD/R7QVMksSnkBWrRqPR18S1znRVa3ooRtWQ9nDAnF9XNBneY3h9KQY+7rdSx6S9T2Z397Suhig==',key_name='tempest-keypair-1409094913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d5a8e599b3141339ed0ae6729031b36',ramdisk_id='',reservation_id='r-74p70b5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-860464885',owner_user_name='tempest-AttachVolumeNegativeTest-860464885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:43:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dad45adee1047bda7350d8a3f8a2f54',uuid=e07cfc63-1ce9-466b-aa01-d967be383f45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82102e20-784e-4435-9c32-381ae24600f4", "address": "fa:16:3e:a7:27:9a", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82102e20-78", "ovs_interfaceid": "82102e20-784e-4435-9c32-381ae24600f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Converting VIF {"id": "82102e20-784e-4435-9c32-381ae24600f4", "address": "fa:16:3e:a7:27:9a", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82102e20-78", "ovs_interfaceid": "82102e20-784e-4435-9c32-381ae24600f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:27:9a,bridge_name='br-int',has_traffic_filtering=True,id=82102e20-784e-4435-9c32-381ae24600f4,network=Network(ad323a8d-7318-46f5-8af4-cbc61ae589b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82102e20-78') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG os_vif [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:27:9a,bridge_name='br-int',has_traffic_filtering=True,id=82102e20-784e-4435-9c32-381ae24600f4,network=Network(ad323a8d-7318-46f5-8af4-cbc61ae589b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82102e20-78') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap82102e20-78, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap82102e20-78, col_values=(('external_ids', {'iface-id': '82102e20-784e-4435-9c32-381ae24600f4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:27:9a', 'vm-uuid': 'e07cfc63-1ce9-466b-aa01-d967be383f45'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:57 user nova-compute[73056]: INFO os_vif [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:27:9a,bridge_name='br-int',has_traffic_filtering=True,id=82102e20-784e-4435-9c32-381ae24600f4,network=Network(ad323a8d-7318-46f5-8af4-cbc61ae589b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82102e20-78')
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.network.neutron [req-0e2b2e83-c311-49b4-8e85-42b64f24e623 req-d6df0fc3-db69-492e-9274-78c6c129b4b1 service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Updated VIF entry in instance network info cache for port 2a57f016-2b33-46f4-a885-51c4ac8658bb. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.network.neutron [req-0e2b2e83-c311-49b4-8e85-42b64f24e623 req-d6df0fc3-db69-492e-9274-78c6c129b4b1 service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Updating instance_info_cache with network_info: [{"id": "2a57f016-2b33-46f4-a885-51c4ac8658bb", "address": "fa:16:3e:11:b2:3a", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a57f016-2b", "ovs_interfaceid": "2a57f016-2b33-46f4-a885-51c4ac8658bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0e2b2e83-c311-49b4-8e85-42b64f24e623 req-d6df0fc3-db69-492e-9274-78c6c129b4b1 service nova] Releasing lock "refresh_cache-92c34cf0-fd39-49fc-9244-4da8ccae6eec" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692031422.8544667, 18008990-9ed6-46e5-805c-4475e58855a6 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:43:57 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] VM Stopped (Lifecycle Event)
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] No VIF found with MAC fa:16:3e:a7:27:9a, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:43:57 user nova-compute[73056]: DEBUG nova.compute.manager [None req-b4351baf-78d8-4bba-9482-e5818bbc817d None None] [instance: 18008990-9ed6-46e5-805c-4475e58855a6] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:43:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:43:58 user nova-compute[73056]: DEBUG nova.network.neutron [req-f0c9e1f6-a9ff-462d-9929-29701b3c8c75 req-e5aabacd-f252-4e70-a0e0-c640e5d6fb30 service nova] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Updated VIF entry in instance network info cache for port 82102e20-784e-4435-9c32-381ae24600f4. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:43:58 user nova-compute[73056]: DEBUG nova.network.neutron [req-f0c9e1f6-a9ff-462d-9929-29701b3c8c75 req-e5aabacd-f252-4e70-a0e0-c640e5d6fb30 service nova] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Updating instance_info_cache with network_info: [{"id": "82102e20-784e-4435-9c32-381ae24600f4", "address": "fa:16:3e:a7:27:9a", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82102e20-78", "ovs_interfaceid": "82102e20-784e-4435-9c32-381ae24600f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:43:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f0c9e1f6-a9ff-462d-9929-29701b3c8c75 req-e5aabacd-f252-4e70-a0e0-c640e5d6fb30 service nova] Releasing lock "refresh_cache-e07cfc63-1ce9-466b-aa01-d967be383f45" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:43:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-f60cdbc7-8f2b-44d4-9113-ebeaf1c827de tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-f60cdbc7-8f2b-44d4-9113-ebeaf1c827de tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:58 user nova-compute[73056]: INFO nova.compute.manager [None req-f60cdbc7-8f2b-44d4-9113-ebeaf1c827de tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Detaching volume 0784b982-76ba-4021-9063-b976f48f7e96
Aug 14 16:43:58 user nova-compute[73056]: INFO nova.virt.block_device [None req-f60cdbc7-8f2b-44d4-9113-ebeaf1c827de tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Attempting to driver detach volume 0784b982-76ba-4021-9063-b976f48f7e96 from mountpoint /dev/vdb
Aug 14 16:43:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-f60cdbc7-8f2b-44d4-9113-ebeaf1c827de tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Attempting to detach device vdb from instance 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8 from the persistent domain config. {{(pid=73056) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-f60cdbc7-8f2b-44d4-9113-ebeaf1c827de tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 16:43:59 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:43:59 user nova-compute[73056]:   <source dev="/dev/sdc"/>
Aug 14 16:43:59 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:43:59 user nova-compute[73056]:   <serial>0784b982-76ba-4021-9063-b976f48f7e96</serial>
Aug 14 16:43:59 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 16:43:59 user nova-compute[73056]: </disk>
Aug 14 16:43:59 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 16:43:59 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-f60cdbc7-8f2b-44d4-9113-ebeaf1c827de tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Successfully detached device vdb from instance 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8 from the persistent domain config.
Aug 14 16:43:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-f60cdbc7-8f2b-44d4-9113-ebeaf1c827de tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8 from the live domain config. {{(pid=73056) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-f60cdbc7-8f2b-44d4-9113-ebeaf1c827de tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 16:43:59 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:43:59 user nova-compute[73056]:   <source dev="/dev/sdc"/>
Aug 14 16:43:59 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:43:59 user nova-compute[73056]:   <serial>0784b982-76ba-4021-9063-b976f48f7e96</serial>
Aug 14 16:43:59 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 16:43:59 user nova-compute[73056]: </disk>
Aug 14 16:43:59 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG nova.compute.manager [req-a1770354-4e6d-4795-aefd-54ba39108763 req-c375b80d-fd16-46d6-b69b-9487fe0c9bdd service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Received event network-vif-plugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a1770354-4e6d-4795-aefd-54ba39108763 req-c375b80d-fd16-46d6-b69b-9487fe0c9bdd service nova] Acquiring lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a1770354-4e6d-4795-aefd-54ba39108763 req-c375b80d-fd16-46d6-b69b-9487fe0c9bdd service nova] Lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a1770354-4e6d-4795-aefd-54ba39108763 req-c375b80d-fd16-46d6-b69b-9487fe0c9bdd service nova] Lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG nova.compute.manager [req-a1770354-4e6d-4795-aefd-54ba39108763 req-c375b80d-fd16-46d6-b69b-9487fe0c9bdd service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] No waiting events found dispatching network-vif-plugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:43:59 user nova-compute[73056]: WARNING nova.compute.manager [req-a1770354-4e6d-4795-aefd-54ba39108763 req-c375b80d-fd16-46d6-b69b-9487fe0c9bdd service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Received unexpected event network-vif-plugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 for instance with vm_state building and task_state spawning.
Aug 14 16:43:59 user nova-compute[73056]: DEBUG nova.compute.manager [req-a1770354-4e6d-4795-aefd-54ba39108763 req-c375b80d-fd16-46d6-b69b-9487fe0c9bdd service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Received event network-vif-plugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a1770354-4e6d-4795-aefd-54ba39108763 req-c375b80d-fd16-46d6-b69b-9487fe0c9bdd service nova] Acquiring lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a1770354-4e6d-4795-aefd-54ba39108763 req-c375b80d-fd16-46d6-b69b-9487fe0c9bdd service nova] Lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a1770354-4e6d-4795-aefd-54ba39108763 req-c375b80d-fd16-46d6-b69b-9487fe0c9bdd service nova] Lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG nova.compute.manager [req-a1770354-4e6d-4795-aefd-54ba39108763 req-c375b80d-fd16-46d6-b69b-9487fe0c9bdd service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] No waiting events found dispatching network-vif-plugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:43:59 user nova-compute[73056]: WARNING nova.compute.manager [req-a1770354-4e6d-4795-aefd-54ba39108763 req-c375b80d-fd16-46d6-b69b-9487fe0c9bdd service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Received unexpected event network-vif-plugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 for instance with vm_state building and task_state spawning.
Aug 14 16:43:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Received event <DeviceRemovedEvent: 1692031439.5197947, 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73056) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-f60cdbc7-8f2b-44d4-9113-ebeaf1c827de tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8 {{(pid=73056) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 16:43:59 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-f60cdbc7-8f2b-44d4-9113-ebeaf1c827de tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Successfully detached device vdb from instance 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8 from the live domain config.
Aug 14 16:43:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f60cdbc7-8f2b-44d4-9113-ebeaf1c827de tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60cdbc7-8f2b-44d4-9113-ebeaf1c827de tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AYPjGBth', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:43:59 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-f60cdbc7-8f2b-44d4-9113-ebeaf1c827de tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:43:59 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-f60cdbc7-8f2b-44d4-9113-ebeaf1c827de tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-f60cdbc7-8f2b-44d4-9113-ebeaf1c827de tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60cdbc7-8f2b-44d4-9113-ebeaf1c827de tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a427eec4-12fe-4e1a-8553-f05f5343737a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb87f38-60bd-41b7-b42b-29a2b58eb401]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60cdbc7-8f2b-44d4-9113-ebeaf1c827de tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 (non-flash)
Aug 14 16:43:59 user nova-compute[73056]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a (non-flash)
Aug 14 16:43:59 user nova-compute[73056]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)
Aug 14 16:43:59 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60cdbc7-8f2b-44d4-9113-ebeaf1c827de tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 (non-flash)
Aug 14 16:43:59 user nova-compute[73056]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a (non-flash)
Aug 14 16:43:59 user nova-compute[73056]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)
Aug 14 16:43:59 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60cdbc7-8f2b-44d4-9113-ebeaf1c827de tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff2dce4d240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96'): ({'sdc'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-f60cdbc7-8f2b-44d4-9113-ebeaf1c827de tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Removing single pathed devices sdc {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc511d3-1f1a-4256-b5f9-c2a44cde8be4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e07c2d-4501-45f5-b35e-9c0d66a0cc34]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-f60cdbc7-8f2b-44d4-9113-ebeaf1c827de tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Flushing IO for device /dev/sdc {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b7c4b7-6dab-4b80-9b3b-d2dfa2128f18]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-f60cdbc7-8f2b-44d4-9113-ebeaf1c827de tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60ad3fd-3a93-407c-ba9e-c37318e1b137]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-f60cdbc7-8f2b-44d4-9113-ebeaf1c827de tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-f60cdbc7-8f2b-44d4-9113-ebeaf1c827de tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] SCSI volumes sdc have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60cdbc7-8f2b-44d4-9113-ebeaf1c827de tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2140a97-bcc5-4b7d-9cdc-9bb9d9fa4204]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60cdbc7-8f2b-44d4-9113-ebeaf1c827de tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c35818b-a3be-413f-aa36-f1c435016cfa]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60cdbc7-8f2b-44d4-9113-ebeaf1c827de tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96, portal: 172.16.0.220,3260]
Aug 14 16:43:59 user nova-compute[73056]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96, portal: 172.16.0.220,3260] successful.
Aug 14 16:43:59 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0784b982-76ba-4021-9063-b976f48f7e96 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e546ba-58f3-49bb-a247-c1bbb194363a]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60cdbc7-8f2b-44d4-9113-ebeaf1c827de tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-f60cdbc7-8f2b-44d4-9113-ebeaf1c827de tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60cdbc7-8f2b-44d4-9113-ebeaf1c827de tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] <== disconnect_volume: return (296ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:43:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f60cdbc7-8f2b-44d4-9113-ebeaf1c827de tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:44:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:00 user nova-compute[73056]: DEBUG nova.compute.manager [req-9edff15e-4a2d-452f-84f6-5b0a7a480d5c req-fdec43dc-e7b3-416a-9d11-b3e072b6d8cb service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Received event network-vif-plugged-2a57f016-2b33-46f4-a885-51c4ac8658bb {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:44:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9edff15e-4a2d-452f-84f6-5b0a7a480d5c req-fdec43dc-e7b3-416a-9d11-b3e072b6d8cb service nova] Acquiring lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:44:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9edff15e-4a2d-452f-84f6-5b0a7a480d5c req-fdec43dc-e7b3-416a-9d11-b3e072b6d8cb service nova] Lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:44:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9edff15e-4a2d-452f-84f6-5b0a7a480d5c req-fdec43dc-e7b3-416a-9d11-b3e072b6d8cb service nova] Lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:44:00 user nova-compute[73056]: DEBUG nova.compute.manager [req-9edff15e-4a2d-452f-84f6-5b0a7a480d5c req-fdec43dc-e7b3-416a-9d11-b3e072b6d8cb service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] No waiting events found dispatching network-vif-plugged-2a57f016-2b33-46f4-a885-51c4ac8658bb {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:44:00 user nova-compute[73056]: WARNING nova.compute.manager [req-9edff15e-4a2d-452f-84f6-5b0a7a480d5c req-fdec43dc-e7b3-416a-9d11-b3e072b6d8cb service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Received unexpected event network-vif-plugged-2a57f016-2b33-46f4-a885-51c4ac8658bb for instance with vm_state building and task_state spawning.
Aug 14 16:44:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:00 user nova-compute[73056]: DEBUG nova.objects.instance [None req-f60cdbc7-8f2b-44d4-9113-ebeaf1c827de tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lazy-loading 'flavor' on Instance uuid 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:44:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-f60cdbc7-8f2b-44d4-9113-ebeaf1c827de tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.833s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:44:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:01 user nova-compute[73056]: DEBUG nova.compute.manager [req-9cecacbf-4102-4d88-aa18-a92f84d4e803 req-720a9316-93d4-4ba3-a766-61cfd71b5b1d service nova] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Received event network-vif-plugged-82102e20-784e-4435-9c32-381ae24600f4 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:44:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9cecacbf-4102-4d88-aa18-a92f84d4e803 req-720a9316-93d4-4ba3-a766-61cfd71b5b1d service nova] Acquiring lock "e07cfc63-1ce9-466b-aa01-d967be383f45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:44:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9cecacbf-4102-4d88-aa18-a92f84d4e803 req-720a9316-93d4-4ba3-a766-61cfd71b5b1d service nova] Lock "e07cfc63-1ce9-466b-aa01-d967be383f45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:44:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9cecacbf-4102-4d88-aa18-a92f84d4e803 req-720a9316-93d4-4ba3-a766-61cfd71b5b1d service nova] Lock "e07cfc63-1ce9-466b-aa01-d967be383f45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:44:01 user nova-compute[73056]: DEBUG nova.compute.manager [req-9cecacbf-4102-4d88-aa18-a92f84d4e803 req-720a9316-93d4-4ba3-a766-61cfd71b5b1d service nova] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] No waiting events found dispatching network-vif-plugged-82102e20-784e-4435-9c32-381ae24600f4 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:44:01 user nova-compute[73056]: WARNING nova.compute.manager [req-9cecacbf-4102-4d88-aa18-a92f84d4e803 req-720a9316-93d4-4ba3-a766-61cfd71b5b1d service nova] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Received unexpected event network-vif-plugged-82102e20-784e-4435-9c32-381ae24600f4 for instance with vm_state building and task_state spawning.
Aug 14 16:44:02 user nova-compute[73056]: DEBUG nova.compute.manager [req-54b68392-1608-46bf-92f6-158e63c3e58d req-c5be19e4-6f59-4806-a0ac-936b3ea5829c service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Received event network-vif-plugged-2a57f016-2b33-46f4-a885-51c4ac8658bb {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:44:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-54b68392-1608-46bf-92f6-158e63c3e58d req-c5be19e4-6f59-4806-a0ac-936b3ea5829c service nova] Acquiring lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:44:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-54b68392-1608-46bf-92f6-158e63c3e58d req-c5be19e4-6f59-4806-a0ac-936b3ea5829c service nova] Lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:44:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-54b68392-1608-46bf-92f6-158e63c3e58d req-c5be19e4-6f59-4806-a0ac-936b3ea5829c service nova] Lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:44:02 user nova-compute[73056]: DEBUG nova.compute.manager [req-54b68392-1608-46bf-92f6-158e63c3e58d req-c5be19e4-6f59-4806-a0ac-936b3ea5829c service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] No waiting events found dispatching network-vif-plugged-2a57f016-2b33-46f4-a885-51c4ac8658bb {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:44:02 user nova-compute[73056]: WARNING nova.compute.manager [req-54b68392-1608-46bf-92f6-158e63c3e58d req-c5be19e4-6f59-4806-a0ac-936b3ea5829c service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Received unexpected event network-vif-plugged-2a57f016-2b33-46f4-a885-51c4ac8658bb for instance with vm_state building and task_state spawning.
Aug 14 16:44:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:02 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031442.7554328, b580e3d0-88b5-42a3-a953-84b94c088f41 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:44:02 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] VM Resumed (Lifecycle Event)
Aug 14 16:44:02 user nova-compute[73056]: DEBUG nova.compute.manager [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:44:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:44:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:02 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:44:02 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Instance spawned successfully.
Aug 14 16:44:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:44:02 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:44:02 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:44:02 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031442.7720544, b580e3d0-88b5-42a3-a953-84b94c088f41 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:44:02 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] VM Started (Lifecycle Event)
Aug 14 16:44:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:44:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:44:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:44:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:44:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:44:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:44:02 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:44:02 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:44:02 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:44:02 user nova-compute[73056]: INFO nova.compute.manager [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Took 9.54 seconds to spawn the instance on the hypervisor.
Aug 14 16:44:02 user nova-compute[73056]: DEBUG nova.compute.manager [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:44:03 user nova-compute[73056]: INFO nova.compute.manager [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Took 10.44 seconds to build instance.
Aug 14 16:44:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3ce992af-6f00-45e3-868e-20745575d154 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "b580e3d0-88b5-42a3-a953-84b94c088f41" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.592s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:44:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6108d44-11ef-4414-889b-35a105195b8e/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:03 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031443.5375881, e07cfc63-1ce9-466b-aa01-d967be383f45 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:44:03 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] VM Resumed (Lifecycle Event)
Aug 14 16:44:03 user nova-compute[73056]: DEBUG nova.compute.manager [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:44:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:44:03 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Instance spawned successfully.
Aug 14 16:44:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:44:03 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:44:03 user nova-compute[73056]: DEBUG nova.compute.manager [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:44:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:44:03 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:44:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:44:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:44:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:44:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:44:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:44:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:44:03 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:44:03 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031443.5424154, e07cfc63-1ce9-466b-aa01-d967be383f45 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:44:03 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] VM Started (Lifecycle Event)
Aug 14 16:44:03 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Instance spawned successfully.
Aug 14 16:44:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:44:03 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:44:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:44:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:44:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:44:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:44:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:44:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:44:03 user nova-compute[73056]: DEBUG nova.compute.manager [req-7dc2cc4a-5465-495c-87cf-7058342369e1 req-4c6b8c88-7999-44c5-857b-a88ff005965c service nova] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Received event network-vif-plugged-82102e20-784e-4435-9c32-381ae24600f4 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:44:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-7dc2cc4a-5465-495c-87cf-7058342369e1 req-4c6b8c88-7999-44c5-857b-a88ff005965c service nova] Acquiring lock "e07cfc63-1ce9-466b-aa01-d967be383f45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:44:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-7dc2cc4a-5465-495c-87cf-7058342369e1 req-4c6b8c88-7999-44c5-857b-a88ff005965c service nova] Lock "e07cfc63-1ce9-466b-aa01-d967be383f45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:44:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-7dc2cc4a-5465-495c-87cf-7058342369e1 req-4c6b8c88-7999-44c5-857b-a88ff005965c service nova] Lock "e07cfc63-1ce9-466b-aa01-d967be383f45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:44:03 user nova-compute[73056]: DEBUG nova.compute.manager [req-7dc2cc4a-5465-495c-87cf-7058342369e1 req-4c6b8c88-7999-44c5-857b-a88ff005965c service nova] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] No waiting events found dispatching network-vif-plugged-82102e20-784e-4435-9c32-381ae24600f4 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:44:03 user nova-compute[73056]: WARNING nova.compute.manager [req-7dc2cc4a-5465-495c-87cf-7058342369e1 req-4c6b8c88-7999-44c5-857b-a88ff005965c service nova] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Received unexpected event network-vif-plugged-82102e20-784e-4435-9c32-381ae24600f4 for instance with vm_state building and task_state spawning.
Aug 14 16:44:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6108d44-11ef-4414-889b-35a105195b8e/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6108d44-11ef-4414-889b-35a105195b8e/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:03 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:44:03 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:44:03 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031443.576649, 92c34cf0-fd39-49fc-9244-4da8ccae6eec => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:44:03 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] VM Resumed (Lifecycle Event)
Aug 14 16:44:03 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:44:03 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:44:03 user nova-compute[73056]: INFO nova.compute.manager [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Took 8.48 seconds to spawn the instance on the hypervisor.
Aug 14 16:44:03 user nova-compute[73056]: DEBUG nova.compute.manager [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:44:03 user nova-compute[73056]: INFO nova.compute.manager [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Took 9.34 seconds to spawn the instance on the hypervisor.
Aug 14 16:44:03 user nova-compute[73056]: DEBUG nova.compute.manager [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:44:03 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:44:03 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031443.5781307, 92c34cf0-fd39-49fc-9244-4da8ccae6eec => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:44:03 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] VM Started (Lifecycle Event)
Aug 14 16:44:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6108d44-11ef-4414-889b-35a105195b8e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:03 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:44:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:44:03 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:44:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1beaec7b-ecd0-4586-b4b2-b04588ce9e2a/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:03 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:44:04 user nova-compute[73056]: INFO nova.compute.manager [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Took 9.85 seconds to build instance.
Aug 14 16:44:04 user nova-compute[73056]: INFO nova.compute.manager [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Took 10.65 seconds to build instance.
Aug 14 16:44:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d8df75e0-d8fe-4567-a905-8ae64eefc2ee tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "e07cfc63-1ce9-466b-aa01-d967be383f45" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.998s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:44:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-8718fd8f-56dd-4a33-8a42-d466db1fbe6f tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.778s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:44:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1beaec7b-ecd0-4586-b4b2-b04588ce9e2a/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1beaec7b-ecd0-4586-b4b2-b04588ce9e2a/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1beaec7b-ecd0-4586-b4b2-b04588ce9e2a/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dbfa63-5061-4304-b8eb-4565ad9f0a96/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dbfa63-5061-4304-b8eb-4565ad9f0a96/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dbfa63-5061-4304-b8eb-4565ad9f0a96/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dbfa63-5061-4304-b8eb-4565ad9f0a96/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07cfc63-1ce9-466b-aa01-d967be383f45/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07cfc63-1ce9-466b-aa01-d967be383f45/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07cfc63-1ce9-466b-aa01-d967be383f45/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07cfc63-1ce9-466b-aa01-d967be383f45/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json" returned: 0 in 0.300s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json" returned: 0 in 0.299s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3270811-8241-47a6-aa36-0ec3feddf0fc/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3270811-8241-47a6-aa36-0ec3feddf0fc/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3270811-8241-47a6-aa36-0ec3feddf0fc/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3270811-8241-47a6-aa36-0ec3feddf0fc/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:44:09 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:44:09 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:44:09 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=7153MB free_disk=25.428455352783203GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 16:44:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:44:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:44:09 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 9f3a7f8a-e3b9-4918-9663-968677fe5c90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:44:09 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:44:09 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 4731f355-9307-4176-910b-cf35beb85e75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:44:09 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 9c11423c-88d3-4fae-8917-c0d57021d194 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:44:09 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance b3270811-8241-47a6-aa36-0ec3feddf0fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:44:09 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:44:09 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance a6108d44-11ef-4414-889b-35a105195b8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:44:09 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 10b527b0-a7f1-4149-9859-69dac9f481e3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:44:09 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance d5dbfa63-5061-4304-b8eb-4565ad9f0a96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:44:09 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance b580e3d0-88b5-42a3-a953-84b94c088f41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:44:09 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 92c34cf0-fd39-49fc-9244-4da8ccae6eec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:44:09 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance e07cfc63-1ce9-466b-aa01-d967be383f45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:44:09 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 16:44:09 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 16:44:09 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:44:09 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:44:10 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 16:44:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.737s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:44:10 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:44:10 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:44:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-e686a575-119f-4e17-b8e5-db566de88b8f tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Acquiring lock "1beaec7b-ecd0-4586-b4b2-b04588ce9e2a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:44:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-e686a575-119f-4e17-b8e5-db566de88b8f tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Lock "1beaec7b-ecd0-4586-b4b2-b04588ce9e2a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:44:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-e686a575-119f-4e17-b8e5-db566de88b8f tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Acquiring lock "1beaec7b-ecd0-4586-b4b2-b04588ce9e2a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:44:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-e686a575-119f-4e17-b8e5-db566de88b8f tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Lock "1beaec7b-ecd0-4586-b4b2-b04588ce9e2a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:44:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-e686a575-119f-4e17-b8e5-db566de88b8f tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Lock "1beaec7b-ecd0-4586-b4b2-b04588ce9e2a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:44:14 user nova-compute[73056]: INFO nova.compute.manager [None req-e686a575-119f-4e17-b8e5-db566de88b8f tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Terminating instance
Aug 14 16:44:14 user nova-compute[73056]: DEBUG nova.compute.manager [None req-e686a575-119f-4e17-b8e5-db566de88b8f tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 16:44:14 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:14 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:14 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:14 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:15 user nova-compute[73056]: DEBUG nova.compute.manager [req-d2bc4b0b-2b23-4c5e-9729-ff44400b7bb8 req-df8d6e70-efea-43ad-bafc-3ef5b6eff500 service nova] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Received event network-vif-unplugged-19e38b07-dcc8-41aa-a433-38ca54ed0b4e {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:44:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-d2bc4b0b-2b23-4c5e-9729-ff44400b7bb8 req-df8d6e70-efea-43ad-bafc-3ef5b6eff500 service nova] Acquiring lock "1beaec7b-ecd0-4586-b4b2-b04588ce9e2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:44:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-d2bc4b0b-2b23-4c5e-9729-ff44400b7bb8 req-df8d6e70-efea-43ad-bafc-3ef5b6eff500 service nova] Lock "1beaec7b-ecd0-4586-b4b2-b04588ce9e2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:44:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-d2bc4b0b-2b23-4c5e-9729-ff44400b7bb8 req-df8d6e70-efea-43ad-bafc-3ef5b6eff500 service nova] Lock "1beaec7b-ecd0-4586-b4b2-b04588ce9e2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:44:15 user nova-compute[73056]: DEBUG nova.compute.manager [req-d2bc4b0b-2b23-4c5e-9729-ff44400b7bb8 req-df8d6e70-efea-43ad-bafc-3ef5b6eff500 service nova] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] No waiting events found dispatching network-vif-unplugged-19e38b07-dcc8-41aa-a433-38ca54ed0b4e {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:44:15 user nova-compute[73056]: DEBUG nova.compute.manager [req-d2bc4b0b-2b23-4c5e-9729-ff44400b7bb8 req-df8d6e70-efea-43ad-bafc-3ef5b6eff500 service nova] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Received event network-vif-unplugged-19e38b07-dcc8-41aa-a433-38ca54ed0b4e for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:44:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:15 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Instance destroyed successfully.
Aug 14 16:44:15 user nova-compute[73056]: DEBUG nova.objects.instance [None req-e686a575-119f-4e17-b8e5-db566de88b8f tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Lazy-loading 'resources' on Instance uuid 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:44:15 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-e686a575-119f-4e17-b8e5-db566de88b8f tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:42:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1833232215',display_name='tempest-VolumesActionsTest-instance-1833232215',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1833232215',id=18,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:42:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b1bd35329054f4793440e9a780a0a75',ramdisk_id='',reservation_id='r-n5jzi0on',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1822561302',owner_user_name='tempest-VolumesActionsTest-1822561302-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:42:31Z,user_data=None,user_id='6f3c0d0bffd749299fe0bf8ab5aaf8c5',uuid=1beaec7b-ecd0-4586-b4b2-b04588ce9e2a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19e38b07-dcc8-41aa-a433-38ca54ed0b4e", "address": "fa:16:3e:38:40:27", "network": {"id": "90290111-0089-4535-9ba5-97fb3b034dcd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1526741248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1bd35329054f4793440e9a780a0a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e38b07-dc", "ovs_interfaceid": "19e38b07-dcc8-41aa-a433-38ca54ed0b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:44:15 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-e686a575-119f-4e17-b8e5-db566de88b8f tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Converting VIF {"id": "19e38b07-dcc8-41aa-a433-38ca54ed0b4e", "address": "fa:16:3e:38:40:27", "network": {"id": "90290111-0089-4535-9ba5-97fb3b034dcd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1526741248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1bd35329054f4793440e9a780a0a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e38b07-dc", "ovs_interfaceid": "19e38b07-dcc8-41aa-a433-38ca54ed0b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:44:15 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-e686a575-119f-4e17-b8e5-db566de88b8f tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:40:27,bridge_name='br-int',has_traffic_filtering=True,id=19e38b07-dcc8-41aa-a433-38ca54ed0b4e,network=Network(90290111-0089-4535-9ba5-97fb3b034dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19e38b07-dc') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:44:15 user nova-compute[73056]: DEBUG os_vif [None req-e686a575-119f-4e17-b8e5-db566de88b8f tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:40:27,bridge_name='br-int',has_traffic_filtering=True,id=19e38b07-dcc8-41aa-a433-38ca54ed0b4e,network=Network(90290111-0089-4535-9ba5-97fb3b034dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19e38b07-dc') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:44:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19e38b07-dc, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:44:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:15 user nova-compute[73056]: INFO os_vif [None req-e686a575-119f-4e17-b8e5-db566de88b8f tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:40:27,bridge_name='br-int',has_traffic_filtering=True,id=19e38b07-dcc8-41aa-a433-38ca54ed0b4e,network=Network(90290111-0089-4535-9ba5-97fb3b034dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19e38b07-dc')
Aug 14 16:44:15 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-e686a575-119f-4e17-b8e5-db566de88b8f tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Deleting instance files /opt/stack/data/nova/instances/1beaec7b-ecd0-4586-b4b2-b04588ce9e2a_del
Aug 14 16:44:15 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-e686a575-119f-4e17-b8e5-db566de88b8f tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Deletion of /opt/stack/data/nova/instances/1beaec7b-ecd0-4586-b4b2-b04588ce9e2a_del complete
Aug 14 16:44:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:15 user nova-compute[73056]: INFO nova.compute.manager [None req-e686a575-119f-4e17-b8e5-db566de88b8f tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Took 0.81 seconds to destroy the instance on the hypervisor.
Aug 14 16:44:15 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-e686a575-119f-4e17-b8e5-db566de88b8f tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 16:44:15 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 16:44:15 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 16:44:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:16 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:44:16 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Took 1.08 seconds to deallocate network for instance.
Aug 14 16:44:16 user nova-compute[73056]: DEBUG nova.compute.manager [req-7e0f58b2-2780-4d4b-87ae-398eb419c11a req-ad2cf145-28db-44a6-8e81-51b5f0dca3d9 service nova] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Received event network-vif-deleted-19e38b07-dcc8-41aa-a433-38ca54ed0b4e {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:44:16 user nova-compute[73056]: INFO nova.compute.manager [req-7e0f58b2-2780-4d4b-87ae-398eb419c11a req-ad2cf145-28db-44a6-8e81-51b5f0dca3d9 service nova] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Neutron deleted interface 19e38b07-dcc8-41aa-a433-38ca54ed0b4e; detaching it from the instance and deleting it from the info cache
Aug 14 16:44:16 user nova-compute[73056]: DEBUG nova.network.neutron [req-7e0f58b2-2780-4d4b-87ae-398eb419c11a req-ad2cf145-28db-44a6-8e81-51b5f0dca3d9 service nova] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:44:16 user nova-compute[73056]: DEBUG nova.compute.manager [req-7e0f58b2-2780-4d4b-87ae-398eb419c11a req-ad2cf145-28db-44a6-8e81-51b5f0dca3d9 service nova] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Detach interface failed, port_id=19e38b07-dcc8-41aa-a433-38ca54ed0b4e, reason: Instance 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a could not be found. {{(pid=73056) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 16:44:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-e686a575-119f-4e17-b8e5-db566de88b8f tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:44:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-e686a575-119f-4e17-b8e5-db566de88b8f tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:44:16 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-e686a575-119f-4e17-b8e5-db566de88b8f tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:44:16 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-e686a575-119f-4e17-b8e5-db566de88b8f tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:44:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-e686a575-119f-4e17-b8e5-db566de88b8f tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:44:16 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-e686a575-119f-4e17-b8e5-db566de88b8f tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Deleted allocations for instance 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a
Aug 14 16:44:17 user nova-compute[73056]: DEBUG nova.compute.manager [req-c99dd538-8fed-45c1-892d-74693500cce3 req-17db527b-c8ed-45dc-a3a7-df2e75278723 service nova] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Received event network-vif-plugged-19e38b07-dcc8-41aa-a433-38ca54ed0b4e {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:44:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c99dd538-8fed-45c1-892d-74693500cce3 req-17db527b-c8ed-45dc-a3a7-df2e75278723 service nova] Acquiring lock "1beaec7b-ecd0-4586-b4b2-b04588ce9e2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:44:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c99dd538-8fed-45c1-892d-74693500cce3 req-17db527b-c8ed-45dc-a3a7-df2e75278723 service nova] Lock "1beaec7b-ecd0-4586-b4b2-b04588ce9e2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:44:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c99dd538-8fed-45c1-892d-74693500cce3 req-17db527b-c8ed-45dc-a3a7-df2e75278723 service nova] Lock "1beaec7b-ecd0-4586-b4b2-b04588ce9e2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:44:17 user nova-compute[73056]: DEBUG nova.compute.manager [req-c99dd538-8fed-45c1-892d-74693500cce3 req-17db527b-c8ed-45dc-a3a7-df2e75278723 service nova] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] No waiting events found dispatching network-vif-plugged-19e38b07-dcc8-41aa-a433-38ca54ed0b4e {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:44:17 user nova-compute[73056]: WARNING nova.compute.manager [req-c99dd538-8fed-45c1-892d-74693500cce3 req-17db527b-c8ed-45dc-a3a7-df2e75278723 service nova] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Received unexpected event network-vif-plugged-19e38b07-dcc8-41aa-a433-38ca54ed0b4e for instance with vm_state deleted and task_state None.
Aug 14 16:44:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-e686a575-119f-4e17-b8e5-db566de88b8f tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Lock "1beaec7b-ecd0-4586-b4b2-b04588ce9e2a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.434s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:44:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:22 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Acquiring lock "4731f355-9307-4176-910b-cf35beb85e75" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:44:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lock "4731f355-9307-4176-910b-cf35beb85e75" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:44:30 user nova-compute[73056]: DEBUG nova.objects.instance [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lazy-loading 'flavor' on Instance uuid 4731f355-9307-4176-910b-cf35beb85e75 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:44:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lock "4731f355-9307-4176-910b-cf35beb85e75" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:44:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Acquiring lock "4731f355-9307-4176-910b-cf35beb85e75" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:44:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lock "4731f355-9307-4176-910b-cf35beb85e75" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:44:30 user nova-compute[73056]: INFO nova.compute.manager [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Attaching volume 1ce20211-b727-4881-a8ee-7b3093d157fd to /dev/vdb
Aug 14 16:44:30 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692031455.287258, 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:44:30 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] VM Stopped (Lifecycle Event)
Aug 14 16:44:30 user nova-compute[73056]: DEBUG nova.compute.manager [None req-bd98af28-4650-4f1d-9af3-63c9283f459a None None] [instance: 1beaec7b-ecd0-4586-b4b2-b04588ce9e2a] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:44:30 user nova-compute[73056]: DEBUG os_brick.utils [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:44:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:30 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc42b2d-33c0-4e4d-9f78-f5bcc38e1151]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:44:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:30 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[494d275a-52b0-4f40-93a1-95f75f5ee48a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:44:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:30 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6f0480-52a2-4fdc-b7c0-e3316a129a4c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:44:30 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f021df67-c2ab-4d1b-9565-b2e17dd6da24]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:44:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:44:30 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:44:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:44:30 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:44:30 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d56c72-47ce-4f18-8777-e7e63be57102]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:44:30 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:44:30 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:44:30 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:44:30 user nova-compute[73056]: DEBUG os_brick.utils [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:44:30 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Updating existing volume attachment record: fe2a10a9-0afb-4714-927e-aa471d7cf564 {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 16:44:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:37 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:38 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:44:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NDUMQuKC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:44:38 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:44:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:44:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:44:38 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:44:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:44:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:44:38 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:44:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:38 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc24a75-9af3-483a-8ea2-e4bf4d0db85b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:44:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:44:38 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[66514ead-514c-4176-ba48-05c8f08316ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd] added
Aug 14 16:44:39 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb82814-d8f6-4026-b0cd-553aaa773399]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[789f4964-0566-4e1a-8452-5a0161aa0cdc]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NDUMQuKC {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NDUMQuKC" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4a02bb-4400-44f7-a8bc-abd8e343932a]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NDUMQuKC'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[57811746-1a22-4eb1-b143-4f070139c38f]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a720e023-0549-4271-9b6a-d72f970cfae8]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a (non-flash)
Aug 14 16:44:39 user nova-compute[73056]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)
Aug 14 16:44:39 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a (non-flash)
Aug 14 16:44:39 user nova-compute[73056]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)
Aug 14 16:44:39 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[189aad52-f91e-42de-98aa-9e24d132ffb7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd, portal: 172.16.0.220,3260]
Aug 14 16:44:39 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd, portal: 172.16.0.220,3260] successful.
Aug 14 16:44:39 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4be3a43-bdb3-432a-9feb-720e13427c19]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c59e4f-ab8d-45e9-89b9-19726a13cfbb]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a (non-flash)
Aug 14 16:44:39 user nova-compute[73056]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)
Aug 14 16:44:39 user nova-compute[73056]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:44:39 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a (non-flash)
Aug 14 16:44:39 user nova-compute[73056]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)
Aug 14 16:44:39 user nova-compute[73056]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:44:39 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4e08ae-9f47-4f26-b894-1efbb52e4d88]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:44:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NDUMQuKC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:44:40 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:44:40 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23462656363623562', 'path': '/dev/sdc'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:44:40 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462656363623562', 'path': '/dev/sdc'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:44:40 user nova-compute[73056]: DEBUG nova.objects.instance [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lazy-loading 'flavor' on Instance uuid 4731f355-9307-4176-910b-cf35beb85e75 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:44:40 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 16:44:40 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:44:40 user nova-compute[73056]:   <source dev="/dev/sdc"/>
Aug 14 16:44:40 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:44:40 user nova-compute[73056]:   <serial>1ce20211-b727-4881-a8ee-7b3093d157fd</serial>
Aug 14 16:44:40 user nova-compute[73056]: </disk>
Aug 14 16:44:40 user nova-compute[73056]:  {{(pid=73056) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 16:44:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:40 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:44:40 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:44:40 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] No VIF found with MAC fa:16:3e:2d:f9:8e, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:44:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c712b62a-3d77-46be-b8d3-8750661b80db tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lock "4731f355-9307-4176-910b-cf35beb85e75" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.587s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:44:41 user nova-compute[73056]: INFO nova.compute.manager [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Rescuing
Aug 14 16:44:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Acquiring lock "refresh_cache-4731f355-9307-4176-910b-cf35beb85e75" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:44:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Acquired lock "refresh_cache-4731f355-9307-4176-910b-cf35beb85e75" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:44:41 user nova-compute[73056]: DEBUG nova.network.neutron [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:44:42 user nova-compute[73056]: DEBUG nova.network.neutron [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Updating instance_info_cache with network_info: [{"id": "83386dcc-c4f0-49aa-8bd0-43fd3b202c46", "address": "fa:16:3e:2d:f9:8e", "network": {"id": "cf5d30f2-97c6-4785-83d2-549eeb6eca88", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1151628801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd5d50a2601044b5aef50a0d0c6e311a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83386dcc-c4", "ovs_interfaceid": "83386dcc-c4f0-49aa-8bd0-43fd3b202c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:44:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Releasing lock "refresh_cache-4731f355-9307-4176-910b-cf35beb85e75" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:44:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:42 user nova-compute[73056]: DEBUG nova.compute.manager [req-ad8b41bb-15ba-4a89-ab3d-3bce5b7ea667 req-be78ce65-dbe5-4c21-97c1-9fc34be1aa5f service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Received event network-vif-unplugged-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:44:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ad8b41bb-15ba-4a89-ab3d-3bce5b7ea667 req-be78ce65-dbe5-4c21-97c1-9fc34be1aa5f service nova] Acquiring lock "4731f355-9307-4176-910b-cf35beb85e75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:44:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ad8b41bb-15ba-4a89-ab3d-3bce5b7ea667 req-be78ce65-dbe5-4c21-97c1-9fc34be1aa5f service nova] Lock "4731f355-9307-4176-910b-cf35beb85e75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:44:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ad8b41bb-15ba-4a89-ab3d-3bce5b7ea667 req-be78ce65-dbe5-4c21-97c1-9fc34be1aa5f service nova] Lock "4731f355-9307-4176-910b-cf35beb85e75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:44:42 user nova-compute[73056]: DEBUG nova.compute.manager [req-ad8b41bb-15ba-4a89-ab3d-3bce5b7ea667 req-be78ce65-dbe5-4c21-97c1-9fc34be1aa5f service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] No waiting events found dispatching network-vif-unplugged-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:44:42 user nova-compute[73056]: WARNING nova.compute.manager [req-ad8b41bb-15ba-4a89-ab3d-3bce5b7ea667 req-be78ce65-dbe5-4c21-97c1-9fc34be1aa5f service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Received unexpected event network-vif-unplugged-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 for instance with vm_state active and task_state rescuing.
Aug 14 16:44:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Acquiring lock "9c11423c-88d3-4fae-8917-c0d57021d194" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:44:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "9c11423c-88d3-4fae-8917-c0d57021d194" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:44:42 user nova-compute[73056]: DEBUG nova.objects.instance [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lazy-loading 'flavor' on Instance uuid 9c11423c-88d3-4fae-8917-c0d57021d194 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:44:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "9c11423c-88d3-4fae-8917-c0d57021d194" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:44:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Acquiring lock "9c11423c-88d3-4fae-8917-c0d57021d194" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:44:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "9c11423c-88d3-4fae-8917-c0d57021d194" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:44:43 user nova-compute[73056]: INFO nova.compute.manager [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Attaching volume 37a09be2-92fa-4429-a416-13d78c74eda0 to /dev/vdb
Aug 14 16:44:43 user nova-compute[73056]: DEBUG os_brick.utils [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:44:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:43 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad7347a-616e-4b09-9e60-947691ac09c5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:44:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:43 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Instance destroyed successfully.
Aug 14 16:44:43 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Attempting a stable device rescue
Aug 14 16:44:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:43 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d736eb-9d4f-46f6-a11f-d1507bf5439f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:44:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:43 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecc60bb-9d0c-4850-a4b3-823c3b8a7ba9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:44:43 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=73056) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 16:44:43 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b670a4-b649-43cf-bfbc-49124791cbe6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:44:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:44:43 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:44:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:43 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Instance directory exists: not creating {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 16:44:43 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Creating image(s)
Aug 14 16:44:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Acquiring lock "/opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:44:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lock "/opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:44:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lock "/opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:44:43 user nova-compute[73056]: DEBUG nova.objects.instance [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4731f355-9307-4176-910b-cf35beb85e75 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:44:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:44:43 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:44:43 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc2b55b-a1d4-4c0d-afdf-e8980b57a081]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:44:43 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:44:43 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:44:43 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:44:43 user nova-compute[73056]: DEBUG os_brick.utils [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:44:43 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Updating existing volume attachment record: cac25b65-2cc4-4f06-a250-6ab1854885e1 {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 16:44:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Acquiring lock "d8a4e28779756b2c305892f62fba2aebbda21833" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:44:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lock "d8a4e28779756b2c305892f62fba2aebbda21833" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:44:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8a4e28779756b2c305892f62fba2aebbda21833.part --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8a4e28779756b2c305892f62fba2aebbda21833.part --force-share --output=json" returned: 0 in 0.178s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:44 user nova-compute[73056]: DEBUG nova.virt.images [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] 407c0cb7-ebe5-4fb5-96b3-7a2b1608c419 was qcow2, converting to raw {{(pid=73056) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 16:44:44 user nova-compute[73056]: DEBUG nova.privsep.utils [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73056) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 16:44:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d8a4e28779756b2c305892f62fba2aebbda21833.part /opt/stack/data/nova/instances/_base/d8a4e28779756b2c305892f62fba2aebbda21833.converted {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d8a4e28779756b2c305892f62fba2aebbda21833.part /opt/stack/data/nova/instances/_base/d8a4e28779756b2c305892f62fba2aebbda21833.converted" returned: 0 in 0.273s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8a4e28779756b2c305892f62fba2aebbda21833.converted --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:44 user nova-compute[73056]: DEBUG nova.compute.manager [req-48eec42b-bca1-4db1-8bb2-aee51ed76437 req-f2a973a3-1150-434a-a648-d12f9cd4240a service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Received event network-vif-plugged-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:44:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-48eec42b-bca1-4db1-8bb2-aee51ed76437 req-f2a973a3-1150-434a-a648-d12f9cd4240a service nova] Acquiring lock "4731f355-9307-4176-910b-cf35beb85e75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:44:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-48eec42b-bca1-4db1-8bb2-aee51ed76437 req-f2a973a3-1150-434a-a648-d12f9cd4240a service nova] Lock "4731f355-9307-4176-910b-cf35beb85e75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:44:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-48eec42b-bca1-4db1-8bb2-aee51ed76437 req-f2a973a3-1150-434a-a648-d12f9cd4240a service nova] Lock "4731f355-9307-4176-910b-cf35beb85e75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:44:44 user nova-compute[73056]: DEBUG nova.compute.manager [req-48eec42b-bca1-4db1-8bb2-aee51ed76437 req-f2a973a3-1150-434a-a648-d12f9cd4240a service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] No waiting events found dispatching network-vif-plugged-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:44:44 user nova-compute[73056]: WARNING nova.compute.manager [req-48eec42b-bca1-4db1-8bb2-aee51ed76437 req-f2a973a3-1150-434a-a648-d12f9cd4240a service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Received unexpected event network-vif-plugged-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 for instance with vm_state active and task_state rescuing.
Aug 14 16:44:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8a4e28779756b2c305892f62fba2aebbda21833.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lock "d8a4e28779756b2c305892f62fba2aebbda21833" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.643s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Acquiring lock "d8a4e28779756b2c305892f62fba2aebbda21833" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lock "d8a4e28779756b2c305892f62fba2aebbda21833" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8a4e28779756b2c305892f62fba2aebbda21833 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8a4e28779756b2c305892f62fba2aebbda21833 --force-share --output=json" returned: 0 in 0.180s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8a4e28779756b2c305892f62fba2aebbda21833,backing_fmt=raw /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk.rescue {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8a4e28779756b2c305892f62fba2aebbda21833,backing_fmt=raw /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk.rescue" returned: 0 in 0.065s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lock "d8a4e28779756b2c305892f62fba2aebbda21833" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG nova.objects.instance [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lazy-loading 'migration_context' on Instance uuid 4731f355-9307-4176-910b-cf35beb85e75 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Start _get_guest_xml network_info=[{"id": "83386dcc-c4f0-49aa-8bd0-43fd3b202c46", "address": "fa:16:3e:2d:f9:8e", "network": {"id": "cf5d30f2-97c6-4785-83d2-549eeb6eca88", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1151628801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1151628801-network", "vif_mac": "fa:16:3e:2d:f9:8e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd5d50a2601044b5aef50a0d0c6e311a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83386dcc-c4", "ovs_interfaceid": "83386dcc-c4f0-49aa-8bd0-43fd3b202c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '407c0cb7-ebe5-4fb5-96b3-7a2b1608c419', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NDUMQuKC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '4731f355-9307-4176-910b-cf35beb85e75', 'attached_at': '', 'detached_at': '', 'volume_id': '1ce20211-b727-4881-a8ee-7b3093d157fd', 'serial': '1ce20211-b727-4881-a8ee-7b3093d157fd'}, 'attachment_id': 'fe2a10a9-0afb-4714-927e-aa471d7cf564', 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG nova.objects.instance [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lazy-loading 'resources' on Instance uuid 4731f355-9307-4176-910b-cf35beb85e75 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG nova.objects.instance [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lazy-loading 'numa_topology' on Instance uuid 4731f355-9307-4176-910b-cf35beb85e75 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:44:45 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:44:45 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:44:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG nova.objects.instance [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4731f355-9307-4176-910b-cf35beb85e75 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NDUMQuKC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:44:45 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:44:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:44:45 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:44:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:44:45 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:44:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa606848-57a6-4025-b1f9-6d782941b572]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = NDUMQuKC\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 14 16:44:45 user nova-compute[73056]: node.name = iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd
Aug 14 16:44:45 user nova-compute[73056]: node.tpgt = -1
Aug 14 16:44:45 user nova-compute[73056]: node.startup = automatic
Aug 14 16:44:45 user nova-compute[73056]: node.leading_login = No
Aug 14 16:44:45 user nova-compute[73056]: iface.iscsi_ifacename = default
Aug 14 16:44:45 user nova-compute[73056]: iface.net_ifacename = <empty>
Aug 14 16:44:45 user nova-compute[73056]: iface.ipaddress = <empty>
Aug 14 16:44:45 user nova-compute[73056]: iface.prefix_len = 0
Aug 14 16:44:45 user nova-compute[73056]: iface.hwaddress = <empty>
Aug 14 16:44:45 user nova-compute[73056]: iface.transport_name = tcp
Aug 14 16:44:45 user nova-compute[73056]: iface.initiatorname = <empty>
Aug 14 16:44:45 user nova-compute[73056]: iface.state = <empty>
Aug 14 16:44:45 user nova-compute[73056]: iface.vlan_id = 0
Aug 14 16:44:45 user nova-compute[73056]: iface.vlan_priority = 0
Aug 14 16:44:45 user nova-compute[73056]: iface.vlan_state = <empty>
Aug 14 16:44:45 user nova-compute[73056]: iface.iface_num = 0
Aug 14 16:44:45 user nova-compute[73056]: iface.mtu = 0
Aug 14 16:44:45 user nova-compute[73056]: iface.port = 0
Aug 14 16:44:45 user nova-compute[73056]: iface.bootproto = <empty>
Aug 14 16:44:45 user nova-compute[73056]: iface.subnet_mask = <empty>
Aug 14 16:44:45 user nova-compute[73056]: iface.gateway = <empty>
Aug 14 16:44:45 user nova-compute[73056]: iface.dhcp_alt_client_id_state = <empty>
Aug 14 16:44:45 user nova-compute[73056]: iface.dhcp_alt_client_id = <empty>
Aug 14 16:44:45 user nova-compute[73056]: iface.dhcp_dns = <empty>
Aug 14 16:44:45 user nova-compute[73056]: iface.dhcp_learn_iqn = <empty>
Aug 14 16:44:45 user nova-compute[73056]: iface.dhcp_req_vendor_id_state = <empty>
Aug 14 16:44:45 user nova-compute[73056]: iface.dhcp_vendor_id_state = <empty>
Aug 14 16:44:45 user nova-compute[73056]: iface.dhcp_vendor_id = <empty>
Aug 14 16:44:45 user nova-compute[73056]: iface.dhcp_slp_da = <empty>
Aug 14 16:44:45 user nova-compute[73056]: iface.fragmentation = <empty>
Aug 14 16:44:45 user nova-compute[73056]: iface.gratuitous_arp = <empty>
Aug 14 16:44:45 user nova-compute[73056]: iface.incoming_forwarding = <empty>
Aug 14 16:44:45 user nova-compute[73056]: iface.tos_state = <empty>
Aug 14 16:44:45 user nova-compute[73056]: iface.tos = 0
Aug 14 16:44:45 user nova-compute[73056]: iface.ttl = 0
Aug 14 16:44:45 user nova-compute[73056]: iface.delayed_ack = <empty>
Aug 14 16:44:45 user nova-compute[73056]: iface.tcp_nagle = <empty>
Aug 14 16:44:45 user nova-compute[73056]: iface.tcp_wsf_state = <empty>
Aug 14 16:44:45 user nova-compute[73056]: iface.tcp_wsf = 0
Aug 14 16:44:45 user nova-compute[73056]: iface.tcp_timer_scale = 0
Aug 14 16:44:45 user nova-compute[73056]: iface.tcp_timestamp = <empty>
Aug 14 16:44:45 user nova-compute[73056]: iface.redirect = <empty>
Aug 14 16:44:45 user nova-compute[73056]: iface.def_task_mgmt_timeout = 0
Aug 14 16:44:45 user nova-compute[73056]: iface.header_digest = <empty>
Aug 14 16:44:45 user nova-compute[73056]: iface.data_digest = <empty>
Aug 14 16:44:45 user nova-compute[73056]: iface.immediate_data = <empty>
Aug 14 16:44:45 user nova-compute[73056]: iface.initial_r2t = <empty>
Aug 14 16:44:45 user nova-compute[73056]: iface.data_seq_inorder = <empty>
Aug 14 16:44:45 user nova-compute[73056]: iface.data_pdu_inorder = <empty>
Aug 14 16:44:45 user nova-compute[73056]: iface.erl = 0
Aug 14 16:44:45 user nova-compute[73056]: iface.max_receive_data_len = 0
Aug 14 16:44:45 user nova-compute[73056]: iface.first_burst_len = 0
Aug 14 16:44:45 user nova-compute[73056]: iface.max_outstanding_r2t = 0
Aug 14 16:44:45 user nova-compute[73056]: iface.max_burst_len = 0
Aug 14 16:44:45 user nova-compute[73056]: iface.chap_auth = <empty>
Aug 14 16:44:45 user nova-compute[73056]: iface.bidi_chap = <empty>
Aug 14 16:44:45 user nova-compute[73056]: iface.strict_login_compliance = <empty>
Aug 14 16:44:45 user nova-compute[73056]: iface.discovery_auth = <empty>
Aug 14 16:44:45 user nova-compute[73056]: iface.discovery_logout = <empty>
Aug 14 16:44:45 user nova-compute[73056]: node.discovery_address = <empty>
Aug 14 16:44:45 user nova-compute[73056]: node.discovery_port = 0
Aug 14 16:44:45 user nova-compute[73056]: node.discovery_type = static
Aug 14 16:44:45 user nova-compute[73056]: node.session.initial_cmdsn = 0
Aug 14 16:44:45 user nova-compute[73056]: node.session.initial_login_retry_max = 8
Aug 14 16:44:45 user nova-compute[73056]: node.session.xmit_thread_priority = -20
Aug 14 16:44:45 user nova-compute[73056]: node.session.cmds_max = 128
Aug 14 16:44:45 user nova-compute[73056]: node.session.queue_depth = 32
Aug 14 16:44:45 user nova-compute[73056]: node.session.nr_sessions = 1
Aug 14 16:44:45 user nova-compute[73056]: node.session.auth.authmethod = CHAP
Aug 14 16:44:45 user nova-compute[73056]: node.session.auth.username = NDUMQuKC
Aug 14 16:44:45 user nova-compute[73056]: node.session.auth.password = ***
Aug 14 16:44:45 user nova-compute[73056]: node.session.auth.username_in = <empty>
Aug 14 16:44:45 user nova-compute[73056]: node.session.auth.password_in = <empty>
Aug 14 16:44:45 user nova-compute[73056]: node.session.auth.chap_algs = MD5
Aug 14 16:44:45 user nova-compute[73056]: node.session.timeo.replacement_timeout = 120
Aug 14 16:44:45 user nova-compute[73056]: node.session.err_timeo.abort_timeout = 15
Aug 14 16:44:45 user nova-compute[73056]: node.session.err_timeo.lu_reset_timeout = 30
Aug 14 16:44:45 user nova-compute[73056]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 14 16:44:45 user nova-compute[73056]: node.session.err_timeo.host_reset_timeout = 60
Aug 14 16:44:45 user nova-compute[73056]: node.session.iscsi.FastAbort = Yes
Aug 14 16:44:45 user nova-compute[73056]: node.session.iscsi.InitialR2T = No
Aug 14 16:44:45 user nova-compute[73056]: node.session.iscsi.ImmediateData = Yes
Aug 14 16:44:45 user nova-compute[73056]: node.session.iscsi.FirstBurstLength = 262144
Aug 14 16:44:45 user nova-compute[73056]: node.session.iscsi.MaxBurstLength = 16776192
Aug 14 16:44:45 user nova-compute[73056]: node.session.iscsi.DefaultTime2Retain = 0
Aug 14 16:44:45 user nova-compute[73056]: node.session.iscsi.DefaultTime2Wait = 2
Aug 14 16:44:45 user nova-compute[73056]: node.session.iscsi.MaxConnections = 1
Aug 14 16:44:45 user nova-compute[73056]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 14 16:44:45 user nova-compute[73056]: node.session.iscsi.ERL = 0
Aug 14 16:44:45 user nova-compute[73056]: node.session.scan = manual
Aug 14 16:44:45 user nova-compute[73056]: node.session.reopen_max = 0
Aug 14 16:44:45 user nova-compute[73056]: node.conn[0].address = 172.16.0.220
Aug 14 16:44:45 user nova-compute[73056]: node.conn[0].port = 3260
Aug 14 16:44:45 user nova-compute[73056]: node.conn[0].startup = manual
Aug 14 16:44:45 user nova-compute[73056]: node.conn[0].tcp.window_size = 524288
Aug 14 16:44:45 user nova-compute[73056]: node.conn[0].tcp.type_of_service = 0
Aug 14 16:44:45 user nova-compute[73056]: node.conn[0].timeo.logout_timeout = 15
Aug 14 16:44:45 user nova-compute[73056]: node.conn[0].timeo.login_timeout = 15
Aug 14 16:44:45 user nova-compute[73056]: node.conn[0].timeo.auth_timeout = 45
Aug 14 16:44:45 user nova-compute[73056]: node.conn[0].timeo.noop_out_interval = 5
Aug 14 16:44:45 user nova-compute[73056]: node.conn[0].timeo.noop_out_timeout = 5
Aug 14 16:44:45 user nova-compute[73056]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 14 16:44:45 user nova-compute[73056]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 14 16:44:45 user nova-compute[73056]: node.conn[0].iscsi.HeaderDigest = None
Aug 14 16:44:45 user nova-compute[73056]: node.conn[0].iscsi.DataDigest = None
Aug 14 16:44:45 user nova-compute[73056]: node.conn[0].iscsi.IFMarker = No
Aug 14 16:44:45 user nova-compute[73056]: node.conn[0].iscsi.OFMarker = No
Aug 14 16:44:45 user nova-compute[73056]: # END RECORD
Aug 14 16:44:45 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b28eb7-7508-4d63-95f2-12137ea9d9dc]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f1bb13-b6fc-4864-983d-fafe32670713]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NDUMQuKC {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NDUMQuKC" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a7c9c8-1a4f-4d1b-a60e-03cc2ab17f9f]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NDUMQuKC'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddb92b9-3093-44bb-b78b-2607847eef44]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04b075b-00d7-47df-9a8e-e3b94057b584]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a (non-flash)
Aug 14 16:44:45 user nova-compute[73056]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)
Aug 14 16:44:45 user nova-compute[73056]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:44:45 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a (non-flash)
Aug 14 16:44:45 user nova-compute[73056]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)
Aug 14 16:44:45 user nova-compute[73056]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:44:45 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.153s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] HCTL ('34', '0', '0', 0) found on session 25 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc9adf2-e26c-4ec1-8c18-71d6c72a2c81]: (4, ('0 0 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Searching for a device in session 25 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NDUMQuKC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.176s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] <== connect_volume: return (177ms) {'type': 'block', 'scsi_wwn': '23462656363623562', 'path': '/dev/sdc'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462656363623562', 'path': '/dev/sdc'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1469159950',display_name='tempest-ServerStableDeviceRescueTest-server-1469159950',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1469159950',id=15,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBQNxWg7OUFhWDQI9/wLnHn2nbEn9G6E26h3WdcqE+rXscJRVMjpTW2ni6zhMvgbqQhJ+9ECYhu3ChirXTVDZRVv933jeqBHwG9oVjz7+R20pljc2XSQT8462fqM4Z3mA==',key_name='tempest-keypair-610798452',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:40:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd5d50a2601044b5aef50a0d0c6e311a',ramdisk_id='',reservation_id='r-hqhusr42',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-759559269',owner_user_name='tempest-ServerStableDeviceRescueTest-759559269-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:42:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3fcea40a59c402ca0fa47cadc0c0e98',uuid=4731f355-9307-4176-910b-cf35beb85e75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83386dcc-c4f0-49aa-8bd0-43fd3b202c46", "address": "fa:16:3e:2d:f9:8e", "network": {"id": "cf5d30f2-97c6-4785-83d2-549eeb6eca88", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1151628801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1151628801-network", "vif_mac": "fa:16:3e:2d:f9:8e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd5d50a2601044b5aef50a0d0c6e311a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83386dcc-c4", "ovs_interfaceid": "83386dcc-c4f0-49aa-8bd0-43fd3b202c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Converting VIF {"id": "83386dcc-c4f0-49aa-8bd0-43fd3b202c46", "address": "fa:16:3e:2d:f9:8e", "network": {"id": "cf5d30f2-97c6-4785-83d2-549eeb6eca88", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1151628801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1151628801-network", "vif_mac": "fa:16:3e:2d:f9:8e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd5d50a2601044b5aef50a0d0c6e311a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83386dcc-c4", "ovs_interfaceid": "83386dcc-c4f0-49aa-8bd0-43fd3b202c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:f9:8e,bridge_name='br-int',has_traffic_filtering=True,id=83386dcc-c4f0-49aa-8bd0-43fd3b202c46,network=Network(cf5d30f2-97c6-4785-83d2-549eeb6eca88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83386dcc-c4') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG nova.objects.instance [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lazy-loading 'pci_devices' on Instance uuid 4731f355-9307-4176-910b-cf35beb85e75 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:44:45 user nova-compute[73056]:   <uuid>4731f355-9307-4176-910b-cf35beb85e75</uuid>
Aug 14 16:44:45 user nova-compute[73056]:   <name>instance-0000000f</name>
Aug 14 16:44:45 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:44:45 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:44:45 user nova-compute[73056]:   <metadata>
Aug 14 16:44:45 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:44:45 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:44:45 user nova-compute[73056]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1469159950</nova:name>
Aug 14 16:44:45 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:44:45</nova:creationTime>
Aug 14 16:44:45 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:44:45 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:44:45 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:44:45 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:44:45 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:44:45 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:44:45 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:44:45 user nova-compute[73056]:       <nova:owner>
Aug 14 16:44:45 user nova-compute[73056]:         <nova:user uuid="a3fcea40a59c402ca0fa47cadc0c0e98">tempest-ServerStableDeviceRescueTest-759559269-project-member</nova:user>
Aug 14 16:44:45 user nova-compute[73056]:         <nova:project uuid="dd5d50a2601044b5aef50a0d0c6e311a">tempest-ServerStableDeviceRescueTest-759559269</nova:project>
Aug 14 16:44:45 user nova-compute[73056]:       </nova:owner>
Aug 14 16:44:45 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:44:45 user nova-compute[73056]:       <nova:ports>
Aug 14 16:44:45 user nova-compute[73056]:         <nova:port uuid="83386dcc-c4f0-49aa-8bd0-43fd3b202c46">
Aug 14 16:44:45 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 14 16:44:45 user nova-compute[73056]:         </nova:port>
Aug 14 16:44:45 user nova-compute[73056]:       </nova:ports>
Aug 14 16:44:45 user nova-compute[73056]:     </nova:instance>
Aug 14 16:44:45 user nova-compute[73056]:   </metadata>
Aug 14 16:44:45 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:44:45 user nova-compute[73056]:     <system>
Aug 14 16:44:45 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:44:45 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:44:45 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:44:45 user nova-compute[73056]:       <entry name="serial">4731f355-9307-4176-910b-cf35beb85e75</entry>
Aug 14 16:44:45 user nova-compute[73056]:       <entry name="uuid">4731f355-9307-4176-910b-cf35beb85e75</entry>
Aug 14 16:44:45 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:44:45 user nova-compute[73056]:     </system>
Aug 14 16:44:45 user nova-compute[73056]:   </sysinfo>
Aug 14 16:44:45 user nova-compute[73056]:   <os>
Aug 14 16:44:45 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:44:45 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:44:45 user nova-compute[73056]:   </os>
Aug 14 16:44:45 user nova-compute[73056]:   <features>
Aug 14 16:44:45 user nova-compute[73056]:     <acpi/>
Aug 14 16:44:45 user nova-compute[73056]:     <apic/>
Aug 14 16:44:45 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:44:45 user nova-compute[73056]:   </features>
Aug 14 16:44:45 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:44:45 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:44:45 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:44:45 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:44:45 user nova-compute[73056]:   </clock>
Aug 14 16:44:45 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:44:45 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:44:45 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:44:45 user nova-compute[73056]:   </cpu>
Aug 14 16:44:45 user nova-compute[73056]:   <devices>
Aug 14 16:44:45 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:44:45 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:44:45 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk"/>
Aug 14 16:44:45 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:44:45 user nova-compute[73056]:     </disk>
Aug 14 16:44:45 user nova-compute[73056]:     <disk type="block" device="disk">
Aug 14 16:44:45 user nova-compute[73056]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:44:45 user nova-compute[73056]:       <source dev="/dev/sdc"/>
Aug 14 16:44:45 user nova-compute[73056]:       <target dev="vdb" bus="virtio"/>
Aug 14 16:44:45 user nova-compute[73056]:       <serial>1ce20211-b727-4881-a8ee-7b3093d157fd</serial>
Aug 14 16:44:45 user nova-compute[73056]:     </disk>
Aug 14 16:44:45 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:44:45 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:44:45 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk.rescue"/>
Aug 14 16:44:45 user nova-compute[73056]:       <target dev="vdc" bus="virtio"/>
Aug 14 16:44:45 user nova-compute[73056]:       <boot order="1"/>
Aug 14 16:44:45 user nova-compute[73056]:     </disk>
Aug 14 16:44:45 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:44:45 user nova-compute[73056]:       <mac address="fa:16:3e:2d:f9:8e"/>
Aug 14 16:44:45 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:44:45 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:44:45 user nova-compute[73056]:       <target dev="tap83386dcc-c4"/>
Aug 14 16:44:45 user nova-compute[73056]:     </interface>
Aug 14 16:44:45 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:44:45 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/console.log" append="off"/>
Aug 14 16:44:45 user nova-compute[73056]:     </serial>
Aug 14 16:44:45 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:44:45 user nova-compute[73056]:     <video>
Aug 14 16:44:45 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:44:45 user nova-compute[73056]:     </video>
Aug 14 16:44:45 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:44:45 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:44:45 user nova-compute[73056]:     </rng>
Aug 14 16:44:45 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:44:45 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:44:45 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:44:45 user nova-compute[73056]:     </memballoon>
Aug 14 16:44:45 user nova-compute[73056]:   </devices>
Aug 14 16:44:45 user nova-compute[73056]: </domain>
Aug 14 16:44:45 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:44:45 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Instance destroyed successfully.
Aug 14 16:44:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:44:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] No VIF found with MAC fa:16:3e:2d:f9:8e, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:44:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:47 user nova-compute[73056]: DEBUG nova.compute.manager [req-262beb0d-4860-49a2-9c93-e8f9393410f8 req-ae6a16ec-5222-4a52-80e4-880a9e77c0b5 service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Received event network-vif-plugged-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:44:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-262beb0d-4860-49a2-9c93-e8f9393410f8 req-ae6a16ec-5222-4a52-80e4-880a9e77c0b5 service nova] Acquiring lock "4731f355-9307-4176-910b-cf35beb85e75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:44:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-262beb0d-4860-49a2-9c93-e8f9393410f8 req-ae6a16ec-5222-4a52-80e4-880a9e77c0b5 service nova] Lock "4731f355-9307-4176-910b-cf35beb85e75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:44:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-262beb0d-4860-49a2-9c93-e8f9393410f8 req-ae6a16ec-5222-4a52-80e4-880a9e77c0b5 service nova] Lock "4731f355-9307-4176-910b-cf35beb85e75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:44:47 user nova-compute[73056]: DEBUG nova.compute.manager [req-262beb0d-4860-49a2-9c93-e8f9393410f8 req-ae6a16ec-5222-4a52-80e4-880a9e77c0b5 service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] No waiting events found dispatching network-vif-plugged-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:44:47 user nova-compute[73056]: WARNING nova.compute.manager [req-262beb0d-4860-49a2-9c93-e8f9393410f8 req-ae6a16ec-5222-4a52-80e4-880a9e77c0b5 service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Received unexpected event network-vif-plugged-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 for instance with vm_state active and task_state rescuing.
Aug 14 16:44:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6c89ddaf-30d6-46f6-9bb4-5ed38fbeb06f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:44:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6c89ddaf-30d6-46f6-9bb4-5ed38fbeb06f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:44:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6c89ddaf-30d6-46f6-9bb4-5ed38fbeb06f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:44:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6c89ddaf-30d6-46f6-9bb4-5ed38fbeb06f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:44:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6c89ddaf-30d6-46f6-9bb4-5ed38fbeb06f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:44:49 user nova-compute[73056]: INFO nova.compute.manager [None req-6c89ddaf-30d6-46f6-9bb4-5ed38fbeb06f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Terminating instance
Aug 14 16:44:49 user nova-compute[73056]: DEBUG nova.compute.manager [None req-6c89ddaf-30d6-46f6-9bb4-5ed38fbeb06f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 16:44:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:49 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Removed pending event for 4731f355-9307-4176-910b-cf35beb85e75 due to event {{(pid=73056) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 16:44:49 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031489.4786553, 4731f355-9307-4176-910b-cf35beb85e75 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:44:49 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 4731f355-9307-4176-910b-cf35beb85e75] VM Resumed (Lifecycle Event)
Aug 14 16:44:49 user nova-compute[73056]: DEBUG nova.compute.manager [None req-a7cd099b-199a-4f5a-849d-91c49d21d957 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:44:49 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:44:49 user nova-compute[73056]: DEBUG nova.compute.manager [req-242a7928-2273-4754-935b-61e43076754a req-ede3b749-da45-42fb-96ce-d78f38b41d6c service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Received event network-vif-plugged-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:44:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-242a7928-2273-4754-935b-61e43076754a req-ede3b749-da45-42fb-96ce-d78f38b41d6c service nova] Acquiring lock "4731f355-9307-4176-910b-cf35beb85e75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:44:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-242a7928-2273-4754-935b-61e43076754a req-ede3b749-da45-42fb-96ce-d78f38b41d6c service nova] Lock "4731f355-9307-4176-910b-cf35beb85e75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:44:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-242a7928-2273-4754-935b-61e43076754a req-ede3b749-da45-42fb-96ce-d78f38b41d6c service nova] Lock "4731f355-9307-4176-910b-cf35beb85e75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:44:49 user nova-compute[73056]: DEBUG nova.compute.manager [req-242a7928-2273-4754-935b-61e43076754a req-ede3b749-da45-42fb-96ce-d78f38b41d6c service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] No waiting events found dispatching network-vif-plugged-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:44:49 user nova-compute[73056]: WARNING nova.compute.manager [req-242a7928-2273-4754-935b-61e43076754a req-ede3b749-da45-42fb-96ce-d78f38b41d6c service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Received unexpected event network-vif-plugged-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 for instance with vm_state active and task_state rescuing.
Aug 14 16:44:49 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:44:49 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 4731f355-9307-4176-910b-cf35beb85e75] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 16:44:49 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031489.4813514, 4731f355-9307-4176-910b-cf35beb85e75 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:44:49 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 4731f355-9307-4176-910b-cf35beb85e75] VM Started (Lifecycle Event)
Aug 14 16:44:49 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:44:49 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:44:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:50 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Instance destroyed successfully.
Aug 14 16:44:50 user nova-compute[73056]: DEBUG nova.objects.instance [None req-6c89ddaf-30d6-46f6-9bb4-5ed38fbeb06f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lazy-loading 'resources' on Instance uuid 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:44:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-6c89ddaf-30d6-46f6-9bb4-5ed38fbeb06f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T16:38:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1424363203',display_name='tempest-ServerActionsTestOtherA-server-1074934452',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1424363203',id=12,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzrXyeuWZXAQJXaMndVYP8YLJJO4IYhi0DtFWiIOZyO1xgLu2NdayGj34gx2+069d0uD51u6mLg7wO65+6tBrUyZO5VP+z88aMjR2XH1fCtm3ZNL2N1XZkwSHRBMKbi2w==',key_name='tempest-keypair-417234224',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:41:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2dd5723fb8384aa985cf401d95aa7d08',ramdisk_id='',reservation_id='r-ueazm8wy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-380813086',owner_user_name='tempest-ServerActionsTestOtherA-380813086-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:41:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9404ed7386e14eed8d046e8c45942c75',uuid=5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2e32544-47df-43ff-ae83-c30388d9d618", "address": "fa:16:3e:9d:43:1e", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2e32544-47", "ovs_interfaceid": "c2e32544-47df-43ff-ae83-c30388d9d618", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:44:50 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-6c89ddaf-30d6-46f6-9bb4-5ed38fbeb06f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Converting VIF {"id": "c2e32544-47df-43ff-ae83-c30388d9d618", "address": "fa:16:3e:9d:43:1e", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2e32544-47", "ovs_interfaceid": "c2e32544-47df-43ff-ae83-c30388d9d618", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:44:50 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-6c89ddaf-30d6-46f6-9bb4-5ed38fbeb06f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:43:1e,bridge_name='br-int',has_traffic_filtering=True,id=c2e32544-47df-43ff-ae83-c30388d9d618,network=Network(2c5f0d57-9485-4a0b-a847-49eea5cd17c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2e32544-47') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:44:50 user nova-compute[73056]: DEBUG os_vif [None req-6c89ddaf-30d6-46f6-9bb4-5ed38fbeb06f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:43:1e,bridge_name='br-int',has_traffic_filtering=True,id=c2e32544-47df-43ff-ae83-c30388d9d618,network=Network(2c5f0d57-9485-4a0b-a847-49eea5cd17c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2e32544-47') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:44:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2e32544-47, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:44:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:44:50 user nova-compute[73056]: INFO os_vif [None req-6c89ddaf-30d6-46f6-9bb4-5ed38fbeb06f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:43:1e,bridge_name='br-int',has_traffic_filtering=True,id=c2e32544-47df-43ff-ae83-c30388d9d618,network=Network(2c5f0d57-9485-4a0b-a847-49eea5cd17c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2e32544-47')
Aug 14 16:44:50 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-6c89ddaf-30d6-46f6-9bb4-5ed38fbeb06f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Deleting instance files /opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8_del
Aug 14 16:44:50 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-6c89ddaf-30d6-46f6-9bb4-5ed38fbeb06f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Deletion of /opt/stack/data/nova/instances/5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8_del complete
Aug 14 16:44:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:50 user nova-compute[73056]: INFO nova.compute.manager [None req-6c89ddaf-30d6-46f6-9bb4-5ed38fbeb06f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 14 16:44:50 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-6c89ddaf-30d6-46f6-9bb4-5ed38fbeb06f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 16:44:50 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 16:44:50 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 16:44:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-ea03e57f-0556-490c-bb01-8b5f7ec435b9 req-3abad98a-b71c-4245-b22b-57082be3d763 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Received event network-vif-unplugged-c2e32544-47df-43ff-ae83-c30388d9d618 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:44:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ea03e57f-0556-490c-bb01-8b5f7ec435b9 req-3abad98a-b71c-4245-b22b-57082be3d763 service nova] Acquiring lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:44:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ea03e57f-0556-490c-bb01-8b5f7ec435b9 req-3abad98a-b71c-4245-b22b-57082be3d763 service nova] Lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:44:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ea03e57f-0556-490c-bb01-8b5f7ec435b9 req-3abad98a-b71c-4245-b22b-57082be3d763 service nova] Lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:44:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-ea03e57f-0556-490c-bb01-8b5f7ec435b9 req-3abad98a-b71c-4245-b22b-57082be3d763 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] No waiting events found dispatching network-vif-unplugged-c2e32544-47df-43ff-ae83-c30388d9d618 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:44:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-ea03e57f-0556-490c-bb01-8b5f7ec435b9 req-3abad98a-b71c-4245-b22b-57082be3d763 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Received event network-vif-unplugged-c2e32544-47df-43ff-ae83-c30388d9d618 for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:44:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-ea03e57f-0556-490c-bb01-8b5f7ec435b9 req-3abad98a-b71c-4245-b22b-57082be3d763 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Received event network-vif-plugged-c2e32544-47df-43ff-ae83-c30388d9d618 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:44:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ea03e57f-0556-490c-bb01-8b5f7ec435b9 req-3abad98a-b71c-4245-b22b-57082be3d763 service nova] Acquiring lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:44:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ea03e57f-0556-490c-bb01-8b5f7ec435b9 req-3abad98a-b71c-4245-b22b-57082be3d763 service nova] Lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:44:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ea03e57f-0556-490c-bb01-8b5f7ec435b9 req-3abad98a-b71c-4245-b22b-57082be3d763 service nova] Lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:44:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-ea03e57f-0556-490c-bb01-8b5f7ec435b9 req-3abad98a-b71c-4245-b22b-57082be3d763 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] No waiting events found dispatching network-vif-plugged-c2e32544-47df-43ff-ae83-c30388d9d618 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:44:51 user nova-compute[73056]: WARNING nova.compute.manager [req-ea03e57f-0556-490c-bb01-8b5f7ec435b9 req-3abad98a-b71c-4245-b22b-57082be3d763 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Received unexpected event network-vif-plugged-c2e32544-47df-43ff-ae83-c30388d9d618 for instance with vm_state active and task_state deleting.
Aug 14 16:44:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-ea03e57f-0556-490c-bb01-8b5f7ec435b9 req-3abad98a-b71c-4245-b22b-57082be3d763 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Received event network-vif-plugged-c2e32544-47df-43ff-ae83-c30388d9d618 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:44:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ea03e57f-0556-490c-bb01-8b5f7ec435b9 req-3abad98a-b71c-4245-b22b-57082be3d763 service nova] Acquiring lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:44:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ea03e57f-0556-490c-bb01-8b5f7ec435b9 req-3abad98a-b71c-4245-b22b-57082be3d763 service nova] Lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:44:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ea03e57f-0556-490c-bb01-8b5f7ec435b9 req-3abad98a-b71c-4245-b22b-57082be3d763 service nova] Lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:44:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-ea03e57f-0556-490c-bb01-8b5f7ec435b9 req-3abad98a-b71c-4245-b22b-57082be3d763 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] No waiting events found dispatching network-vif-plugged-c2e32544-47df-43ff-ae83-c30388d9d618 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:44:51 user nova-compute[73056]: WARNING nova.compute.manager [req-ea03e57f-0556-490c-bb01-8b5f7ec435b9 req-3abad98a-b71c-4245-b22b-57082be3d763 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Received unexpected event network-vif-plugged-c2e32544-47df-43ff-ae83-c30388d9d618 for instance with vm_state active and task_state deleting.
Aug 14 16:44:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-ea03e57f-0556-490c-bb01-8b5f7ec435b9 req-3abad98a-b71c-4245-b22b-57082be3d763 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Received event network-vif-plugged-c2e32544-47df-43ff-ae83-c30388d9d618 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:44:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ea03e57f-0556-490c-bb01-8b5f7ec435b9 req-3abad98a-b71c-4245-b22b-57082be3d763 service nova] Acquiring lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:44:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ea03e57f-0556-490c-bb01-8b5f7ec435b9 req-3abad98a-b71c-4245-b22b-57082be3d763 service nova] Lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:44:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ea03e57f-0556-490c-bb01-8b5f7ec435b9 req-3abad98a-b71c-4245-b22b-57082be3d763 service nova] Lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:44:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-ea03e57f-0556-490c-bb01-8b5f7ec435b9 req-3abad98a-b71c-4245-b22b-57082be3d763 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] No waiting events found dispatching network-vif-plugged-c2e32544-47df-43ff-ae83-c30388d9d618 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:44:51 user nova-compute[73056]: WARNING nova.compute.manager [req-ea03e57f-0556-490c-bb01-8b5f7ec435b9 req-3abad98a-b71c-4245-b22b-57082be3d763 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Received unexpected event network-vif-plugged-c2e32544-47df-43ff-ae83-c30388d9d618 for instance with vm_state active and task_state deleting.
Aug 14 16:44:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-ea03e57f-0556-490c-bb01-8b5f7ec435b9 req-3abad98a-b71c-4245-b22b-57082be3d763 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Received event network-vif-unplugged-c2e32544-47df-43ff-ae83-c30388d9d618 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:44:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ea03e57f-0556-490c-bb01-8b5f7ec435b9 req-3abad98a-b71c-4245-b22b-57082be3d763 service nova] Acquiring lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:44:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ea03e57f-0556-490c-bb01-8b5f7ec435b9 req-3abad98a-b71c-4245-b22b-57082be3d763 service nova] Lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:44:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ea03e57f-0556-490c-bb01-8b5f7ec435b9 req-3abad98a-b71c-4245-b22b-57082be3d763 service nova] Lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:44:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-ea03e57f-0556-490c-bb01-8b5f7ec435b9 req-3abad98a-b71c-4245-b22b-57082be3d763 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] No waiting events found dispatching network-vif-unplugged-c2e32544-47df-43ff-ae83-c30388d9d618 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:44:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-ea03e57f-0556-490c-bb01-8b5f7ec435b9 req-3abad98a-b71c-4245-b22b-57082be3d763 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Received event network-vif-unplugged-c2e32544-47df-43ff-ae83-c30388d9d618 for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:44:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-ea03e57f-0556-490c-bb01-8b5f7ec435b9 req-3abad98a-b71c-4245-b22b-57082be3d763 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Received event network-vif-plugged-c2e32544-47df-43ff-ae83-c30388d9d618 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:44:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ea03e57f-0556-490c-bb01-8b5f7ec435b9 req-3abad98a-b71c-4245-b22b-57082be3d763 service nova] Acquiring lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:44:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ea03e57f-0556-490c-bb01-8b5f7ec435b9 req-3abad98a-b71c-4245-b22b-57082be3d763 service nova] Lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:44:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ea03e57f-0556-490c-bb01-8b5f7ec435b9 req-3abad98a-b71c-4245-b22b-57082be3d763 service nova] Lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:44:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-ea03e57f-0556-490c-bb01-8b5f7ec435b9 req-3abad98a-b71c-4245-b22b-57082be3d763 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] No waiting events found dispatching network-vif-plugged-c2e32544-47df-43ff-ae83-c30388d9d618 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:44:51 user nova-compute[73056]: WARNING nova.compute.manager [req-ea03e57f-0556-490c-bb01-8b5f7ec435b9 req-3abad98a-b71c-4245-b22b-57082be3d763 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Received unexpected event network-vif-plugged-c2e32544-47df-43ff-ae83-c30388d9d618 for instance with vm_state active and task_state deleting.
Aug 14 16:44:51 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:44:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-dd6e6a32-2f59-49b5-bf02-a009426e95ab req-6e7fa46d-27a6-43f6-83ee-b169b671f651 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Received event network-vif-deleted-c2e32544-47df-43ff-ae83-c30388d9d618 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:44:51 user nova-compute[73056]: INFO nova.compute.manager [req-dd6e6a32-2f59-49b5-bf02-a009426e95ab req-6e7fa46d-27a6-43f6-83ee-b169b671f651 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Neutron deleted interface c2e32544-47df-43ff-ae83-c30388d9d618; detaching it from the instance and deleting it from the info cache
Aug 14 16:44:51 user nova-compute[73056]: DEBUG nova.network.neutron [req-dd6e6a32-2f59-49b5-bf02-a009426e95ab req-6e7fa46d-27a6-43f6-83ee-b169b671f651 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:44:51 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Took 1.31 seconds to deallocate network for instance.
Aug 14 16:44:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-dd6e6a32-2f59-49b5-bf02-a009426e95ab req-6e7fa46d-27a6-43f6-83ee-b169b671f651 service nova] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Detach interface failed, port_id=c2e32544-47df-43ff-ae83-c30388d9d618, reason: Instance 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8 could not be found. {{(pid=73056) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 16:44:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6c89ddaf-30d6-46f6-9bb4-5ed38fbeb06f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:44:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6c89ddaf-30d6-46f6-9bb4-5ed38fbeb06f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:44:52 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-6c89ddaf-30d6-46f6-9bb4-5ed38fbeb06f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:44:52 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-6c89ddaf-30d6-46f6-9bb4-5ed38fbeb06f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:44:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6c89ddaf-30d6-46f6-9bb4-5ed38fbeb06f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.438s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:44:52 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-6c89ddaf-30d6-46f6-9bb4-5ed38fbeb06f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Deleted allocations for instance 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8
Aug 14 16:44:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6c89ddaf-30d6-46f6-9bb4-5ed38fbeb06f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.930s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:44:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iThIoFVw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:44:53 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:44:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:44:53 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:44:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:44:53 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:44:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[11194b1a-a2c0-4d45-968a-734149b81d1c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:44:53 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c84387-8383-459a-9a1c-e7c270e19264]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0] added
Aug 14 16:44:53 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[04915d7f-485e-4438-a5b1-e0d3dfb7828a]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b0a96e-1a66-4dd9-83d5-0e5beb015e17]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iThIoFVw {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iThIoFVw" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a25f585-1268-4d0b-aace-81226e6e4ff2]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iThIoFVw'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5460d674-842f-4a3f-b2bb-066e29369344]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77d2d4d-fc03-4bed-8f88-3f5cce43afc2]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a (non-flash)
Aug 14 16:44:53 user nova-compute[73056]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)
Aug 14 16:44:53 user nova-compute[73056]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:44:53 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a (non-flash)
Aug 14 16:44:53 user nova-compute[73056]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)
Aug 14 16:44:53 user nova-compute[73056]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:44:53 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[405bda87-a39a-48c5-8e3b-a25e45ea79a5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0, portal: 172.16.0.220,3260]
Aug 14 16:44:53 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0, portal: 172.16.0.220,3260] successful.
Aug 14 16:44:53 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79eeab3-e935-4676-ac85-f508c04be15c]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8351ad8-4722-4fb1-b582-f0ff80318dce]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a (non-flash)
Aug 14 16:44:53 user nova-compute[73056]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)
Aug 14 16:44:53 user nova-compute[73056]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:44:53 user nova-compute[73056]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)
Aug 14 16:44:53 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a (non-flash)
Aug 14 16:44:53 user nova-compute[73056]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)
Aug 14 16:44:53 user nova-compute[73056]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:44:53 user nova-compute[73056]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)
Aug 14 16:44:53 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] HCTL ('36', '-', '-', 0) found on session 26 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[780acf84-89e1-4c2b-9d4c-4b01e73c22be]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:44:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iThIoFVw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:44:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:44:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '26362383832353464', 'path': '/dev/sde'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:44:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362383832353464', 'path': '/dev/sde'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:44:54 user nova-compute[73056]: DEBUG nova.objects.instance [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lazy-loading 'flavor' on Instance uuid 9c11423c-88d3-4fae-8917-c0d57021d194 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:44:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 16:44:54 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:44:54 user nova-compute[73056]:   <source dev="/dev/sde"/>
Aug 14 16:44:54 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:44:54 user nova-compute[73056]:   <serial>37a09be2-92fa-4429-a416-13d78c74eda0</serial>
Aug 14 16:44:54 user nova-compute[73056]: </disk>
Aug 14 16:44:54 user nova-compute[73056]:  {{(pid=73056) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 16:44:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:44:55 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:44:55 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 16:44:55 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Rebuilding the list of instances to heal {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 16:44:55 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:44:55 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:44:55 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] No VIF found with MAC fa:16:3e:e6:4c:64, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:44:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-9f3a7f8a-e3b9-4918-9663-968677fe5c90" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:44:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-9f3a7f8a-e3b9-4918-9663-968677fe5c90" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:44:55 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 16:44:55 user nova-compute[73056]: DEBUG nova.objects.instance [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lazy-loading 'info_cache' on Instance uuid 9f3a7f8a-e3b9-4918-9663-968677fe5c90 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:44:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-33830f4e-d443-43f6-b358-64229314b5c5 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "9c11423c-88d3-4fae-8917-c0d57021d194" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.399s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:44:56 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Updating instance_info_cache with network_info: [{"id": "312bec25-d19f-423b-aca3-a4117119fc1f", "address": "fa:16:3e:03:ce:11", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312bec25-d1", "ovs_interfaceid": "312bec25-d19f-423b-aca3-a4117119fc1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:44:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-9f3a7f8a-e3b9-4918-9663-968677fe5c90" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:44:56 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 16:44:56 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:44:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:44:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:44:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:44:56 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 16:44:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6108d44-11ef-4414-889b-35a105195b8e/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6108d44-11ef-4414-889b-35a105195b8e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6108d44-11ef-4414-889b-35a105195b8e/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6108d44-11ef-4414-889b-35a105195b8e/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:56 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:44:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dbfa63-5061-4304-b8eb-4565ad9f0a96/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dbfa63-5061-4304-b8eb-4565ad9f0a96/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dbfa63-5061-4304-b8eb-4565ad9f0a96/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dbfa63-5061-4304-b8eb-4565ad9f0a96/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07cfc63-1ce9-466b-aa01-d967be383f45/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07cfc63-1ce9-466b-aa01-d967be383f45/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07cfc63-1ce9-466b-aa01-d967be383f45/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07cfc63-1ce9-466b-aa01-d967be383f45/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:58 user nova-compute[73056]: DEBUG nova.compute.manager [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Stashing vm_state: active {{(pid=73056) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 14 16:44:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:44:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.003s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:44:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:58 user nova-compute[73056]: DEBUG nova.objects.instance [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lazy-loading 'pci_requests' on Instance uuid 9c11423c-88d3-4fae-8917-c0d57021d194 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:44:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:58 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:44:58 user nova-compute[73056]: INFO nova.compute.claims [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Claim successful on node user
Aug 14 16:44:58 user nova-compute[73056]: DEBUG nova.objects.instance [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lazy-loading 'resources' on Instance uuid 9c11423c-88d3-4fae-8917-c0d57021d194 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:44:58 user nova-compute[73056]: DEBUG nova.objects.instance [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c11423c-88d3-4fae-8917-c0d57021d194 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:44:58 user nova-compute[73056]: INFO nova.compute.resource_tracker [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Updating resource usage from migration 701fbf5b-29e5-4606-87a2-d8733de0a2f1
Aug 14 16:44:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:58 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:44:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:58 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:44:58 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:44:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.651s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:44:59 user nova-compute[73056]: INFO nova.compute.manager [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Migrating
Aug 14 16:44:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:44:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Acquired lock "compute-rpcapi-router" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:44:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:59 user nova-compute[73056]: INFO nova.compute.rpcapi [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 14 16:44:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Releasing lock "compute-rpcapi-router" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:44:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Acquiring lock "refresh_cache-9c11423c-88d3-4fae-8917-c0d57021d194" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:44:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Acquired lock "refresh_cache-9c11423c-88d3-4fae-8917-c0d57021d194" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:44:59 user nova-compute[73056]: DEBUG nova.network.neutron [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:44:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:44:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:59 user nova-compute[73056]: DEBUG nova.network.neutron [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Updating instance_info_cache with network_info: [{"id": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "address": "fa:16:3e:e6:4c:64", "network": {"id": "db548415-fd97-4612-8699-d431cfe3c1ec", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-66082327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af3a3df4b8641c1ac0d02df893b524d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8491a73c-f3", "ovs_interfaceid": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:44:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Releasing lock "refresh_cache-9c11423c-88d3-4fae-8917-c0d57021d194" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:44:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:44:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:44:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Starting migrate_disk_and_power_off {{(pid=73056) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 14 16:44:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3270811-8241-47a6-aa36-0ec3feddf0fc/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3270811-8241-47a6-aa36-0ec3feddf0fc/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3270811-8241-47a6-aa36-0ec3feddf0fc/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:00 user nova-compute[73056]: DEBUG nova.compute.manager [req-f346dd3a-5c40-4c14-b751-2fd3470ce9dc req-57f3680a-6759-4263-a3c7-64824f56c14d service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Received event network-vif-unplugged-8491a73c-f38b-4cb4-ab87-d6e41992319d {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:45:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f346dd3a-5c40-4c14-b751-2fd3470ce9dc req-57f3680a-6759-4263-a3c7-64824f56c14d service nova] Acquiring lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f346dd3a-5c40-4c14-b751-2fd3470ce9dc req-57f3680a-6759-4263-a3c7-64824f56c14d service nova] Lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f346dd3a-5c40-4c14-b751-2fd3470ce9dc req-57f3680a-6759-4263-a3c7-64824f56c14d service nova] Lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:00 user nova-compute[73056]: DEBUG nova.compute.manager [req-f346dd3a-5c40-4c14-b751-2fd3470ce9dc req-57f3680a-6759-4263-a3c7-64824f56c14d service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] No waiting events found dispatching network-vif-unplugged-8491a73c-f38b-4cb4-ab87-d6e41992319d {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:45:00 user nova-compute[73056]: WARNING nova.compute.manager [req-f346dd3a-5c40-4c14-b751-2fd3470ce9dc req-57f3680a-6759-4263-a3c7-64824f56c14d service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Received unexpected event network-vif-unplugged-8491a73c-f38b-4cb4-ab87-d6e41992319d for instance with vm_state active and task_state resize_migrating.
Aug 14 16:45:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3270811-8241-47a6-aa36-0ec3feddf0fc/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:45:00 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:45:00 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:45:00 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=6979MB free_disk=25.283206939697266GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 16:45:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:00 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Instance destroyed successfully.
Aug 14 16:45:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:40:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1141868820',display_name='tempest-ServerActionsTestOtherB-server-1141868820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1141868820',id=16,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsc3Uaz7vmbmV86lMnvYNdRaSVfJcdYXdG4vY0wVNgR/VZPzr09+A51tF4EmKhmmLDKglhmcpoAJJc05z8zlcL3Fqhx5uVkS7BbyNbqt0mNNKT7ar0AXFL2PnABSrfDLg==',key_name='tempest-keypair-1532112814',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:41:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4af3a3df4b8641c1ac0d02df893b524d',ramdisk_id='',reservation_id='r-z7s601zt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1168667086',owner_user_name='tempest-ServerActionsTestOtherB-1168667086-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:44:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c39b09d624bb4977b6d1b396f425f737',uuid=9c11423c-88d3-4fae-8917-c0d57021d194,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "address": "fa:16:3e:e6:4c:64", "network": {"id": "db548415-fd97-4612-8699-d431cfe3c1ec", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-66082327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-66082327-network", "vif_mac": "fa:16:3e:e6:4c:64"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af3a3df4b8641c1ac0d02df893b524d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8491a73c-f3", "ovs_interfaceid": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Converting VIF {"id": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "address": "fa:16:3e:e6:4c:64", "network": {"id": "db548415-fd97-4612-8699-d431cfe3c1ec", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-66082327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-66082327-network", "vif_mac": "fa:16:3e:e6:4c:64"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af3a3df4b8641c1ac0d02df893b524d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8491a73c-f3", "ovs_interfaceid": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:4c:64,bridge_name='br-int',has_traffic_filtering=True,id=8491a73c-f38b-4cb4-ab87-d6e41992319d,network=Network(db548415-fd97-4612-8699-d431cfe3c1ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8491a73c-f3') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG os_vif [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:4c:64,bridge_name='br-int',has_traffic_filtering=True,id=8491a73c-f38b-4cb4-ab87-d6e41992319d,network=Network(db548415-fd97-4612-8699-d431cfe3c1ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8491a73c-f3') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8491a73c-f3, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:45:01 user nova-compute[73056]: INFO os_vif [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:4c:64,bridge_name='br-int',has_traffic_filtering=True,id=8491a73c-f38b-4cb4-ab87-d6e41992319d,network=Network(db548415-fd97-4612-8699-d431cfe3c1ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8491a73c-f3')
Aug 14 16:45:01 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iThIoFVw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:45:01 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:45:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5eed7a3-7a62-4b07-8867-f11f5492d42f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e142ea8b-0876-4d43-9f7f-0a15935cbbfe]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a (non-flash)
Aug 14 16:45:01 user nova-compute[73056]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)
Aug 14 16:45:01 user nova-compute[73056]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:45:01 user nova-compute[73056]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)
Aug 14 16:45:01 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a (non-flash)
Aug 14 16:45:01 user nova-compute[73056]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)
Aug 14 16:45:01 user nova-compute[73056]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:45:01 user nova-compute[73056]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)
Aug 14 16:45:01 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff32fcadcf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0'): ({'sde'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Removing single pathed devices sde {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Applying migration context for instance 9c11423c-88d3-4fae-8917-c0d57021d194 as it has an incoming, in-progress migration 701fbf5b-29e5-4606-87a2-d8733de0a2f1. Migration status is migrating {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 14 16:45:01 user nova-compute[73056]: INFO nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Updating resource usage from migration 701fbf5b-29e5-4606-87a2-d8733de0a2f1
Aug 14 16:45:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c16b73-b864-436c-a89b-517140e62aaf]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50cfd4f-e412-4a2e-8954-a885d0174840]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Flushing IO for device /dev/sde {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 9f3a7f8a-e3b9-4918-9663-968677fe5c90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 4731f355-9307-4176-910b-cf35beb85e75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance b3270811-8241-47a6-aa36-0ec3feddf0fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance a6108d44-11ef-4414-889b-35a105195b8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 10b527b0-a7f1-4149-9859-69dac9f481e3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance d5dbfa63-5061-4304-b8eb-4565ad9f0a96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance b580e3d0-88b5-42a3-a953-84b94c088f41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 92c34cf0-fd39-49fc-9244-4da8ccae6eec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance e07cfc63-1ce9-466b-aa01-d967be383f45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Migration 701fbf5b-29e5-4606-87a2-d8733de0a2f1 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 9c11423c-88d3-4fae-8917-c0d57021d194 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b5f17e-d131-4f9e-95cb-8774f68862c4]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[54178ca6-2854-4a0f-8b5e-2b8738e7849b]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] SCSI volumes sde have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[942ee4a8-7a24-454e-af85-9ac8de6d25c8]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[3771ff67-269d-489a-af76-ce503a08e4d2]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0, portal: 172.16.0.220,3260]
Aug 14 16:45:01 user nova-compute[73056]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0, portal: 172.16.0.220,3260] successful.
Aug 14 16:45:01 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c1c1c4-fc4f-40e5-a00f-33689e02900d]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] <== disconnect_volume: return (306ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.604s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194_resize/disk /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:45:01 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:45:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] CMD "cp -r /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194_resize/disk /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk" returned: 0 in 0.473s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194_resize/disk.info /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk.info {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] CMD "cp -r /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194_resize/disk.info /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk.info" returned: 0 in 0.035s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:02 user nova-compute[73056]: DEBUG nova.compute.manager [req-4afedb2f-08b4-4e25-afbe-37d5363649b7 req-619d93e8-2a1a-48be-92b3-9a02b8167306 service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Received event network-vif-plugged-8491a73c-f38b-4cb4-ab87-d6e41992319d {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:45:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4afedb2f-08b4-4e25-afbe-37d5363649b7 req-619d93e8-2a1a-48be-92b3-9a02b8167306 service nova] Acquiring lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4afedb2f-08b4-4e25-afbe-37d5363649b7 req-619d93e8-2a1a-48be-92b3-9a02b8167306 service nova] Lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4afedb2f-08b4-4e25-afbe-37d5363649b7 req-619d93e8-2a1a-48be-92b3-9a02b8167306 service nova] Lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:02 user nova-compute[73056]: DEBUG nova.compute.manager [req-4afedb2f-08b4-4e25-afbe-37d5363649b7 req-619d93e8-2a1a-48be-92b3-9a02b8167306 service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] No waiting events found dispatching network-vif-plugged-8491a73c-f38b-4cb4-ab87-d6e41992319d {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:45:02 user nova-compute[73056]: WARNING nova.compute.manager [req-4afedb2f-08b4-4e25-afbe-37d5363649b7 req-619d93e8-2a1a-48be-92b3-9a02b8167306 service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Received unexpected event network-vif-plugged-8491a73c-f38b-4cb4-ab87-d6e41992319d for instance with vm_state active and task_state resize_migrating.
Aug 14 16:45:03 user nova-compute[73056]: DEBUG nova.network.neutron [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Port 8491a73c-f38b-4cb4-ab87-d6e41992319d binding to destination host user is already ACTIVE {{(pid=73056) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 14 16:45:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Acquiring lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Acquiring lock "refresh_cache-9c11423c-88d3-4fae-8917-c0d57021d194" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:45:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Acquired lock "refresh_cache-9c11423c-88d3-4fae-8917-c0d57021d194" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:45:03 user nova-compute[73056]: DEBUG nova.network.neutron [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:45:03 user nova-compute[73056]: DEBUG nova.network.neutron [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Updating instance_info_cache with network_info: [{"id": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "address": "fa:16:3e:e6:4c:64", "network": {"id": "db548415-fd97-4612-8699-d431cfe3c1ec", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-66082327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af3a3df4b8641c1ac0d02df893b524d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8491a73c-f3", "ovs_interfaceid": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:45:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Releasing lock "refresh_cache-9c11423c-88d3-4fae-8917-c0d57021d194" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:45:04 user nova-compute[73056]: DEBUG os_brick.utils [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:45:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b63ff5-e224-449f-9f4a-f48e40f401ce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb41c55b-8daf-444a-b8d7-b79670b5ed00]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8558ec-6ed0-418a-9910-1aadcb51d540]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[04895af5-8797-4407-bba8-45eef76286c1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:45:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:45:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:45:04 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:45:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c735c0-5c7e-4d63-8f75-c64eb7390796]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:45:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:45:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:45:04 user nova-compute[73056]: DEBUG os_brick.utils [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:45:05 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692031490.159153, 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:45:05 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] VM Stopped (Lifecycle Event)
Aug 14 16:45:05 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5f17454d-0638-45e7-859a-d32cc6af1fcb None None] [instance: 5aaaff86-3ac7-4d59-8fa4-54d7dd7cdbc8] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:45:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:06 user nova-compute[73056]: DEBUG nova.compute.manager [req-9f9cfbe8-79b9-4c95-b535-43edf7b8ab03 req-ed37c025-d25c-48d5-968d-1174cb9359f5 service nova] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Received event network-changed-4fc1f417-10f1-4ebc-a065-0933dbd1863d {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:45:06 user nova-compute[73056]: DEBUG nova.compute.manager [req-9f9cfbe8-79b9-4c95-b535-43edf7b8ab03 req-ed37c025-d25c-48d5-968d-1174cb9359f5 service nova] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Refreshing instance network info cache due to event network-changed-4fc1f417-10f1-4ebc-a065-0933dbd1863d. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:45:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9f9cfbe8-79b9-4c95-b535-43edf7b8ab03 req-ed37c025-d25c-48d5-968d-1174cb9359f5 service nova] Acquiring lock "refresh_cache-a6108d44-11ef-4414-889b-35a105195b8e" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:45:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9f9cfbe8-79b9-4c95-b535-43edf7b8ab03 req-ed37c025-d25c-48d5-968d-1174cb9359f5 service nova] Acquired lock "refresh_cache-a6108d44-11ef-4414-889b-35a105195b8e" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:45:06 user nova-compute[73056]: DEBUG nova.network.neutron [req-9f9cfbe8-79b9-4c95-b535-43edf7b8ab03 req-ed37c025-d25c-48d5-968d-1174cb9359f5 service nova] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Refreshing network info cache for port 4fc1f417-10f1-4ebc-a065-0933dbd1863d {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:45:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Acquiring lock "1feea14e-10f2-4282-8137-2a5a289eda41" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Lock "1feea14e-10f2-4282-8137-2a5a289eda41" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:06 user nova-compute[73056]: DEBUG nova.compute.manager [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:45:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:06 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:45:06 user nova-compute[73056]: INFO nova.compute.claims [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Claim successful on node user
Aug 14 16:45:06 user nova-compute[73056]: DEBUG nova.network.neutron [req-9f9cfbe8-79b9-4c95-b535-43edf7b8ab03 req-ed37c025-d25c-48d5-968d-1174cb9359f5 service nova] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Updated VIF entry in instance network info cache for port 4fc1f417-10f1-4ebc-a065-0933dbd1863d. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:45:06 user nova-compute[73056]: DEBUG nova.network.neutron [req-9f9cfbe8-79b9-4c95-b535-43edf7b8ab03 req-ed37c025-d25c-48d5-968d-1174cb9359f5 service nova] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Updating instance_info_cache with network_info: [{"id": "4fc1f417-10f1-4ebc-a065-0933dbd1863d", "address": "fa:16:3e:a0:4c:46", "network": {"id": "f32dab76-cccd-47e6-9a3a-86c15eec31ec", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1998522699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcccd44594f64557856a1d64fc7f0a11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc1f417-10", "ovs_interfaceid": "4fc1f417-10f1-4ebc-a065-0933dbd1863d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:45:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9f9cfbe8-79b9-4c95-b535-43edf7b8ab03 req-ed37c025-d25c-48d5-968d-1174cb9359f5 service nova] Releasing lock "refresh_cache-a6108d44-11ef-4414-889b-35a105195b8e" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:45:07 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:45:07 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:45:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.522s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:07 user nova-compute[73056]: DEBUG nova.compute.manager [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:45:07 user nova-compute[73056]: DEBUG nova.compute.manager [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:45:07 user nova-compute[73056]: DEBUG nova.network.neutron [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:45:07 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:45:07 user nova-compute[73056]: DEBUG nova.compute.manager [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:45:07 user nova-compute[73056]: DEBUG nova.policy [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6f3c0d0bffd749299fe0bf8ab5aaf8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1bd35329054f4793440e9a780a0a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:45:07 user nova-compute[73056]: DEBUG nova.compute.manager [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:45:07 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:45:07 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Creating image(s)
Aug 14 16:45:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Acquiring lock "/opt/stack/data/nova/instances/1feea14e-10f2-4282-8137-2a5a289eda41/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Lock "/opt/stack/data/nova/instances/1feea14e-10f2-4282-8137-2a5a289eda41/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Lock "/opt/stack/data/nova/instances/1feea14e-10f2-4282-8137-2a5a289eda41/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.189s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Acquiring lock "c889592ab94cd0b0ce896f27a2af0323771db234" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.206s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/1feea14e-10f2-4282-8137-2a5a289eda41/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/1feea14e-10f2-4282-8137-2a5a289eda41/disk 1073741824" returned: 0 in 0.061s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.221s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:08 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1feea14e-10f2-4282-8137-2a5a289eda41/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 16:45:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feea14e-10f2-4282-8137-2a5a289eda41/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feea14e-10f2-4282-8137-2a5a289eda41/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:08 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Cannot resize image /opt/stack/data/nova/instances/1feea14e-10f2-4282-8137-2a5a289eda41/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 16:45:08 user nova-compute[73056]: DEBUG nova.objects.instance [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Lazy-loading 'migration_context' on Instance uuid 1feea14e-10f2-4282-8137-2a5a289eda41 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:45:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 16:45:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Ensure instance console log exists: /opt/stack/data/nova/instances/1feea14e-10f2-4282-8137-2a5a289eda41/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:45:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:08 user nova-compute[73056]: DEBUG nova.network.neutron [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Successfully created port: 8d863621-6a6e-4464-93bd-62b02305ef0a {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:45:09 user nova-compute[73056]: DEBUG nova.network.neutron [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Successfully updated port: 8d863621-6a6e-4464-93bd-62b02305ef0a {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:45:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Acquiring lock "refresh_cache-1feea14e-10f2-4282-8137-2a5a289eda41" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:45:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Acquired lock "refresh_cache-1feea14e-10f2-4282-8137-2a5a289eda41" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:45:09 user nova-compute[73056]: DEBUG nova.network.neutron [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:45:09 user nova-compute[73056]: DEBUG nova.compute.manager [req-28763bb3-20e8-4a6b-b8cb-8af806b2ca57 req-a44c3a17-cbb0-4e32-939e-6575476c0782 service nova] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Received event network-changed-8d863621-6a6e-4464-93bd-62b02305ef0a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:45:09 user nova-compute[73056]: DEBUG nova.compute.manager [req-28763bb3-20e8-4a6b-b8cb-8af806b2ca57 req-a44c3a17-cbb0-4e32-939e-6575476c0782 service nova] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Refreshing instance network info cache due to event network-changed-8d863621-6a6e-4464-93bd-62b02305ef0a. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:45:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-28763bb3-20e8-4a6b-b8cb-8af806b2ca57 req-a44c3a17-cbb0-4e32-939e-6575476c0782 service nova] Acquiring lock "refresh_cache-1feea14e-10f2-4282-8137-2a5a289eda41" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:45:09 user nova-compute[73056]: DEBUG nova.network.neutron [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG nova.network.neutron [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Updating instance_info_cache with network_info: [{"id": "8d863621-6a6e-4464-93bd-62b02305ef0a", "address": "fa:16:3e:7e:6a:2f", "network": {"id": "90290111-0089-4535-9ba5-97fb3b034dcd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1526741248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1bd35329054f4793440e9a780a0a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d863621-6a", "ovs_interfaceid": "8d863621-6a6e-4464-93bd-62b02305ef0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Releasing lock "refresh_cache-1feea14e-10f2-4282-8137-2a5a289eda41" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG nova.compute.manager [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Instance network_info: |[{"id": "8d863621-6a6e-4464-93bd-62b02305ef0a", "address": "fa:16:3e:7e:6a:2f", "network": {"id": "90290111-0089-4535-9ba5-97fb3b034dcd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1526741248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1bd35329054f4793440e9a780a0a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d863621-6a", "ovs_interfaceid": "8d863621-6a6e-4464-93bd-62b02305ef0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-28763bb3-20e8-4a6b-b8cb-8af806b2ca57 req-a44c3a17-cbb0-4e32-939e-6575476c0782 service nova] Acquired lock "refresh_cache-1feea14e-10f2-4282-8137-2a5a289eda41" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG nova.network.neutron [req-28763bb3-20e8-4a6b-b8cb-8af806b2ca57 req-a44c3a17-cbb0-4e32-939e-6575476c0782 service nova] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Refreshing network info cache for port 8d863621-6a6e-4464-93bd-62b02305ef0a {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Start _get_guest_xml network_info=[{"id": "8d863621-6a6e-4464-93bd-62b02305ef0a", "address": "fa:16:3e:7e:6a:2f", "network": {"id": "90290111-0089-4535-9ba5-97fb3b034dcd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1526741248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1bd35329054f4793440e9a780a0a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d863621-6a", "ovs_interfaceid": "8d863621-6a6e-4464-93bd-62b02305ef0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:45:10 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:45:10 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:45:10 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:45:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1038994978',display_name='tempest-VolumesActionsTest-instance-1038994978',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1038994978',id=25,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b1bd35329054f4793440e9a780a0a75',ramdisk_id='',reservation_id='r-nf58coxk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1822561302',owner_user_name='tempest-VolumesActionsTest-1822561302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:45:07Z,user_data=None,user_id='6f3c0d0bffd749299fe0bf8ab5aaf8c5',uuid=1feea14e-10f2-4282-8137-2a5a289eda41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d863621-6a6e-4464-93bd-62b02305ef0a", "address": "fa:16:3e:7e:6a:2f", "network": {"id": "90290111-0089-4535-9ba5-97fb3b034dcd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1526741248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1bd35329054f4793440e9a780a0a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d863621-6a", "ovs_interfaceid": "8d863621-6a6e-4464-93bd-62b02305ef0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Converting VIF {"id": "8d863621-6a6e-4464-93bd-62b02305ef0a", "address": "fa:16:3e:7e:6a:2f", "network": {"id": "90290111-0089-4535-9ba5-97fb3b034dcd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1526741248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1bd35329054f4793440e9a780a0a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d863621-6a", "ovs_interfaceid": "8d863621-6a6e-4464-93bd-62b02305ef0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:6a:2f,bridge_name='br-int',has_traffic_filtering=True,id=8d863621-6a6e-4464-93bd-62b02305ef0a,network=Network(90290111-0089-4535-9ba5-97fb3b034dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d863621-6a') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG nova.objects.instance [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Lazy-loading 'pci_devices' on Instance uuid 1feea14e-10f2-4282-8137-2a5a289eda41 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:45:10 user nova-compute[73056]:   <uuid>1feea14e-10f2-4282-8137-2a5a289eda41</uuid>
Aug 14 16:45:10 user nova-compute[73056]:   <name>instance-00000019</name>
Aug 14 16:45:10 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:45:10 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:45:10 user nova-compute[73056]:   <metadata>
Aug 14 16:45:10 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:45:10 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:45:10 user nova-compute[73056]:       <nova:name>tempest-VolumesActionsTest-instance-1038994978</nova:name>
Aug 14 16:45:10 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:45:10</nova:creationTime>
Aug 14 16:45:10 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:45:10 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:45:10 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:45:10 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:45:10 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:45:10 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:45:10 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:45:10 user nova-compute[73056]:       <nova:owner>
Aug 14 16:45:10 user nova-compute[73056]:         <nova:user uuid="6f3c0d0bffd749299fe0bf8ab5aaf8c5">tempest-VolumesActionsTest-1822561302-project-member</nova:user>
Aug 14 16:45:10 user nova-compute[73056]:         <nova:project uuid="3b1bd35329054f4793440e9a780a0a75">tempest-VolumesActionsTest-1822561302</nova:project>
Aug 14 16:45:10 user nova-compute[73056]:       </nova:owner>
Aug 14 16:45:10 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:45:10 user nova-compute[73056]:       <nova:ports>
Aug 14 16:45:10 user nova-compute[73056]:         <nova:port uuid="8d863621-6a6e-4464-93bd-62b02305ef0a">
Aug 14 16:45:10 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 16:45:10 user nova-compute[73056]:         </nova:port>
Aug 14 16:45:10 user nova-compute[73056]:       </nova:ports>
Aug 14 16:45:10 user nova-compute[73056]:     </nova:instance>
Aug 14 16:45:10 user nova-compute[73056]:   </metadata>
Aug 14 16:45:10 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:45:10 user nova-compute[73056]:     <system>
Aug 14 16:45:10 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:45:10 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:45:10 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:45:10 user nova-compute[73056]:       <entry name="serial">1feea14e-10f2-4282-8137-2a5a289eda41</entry>
Aug 14 16:45:10 user nova-compute[73056]:       <entry name="uuid">1feea14e-10f2-4282-8137-2a5a289eda41</entry>
Aug 14 16:45:10 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:45:10 user nova-compute[73056]:     </system>
Aug 14 16:45:10 user nova-compute[73056]:   </sysinfo>
Aug 14 16:45:10 user nova-compute[73056]:   <os>
Aug 14 16:45:10 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:45:10 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:45:10 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:45:10 user nova-compute[73056]:   </os>
Aug 14 16:45:10 user nova-compute[73056]:   <features>
Aug 14 16:45:10 user nova-compute[73056]:     <acpi/>
Aug 14 16:45:10 user nova-compute[73056]:     <apic/>
Aug 14 16:45:10 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:45:10 user nova-compute[73056]:   </features>
Aug 14 16:45:10 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:45:10 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:45:10 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:45:10 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:45:10 user nova-compute[73056]:   </clock>
Aug 14 16:45:10 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:45:10 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:45:10 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:45:10 user nova-compute[73056]:   </cpu>
Aug 14 16:45:10 user nova-compute[73056]:   <devices>
Aug 14 16:45:10 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:45:10 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:45:10 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/1feea14e-10f2-4282-8137-2a5a289eda41/disk"/>
Aug 14 16:45:10 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:45:10 user nova-compute[73056]:     </disk>
Aug 14 16:45:10 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:45:10 user nova-compute[73056]:       <mac address="fa:16:3e:7e:6a:2f"/>
Aug 14 16:45:10 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:45:10 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:45:10 user nova-compute[73056]:       <target dev="tap8d863621-6a"/>
Aug 14 16:45:10 user nova-compute[73056]:     </interface>
Aug 14 16:45:10 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:45:10 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/1feea14e-10f2-4282-8137-2a5a289eda41/console.log" append="off"/>
Aug 14 16:45:10 user nova-compute[73056]:     </serial>
Aug 14 16:45:10 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:45:10 user nova-compute[73056]:     <video>
Aug 14 16:45:10 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:45:10 user nova-compute[73056]:     </video>
Aug 14 16:45:10 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:45:10 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:45:10 user nova-compute[73056]:     </rng>
Aug 14 16:45:10 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:45:10 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:45:10 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:45:10 user nova-compute[73056]:     </memballoon>
Aug 14 16:45:10 user nova-compute[73056]:   </devices>
Aug 14 16:45:10 user nova-compute[73056]: </domain>
Aug 14 16:45:10 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:45:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1038994978',display_name='tempest-VolumesActionsTest-instance-1038994978',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1038994978',id=25,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b1bd35329054f4793440e9a780a0a75',ramdisk_id='',reservation_id='r-nf58coxk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1822561302',owner_user_name='tempest-VolumesActionsTest-1822561302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:45:07Z,user_data=None,user_id='6f3c0d0bffd749299fe0bf8ab5aaf8c5',uuid=1feea14e-10f2-4282-8137-2a5a289eda41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d863621-6a6e-4464-93bd-62b02305ef0a", "address": "fa:16:3e:7e:6a:2f", "network": {"id": "90290111-0089-4535-9ba5-97fb3b034dcd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1526741248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1bd35329054f4793440e9a780a0a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d863621-6a", "ovs_interfaceid": "8d863621-6a6e-4464-93bd-62b02305ef0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Converting VIF {"id": "8d863621-6a6e-4464-93bd-62b02305ef0a", "address": "fa:16:3e:7e:6a:2f", "network": {"id": "90290111-0089-4535-9ba5-97fb3b034dcd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1526741248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1bd35329054f4793440e9a780a0a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d863621-6a", "ovs_interfaceid": "8d863621-6a6e-4464-93bd-62b02305ef0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:6a:2f,bridge_name='br-int',has_traffic_filtering=True,id=8d863621-6a6e-4464-93bd-62b02305ef0a,network=Network(90290111-0089-4535-9ba5-97fb3b034dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d863621-6a') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG os_vif [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:6a:2f,bridge_name='br-int',has_traffic_filtering=True,id=8d863621-6a6e-4464-93bd-62b02305ef0a,network=Network(90290111-0089-4535-9ba5-97fb3b034dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d863621-6a') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d863621-6a, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8d863621-6a, col_values=(('external_ids', {'iface-id': '8d863621-6a6e-4464-93bd-62b02305ef0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:6a:2f', 'vm-uuid': '1feea14e-10f2-4282-8137-2a5a289eda41'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:10 user nova-compute[73056]: INFO os_vif [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:6a:2f,bridge_name='br-int',has_traffic_filtering=True,id=8d863621-6a6e-4464-93bd-62b02305ef0a,network=Network(90290111-0089-4535-9ba5-97fb3b034dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d863621-6a')
Aug 14 16:45:10 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] No VIF found with MAC fa:16:3e:7e:6a:2f, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG nova.network.neutron [req-28763bb3-20e8-4a6b-b8cb-8af806b2ca57 req-a44c3a17-cbb0-4e32-939e-6575476c0782 service nova] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Updated VIF entry in instance network info cache for port 8d863621-6a6e-4464-93bd-62b02305ef0a. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG nova.network.neutron [req-28763bb3-20e8-4a6b-b8cb-8af806b2ca57 req-a44c3a17-cbb0-4e32-939e-6575476c0782 service nova] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Updating instance_info_cache with network_info: [{"id": "8d863621-6a6e-4464-93bd-62b02305ef0a", "address": "fa:16:3e:7e:6a:2f", "network": {"id": "90290111-0089-4535-9ba5-97fb3b034dcd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1526741248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1bd35329054f4793440e9a780a0a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d863621-6a", "ovs_interfaceid": "8d863621-6a6e-4464-93bd-62b02305ef0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:45:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-28763bb3-20e8-4a6b-b8cb-8af806b2ca57 req-a44c3a17-cbb0-4e32-939e-6575476c0782 service nova] Releasing lock "refresh_cache-1feea14e-10f2-4282-8137-2a5a289eda41" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:45:11 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:11 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:11 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Acquiring lock "a6108d44-11ef-4414-889b-35a105195b8e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Lock "a6108d44-11ef-4414-889b-35a105195b8e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:11 user nova-compute[73056]: DEBUG nova.objects.instance [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Lazy-loading 'flavor' on Instance uuid a6108d44-11ef-4414-889b-35a105195b8e {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:45:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Lock "a6108d44-11ef-4414-889b-35a105195b8e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Acquiring lock "a6108d44-11ef-4414-889b-35a105195b8e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Lock "a6108d44-11ef-4414-889b-35a105195b8e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:11 user nova-compute[73056]: INFO nova.compute.manager [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Attaching volume 53c3d17d-ee51-4bcb-a0e9-e744f6b3e984 to /dev/vdb
Aug 14 16:45:11 user nova-compute[73056]: DEBUG nova.compute.manager [req-5f7a5279-1786-4313-a74d-3d50ce5e64ee req-711208b8-2c9a-4d2d-8296-af3dfe68288f service nova] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Received event network-vif-plugged-8d863621-6a6e-4464-93bd-62b02305ef0a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:45:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-5f7a5279-1786-4313-a74d-3d50ce5e64ee req-711208b8-2c9a-4d2d-8296-af3dfe68288f service nova] Acquiring lock "1feea14e-10f2-4282-8137-2a5a289eda41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-5f7a5279-1786-4313-a74d-3d50ce5e64ee req-711208b8-2c9a-4d2d-8296-af3dfe68288f service nova] Lock "1feea14e-10f2-4282-8137-2a5a289eda41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-5f7a5279-1786-4313-a74d-3d50ce5e64ee req-711208b8-2c9a-4d2d-8296-af3dfe68288f service nova] Lock "1feea14e-10f2-4282-8137-2a5a289eda41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:11 user nova-compute[73056]: DEBUG nova.compute.manager [req-5f7a5279-1786-4313-a74d-3d50ce5e64ee req-711208b8-2c9a-4d2d-8296-af3dfe68288f service nova] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] No waiting events found dispatching network-vif-plugged-8d863621-6a6e-4464-93bd-62b02305ef0a {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:45:11 user nova-compute[73056]: WARNING nova.compute.manager [req-5f7a5279-1786-4313-a74d-3d50ce5e64ee req-711208b8-2c9a-4d2d-8296-af3dfe68288f service nova] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Received unexpected event network-vif-plugged-8d863621-6a6e-4464-93bd-62b02305ef0a for instance with vm_state building and task_state spawning.
Aug 14 16:45:12 user nova-compute[73056]: DEBUG os_brick.utils [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:45:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:12 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1dcb03a-0486-480c-896b-a6e777ca897b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:12 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcfddb2-c2dd-4383-955e-66c9d348398b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:12 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f46d283-81a9-4a2c-a8b4-6a959c0f0eed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:12 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c78400-53b7-4bb1-a447-6645edade00b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:45:12 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:45:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:45:12 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:45:12 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f805fbf1-47f2-47a2-b2a4-6d6f9ef2981b]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:12 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:45:12 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:45:12 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:45:12 user nova-compute[73056]: DEBUG os_brick.utils [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:45:12 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Updating existing volume attachment record: 30339502-22c9-4713-bd33-5fad49528e35 {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 16:45:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:14 user nova-compute[73056]: DEBUG nova.compute.manager [req-51e7ca37-e3a0-43cb-b520-f2c868275768 req-916f3c17-efad-4889-a1f1-ff301e64c1a7 service nova] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Received event network-vif-plugged-8d863621-6a6e-4464-93bd-62b02305ef0a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:45:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-51e7ca37-e3a0-43cb-b520-f2c868275768 req-916f3c17-efad-4889-a1f1-ff301e64c1a7 service nova] Acquiring lock "1feea14e-10f2-4282-8137-2a5a289eda41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-51e7ca37-e3a0-43cb-b520-f2c868275768 req-916f3c17-efad-4889-a1f1-ff301e64c1a7 service nova] Lock "1feea14e-10f2-4282-8137-2a5a289eda41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-51e7ca37-e3a0-43cb-b520-f2c868275768 req-916f3c17-efad-4889-a1f1-ff301e64c1a7 service nova] Lock "1feea14e-10f2-4282-8137-2a5a289eda41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:14 user nova-compute[73056]: DEBUG nova.compute.manager [req-51e7ca37-e3a0-43cb-b520-f2c868275768 req-916f3c17-efad-4889-a1f1-ff301e64c1a7 service nova] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] No waiting events found dispatching network-vif-plugged-8d863621-6a6e-4464-93bd-62b02305ef0a {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:45:14 user nova-compute[73056]: WARNING nova.compute.manager [req-51e7ca37-e3a0-43cb-b520-f2c868275768 req-916f3c17-efad-4889-a1f1-ff301e64c1a7 service nova] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Received unexpected event network-vif-plugged-8d863621-6a6e-4464-93bd-62b02305ef0a for instance with vm_state building and task_state spawning.
Aug 14 16:45:14 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031514.1272511, 1feea14e-10f2-4282-8137-2a5a289eda41 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:45:14 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] VM Resumed (Lifecycle Event)
Aug 14 16:45:14 user nova-compute[73056]: DEBUG nova.compute.manager [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:45:14 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:45:14 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Instance spawned successfully.
Aug 14 16:45:14 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:45:14 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:45:14 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:45:14 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:45:14 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:45:14 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:45:14 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:45:14 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:45:14 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:45:14 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:45:14 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031514.13452, 1feea14e-10f2-4282-8137-2a5a289eda41 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:45:14 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] VM Started (Lifecycle Event)
Aug 14 16:45:14 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:45:14 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:45:14 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:45:14 user nova-compute[73056]: INFO nova.compute.manager [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Took 6.91 seconds to spawn the instance on the hypervisor.
Aug 14 16:45:14 user nova-compute[73056]: DEBUG nova.compute.manager [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:45:14 user nova-compute[73056]: INFO nova.compute.manager [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Took 7.89 seconds to build instance.
Aug 14 16:45:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6bbdaa94-3ee5-4035-9b34-0846703cde3a tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Lock "1feea14e-10f2-4282-8137-2a5a289eda41" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.988s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:15 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692031500.761639, 9c11423c-88d3-4fae-8917-c0d57021d194 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:45:15 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] VM Stopped (Lifecycle Event)
Aug 14 16:45:16 user nova-compute[73056]: DEBUG nova.compute.manager [None req-ef063f5b-8607-44da-b8fd-a79a347bacbd None None] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:45:16 user nova-compute[73056]: DEBUG nova.compute.manager [None req-ef063f5b-8607-44da-b8fd-a79a347bacbd None None] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:45:16 user nova-compute[73056]: INFO nova.compute.manager [None req-ef063f5b-8607-44da-b8fd-a79a347bacbd None None] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 16:45:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Starting finish_migration {{(pid=73056) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Instance directory exists: not creating {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 16:45:18 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Creating image(s)
Aug 14 16:45:18 user nova-compute[73056]: DEBUG nova.objects.instance [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9c11423c-88d3-4fae-8917-c0d57021d194 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.236s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk. size=21474836480 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk 21474836480 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk 21474836480" returned: 0 in 0.063s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Did not create local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Ensure instance console log exists: /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Start _get_guest_xml network_info=[{"id": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "address": "fa:16:3e:e6:4c:64", "network": {"id": "db548415-fd97-4612-8699-d431cfe3c1ec", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-66082327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-66082327-network", "vif_mac": "fa:16:3e:e6:4c:64"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af3a3df4b8641c1ac0d02df893b524d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8491a73c-f3", "ovs_interfaceid": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iThIoFVw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '9c11423c-88d3-4fae-8917-c0d57021d194', 'attached_at': '2023-08-14T16:45:18.000000', 'detached_at': '', 'volume_id': '37a09be2-92fa-4429-a416-13d78c74eda0', 'serial': '37a09be2-92fa-4429-a416-13d78c74eda0'}, 'attachment_id': 'a6647160-cd00-42ba-9144-b6ab94fb6eef', 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:45:18 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:45:18 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:45:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG nova.objects.instance [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9c11423c-88d3-4fae-8917-c0d57021d194 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iThIoFVw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:45:18 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:45:18 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:45:18 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:45:18 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:45:18 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:45:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b608d962-5b7f-44d0-acae-56a2d1f72746]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:45:18 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53b9e4f-345f-4ba8-8233-3ff5f3f00cdf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0] added
Aug 14 16:45:18 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebbc3aa-4b72-4426-8e48-8bbd1e6efef6]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fd3cc7-9fa9-41a1-92ee-7e37f1d5fd11]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iThIoFVw {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iThIoFVw" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe524895-a598-44ac-9fb3-091a39f5490b]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iThIoFVw'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "10b527b0-a7f1-4149-9859-69dac9f481e3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "10b527b0-a7f1-4149-9859-69dac9f481e3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "10b527b0-a7f1-4149-9859-69dac9f481e3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "10b527b0-a7f1-4149-9859-69dac9f481e3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "10b527b0-a7f1-4149-9859-69dac9f481e3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:18 user nova-compute[73056]: INFO nova.compute.manager [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Terminating instance
Aug 14 16:45:18 user nova-compute[73056]: DEBUG nova.compute.manager [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[66658769-0faf-4c14-854a-318c11fccc3a]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:45:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[6498e34f-ab12-450e-bf61-d88568a17f0c]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a (non-flash)
Aug 14 16:45:19 user nova-compute[73056]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)
Aug 14 16:45:19 user nova-compute[73056]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:45:19 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a (non-flash)
Aug 14 16:45:19 user nova-compute[73056]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)
Aug 14 16:45:19 user nova-compute[73056]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:45:19 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fab019-ff3d-4ced-9cef-a81ed10082c7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0, portal: 172.16.0.220,3260]
Aug 14 16:45:19 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0, portal: 172.16.0.220,3260] successful.
Aug 14 16:45:19 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce520ac-07b2-4e3a-9bea-f7e83cf56119]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d5af06-b5bc-48ae-b26c-30bcaa6bec33]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a (non-flash)
Aug 14 16:45:19 user nova-compute[73056]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)
Aug 14 16:45:19 user nova-compute[73056]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:45:19 user nova-compute[73056]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)
Aug 14 16:45:19 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a (non-flash)
Aug 14 16:45:19 user nova-compute[73056]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)
Aug 14 16:45:19 user nova-compute[73056]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:45:19 user nova-compute[73056]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)
Aug 14 16:45:19 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.388s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.035s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd37f7e-8b85-4abd-bfec-f8b3b3c4c125]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iThIoFVw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG nova.compute.manager [req-a1df65eb-ed1c-4969-b2cd-7c77db50a3bb req-28b6e107-c2b7-44a3-9fc1-36937a3eded0 service nova] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Received event network-vif-unplugged-b97ec96e-9506-4427-b9b1-38f2233a320c {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a1df65eb-ed1c-4969-b2cd-7c77db50a3bb req-28b6e107-c2b7-44a3-9fc1-36937a3eded0 service nova] Acquiring lock "10b527b0-a7f1-4149-9859-69dac9f481e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a1df65eb-ed1c-4969-b2cd-7c77db50a3bb req-28b6e107-c2b7-44a3-9fc1-36937a3eded0 service nova] Lock "10b527b0-a7f1-4149-9859-69dac9f481e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a1df65eb-ed1c-4969-b2cd-7c77db50a3bb req-28b6e107-c2b7-44a3-9fc1-36937a3eded0 service nova] Lock "10b527b0-a7f1-4149-9859-69dac9f481e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG nova.compute.manager [req-a1df65eb-ed1c-4969-b2cd-7c77db50a3bb req-28b6e107-c2b7-44a3-9fc1-36937a3eded0 service nova] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] No waiting events found dispatching network-vif-unplugged-b97ec96e-9506-4427-b9b1-38f2233a320c {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG nova.compute.manager [req-a1df65eb-ed1c-4969-b2cd-7c77db50a3bb req-28b6e107-c2b7-44a3-9fc1-36937a3eded0 service nova] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Received event network-vif-unplugged-b97ec96e-9506-4427-b9b1-38f2233a320c for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:45:19 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Instance destroyed successfully.
Aug 14 16:45:19 user nova-compute[73056]: DEBUG nova.objects.instance [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lazy-loading 'resources' on Instance uuid 10b527b0-a7f1-4149-9859-69dac9f481e3 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:43:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1808496566',display_name='tempest-TestVolumeBootPattern-server-1808496566',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1808496566',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:43:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cffb5203b9284500b8add8a6586cad49',ramdisk_id='',reservation_id='r-u0z9umzg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1676214558',owner_user_name='tempest-TestVolumeBootPattern-1676214558-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:43:50Z,user_data=None,user_id='2be1b098ca9f4232bd198b515630f6ad',uuid=10b527b0-a7f1-4149-9859-69dac9f481e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b97ec96e-9506-4427-b9b1-38f2233a320c", "address": "fa:16:3e:46:16:7c", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97ec96e-95", "ovs_interfaceid": "b97ec96e-9506-4427-b9b1-38f2233a320c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Converting VIF {"id": "b97ec96e-9506-4427-b9b1-38f2233a320c", "address": "fa:16:3e:46:16:7c", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97ec96e-95", "ovs_interfaceid": "b97ec96e-9506-4427-b9b1-38f2233a320c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:16:7c,bridge_name='br-int',has_traffic_filtering=True,id=b97ec96e-9506-4427-b9b1-38f2233a320c,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb97ec96e-95') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG os_vif [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:16:7c,bridge_name='br-int',has_traffic_filtering=True,id=b97ec96e-9506-4427-b9b1-38f2233a320c,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb97ec96e-95') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb97ec96e-95, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:45:19 user nova-compute[73056]: INFO os_vif [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:16:7c,bridge_name='br-int',has_traffic_filtering=True,id=b97ec96e-9506-4427-b9b1-38f2233a320c,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb97ec96e-95')
Aug 14 16:45:19 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:45:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNXdBVTo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:45:19 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:45:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.448s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] <== connect_volume: return (1449ms) {'type': 'block', 'scsi_wwn': '26362383832353464', 'path': '/dev/sde'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362383832353464', 'path': '/dev/sde'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.416s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1700c44-0b97-4c66-aa2e-6512b64eecf0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:40:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1141868820',display_name='tempest-ServerActionsTestOtherB-server-1141868820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1141868820',id=16,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsc3Uaz7vmbmV86lMnvYNdRaSVfJcdYXdG4vY0wVNgR/VZPzr09+A51tF4EmKhmmLDKglhmcpoAJJc05z8zlcL3Fqhx5uVkS7BbyNbqt0mNNKT7ar0AXFL2PnABSrfDLg==',key_name='tempest-keypair-1532112814',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:41:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4af3a3df4b8641c1ac0d02df893b524d',ramdisk_id='',reservation_id='r-z7s601zt',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1168667086',owner_user_name='tempest-ServerActionsTestOtherB-1168667086-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:45:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c39b09d624bb4977b6d1b396f425f737',uuid=9c11423c-88d3-4fae-8917-c0d57021d194,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "address": "fa:16:3e:e6:4c:64", "network": {"id": "db548415-fd97-4612-8699-d431cfe3c1ec", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-66082327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-66082327-network", "vif_mac": "fa:16:3e:e6:4c:64"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af3a3df4b8641c1ac0d02df893b524d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8491a73c-f3", "ovs_interfaceid": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Converting VIF {"id": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "address": "fa:16:3e:e6:4c:64", "network": {"id": "db548415-fd97-4612-8699-d431cfe3c1ec", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-66082327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-66082327-network", "vif_mac": "fa:16:3e:e6:4c:64"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af3a3df4b8641c1ac0d02df893b524d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8491a73c-f3", "ovs_interfaceid": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:4c:64,bridge_name='br-int',has_traffic_filtering=True,id=8491a73c-f38b-4cb4-ab87-d6e41992319d,network=Network(db548415-fd97-4612-8699-d431cfe3c1ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8491a73c-f3') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:45:20 user nova-compute[73056]:   <uuid>9c11423c-88d3-4fae-8917-c0d57021d194</uuid>
Aug 14 16:45:20 user nova-compute[73056]:   <name>instance-00000010</name>
Aug 14 16:45:20 user nova-compute[73056]:   <memory>2097152</memory>
Aug 14 16:45:20 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:45:20 user nova-compute[73056]:   <metadata>
Aug 14 16:45:20 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:45:20 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:45:20 user nova-compute[73056]:       <nova:name>tempest-ServerActionsTestOtherB-server-1141868820</nova:name>
Aug 14 16:45:20 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:45:18</nova:creationTime>
Aug 14 16:45:20 user nova-compute[73056]:       <nova:flavor name="m1.small">
Aug 14 16:45:20 user nova-compute[73056]:         <nova:memory>2048</nova:memory>
Aug 14 16:45:20 user nova-compute[73056]:         <nova:disk>20</nova:disk>
Aug 14 16:45:20 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:45:20 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:45:20 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:45:20 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:45:20 user nova-compute[73056]:       <nova:owner>
Aug 14 16:45:20 user nova-compute[73056]:         <nova:user uuid="c39b09d624bb4977b6d1b396f425f737">tempest-ServerActionsTestOtherB-1168667086-project-member</nova:user>
Aug 14 16:45:20 user nova-compute[73056]:         <nova:project uuid="4af3a3df4b8641c1ac0d02df893b524d">tempest-ServerActionsTestOtherB-1168667086</nova:project>
Aug 14 16:45:20 user nova-compute[73056]:       </nova:owner>
Aug 14 16:45:20 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:45:20 user nova-compute[73056]:       <nova:ports>
Aug 14 16:45:20 user nova-compute[73056]:         <nova:port uuid="8491a73c-f38b-4cb4-ab87-d6e41992319d">
Aug 14 16:45:20 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 16:45:20 user nova-compute[73056]:         </nova:port>
Aug 14 16:45:20 user nova-compute[73056]:       </nova:ports>
Aug 14 16:45:20 user nova-compute[73056]:     </nova:instance>
Aug 14 16:45:20 user nova-compute[73056]:   </metadata>
Aug 14 16:45:20 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:45:20 user nova-compute[73056]:     <system>
Aug 14 16:45:20 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:45:20 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:45:20 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:45:20 user nova-compute[73056]:       <entry name="serial">9c11423c-88d3-4fae-8917-c0d57021d194</entry>
Aug 14 16:45:20 user nova-compute[73056]:       <entry name="uuid">9c11423c-88d3-4fae-8917-c0d57021d194</entry>
Aug 14 16:45:20 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:45:20 user nova-compute[73056]:     </system>
Aug 14 16:45:20 user nova-compute[73056]:   </sysinfo>
Aug 14 16:45:20 user nova-compute[73056]:   <os>
Aug 14 16:45:20 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:45:20 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:45:20 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:45:20 user nova-compute[73056]:   </os>
Aug 14 16:45:20 user nova-compute[73056]:   <features>
Aug 14 16:45:20 user nova-compute[73056]:     <acpi/>
Aug 14 16:45:20 user nova-compute[73056]:     <apic/>
Aug 14 16:45:20 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:45:20 user nova-compute[73056]:   </features>
Aug 14 16:45:20 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:45:20 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:45:20 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:45:20 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:45:20 user nova-compute[73056]:   </clock>
Aug 14 16:45:20 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:45:20 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:45:20 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:45:20 user nova-compute[73056]:   </cpu>
Aug 14 16:45:20 user nova-compute[73056]:   <devices>
Aug 14 16:45:20 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:45:20 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:45:20 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk"/>
Aug 14 16:45:20 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:45:20 user nova-compute[73056]:     </disk>
Aug 14 16:45:20 user nova-compute[73056]:     <disk type="block" device="disk">
Aug 14 16:45:20 user nova-compute[73056]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:45:20 user nova-compute[73056]:       <source dev="/dev/sde"/>
Aug 14 16:45:20 user nova-compute[73056]:       <target dev="vdb" bus="virtio"/>
Aug 14 16:45:20 user nova-compute[73056]:       <serial>37a09be2-92fa-4429-a416-13d78c74eda0</serial>
Aug 14 16:45:20 user nova-compute[73056]:     </disk>
Aug 14 16:45:20 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:45:20 user nova-compute[73056]:       <mac address="fa:16:3e:e6:4c:64"/>
Aug 14 16:45:20 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:45:20 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:45:20 user nova-compute[73056]:       <target dev="tap8491a73c-f3"/>
Aug 14 16:45:20 user nova-compute[73056]:     </interface>
Aug 14 16:45:20 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:45:20 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/console.log" append="off"/>
Aug 14 16:45:20 user nova-compute[73056]:     </serial>
Aug 14 16:45:20 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:45:20 user nova-compute[73056]:     <video>
Aug 14 16:45:20 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:45:20 user nova-compute[73056]:     </video>
Aug 14 16:45:20 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:45:20 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:45:20 user nova-compute[73056]:     </rng>
Aug 14 16:45:20 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:45:20 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:45:20 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:45:20 user nova-compute[73056]:     </memballoon>
Aug 14 16:45:20 user nova-compute[73056]:   </devices>
Aug 14 16:45:20 user nova-compute[73056]: </domain>
Aug 14 16:45:20 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:40:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1141868820',display_name='tempest-ServerActionsTestOtherB-server-1141868820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1141868820',id=16,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsc3Uaz7vmbmV86lMnvYNdRaSVfJcdYXdG4vY0wVNgR/VZPzr09+A51tF4EmKhmmLDKglhmcpoAJJc05z8zlcL3Fqhx5uVkS7BbyNbqt0mNNKT7ar0AXFL2PnABSrfDLg==',key_name='tempest-keypair-1532112814',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:41:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4af3a3df4b8641c1ac0d02df893b524d',ramdisk_id='',reservation_id='r-z7s601zt',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1168667086',owner_user_name='tempest-ServerActionsTestOtherB-1168667086-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:45:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c39b09d624bb4977b6d1b396f425f737',uuid=9c11423c-88d3-4fae-8917-c0d57021d194,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "address": "fa:16:3e:e6:4c:64", "network": {"id": "db548415-fd97-4612-8699-d431cfe3c1ec", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-66082327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-66082327-network", "vif_mac": "fa:16:3e:e6:4c:64"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af3a3df4b8641c1ac0d02df893b524d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8491a73c-f3", "ovs_interfaceid": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Converting VIF {"id": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "address": "fa:16:3e:e6:4c:64", "network": {"id": "db548415-fd97-4612-8699-d431cfe3c1ec", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-66082327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-66082327-network", "vif_mac": "fa:16:3e:e6:4c:64"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af3a3df4b8641c1ac0d02df893b524d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8491a73c-f3", "ovs_interfaceid": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:4c:64,bridge_name='br-int',has_traffic_filtering=True,id=8491a73c-f38b-4cb4-ab87-d6e41992319d,network=Network(db548415-fd97-4612-8699-d431cfe3c1ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8491a73c-f3') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG os_vif [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:4c:64,bridge_name='br-int',has_traffic_filtering=True,id=8491a73c-f38b-4cb4-ab87-d6e41992319d,network=Network(db548415-fd97-4612-8699-d431cfe3c1ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8491a73c-f3') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8491a73c-f3, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8491a73c-f3, col_values=(('external_ids', {'iface-id': '8491a73c-f38b-4cb4-ab87-d6e41992319d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:4c:64', 'vm-uuid': '9c11423c-88d3-4fae-8917-c0d57021d194'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff3b7a6-1094-4ec9-ae0e-189877faeaa6]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a (non-flash)
Aug 14 16:45:20 user nova-compute[73056]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)
Aug 14 16:45:20 user nova-compute[73056]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:45:20 user nova-compute[73056]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)
Aug 14 16:45:20 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a (non-flash)
Aug 14 16:45:20 user nova-compute[73056]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)
Aug 14 16:45:20 user nova-compute[73056]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:45:20 user nova-compute[73056]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)
Aug 14 16:45:20 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff2dcd100d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a'): ({'sdb'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Removing single pathed devices sdb {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:20 user nova-compute[73056]: INFO os_vif [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:4c:64,bridge_name='br-int',has_traffic_filtering=True,id=8491a73c-f38b-4cb4-ab87-d6e41992319d,network=Network(db548415-fd97-4612-8699-d431cfe3c1ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8491a73c-f3')
Aug 14 16:45:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ceb56bf-14ca-448a-9985-d55d7b4e7f5f]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15fd778-80d0-40db-92c5-f988fd6ee6c4]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Flushing IO for device /dev/sdb {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec3eec9-4324-4d2d-bead-45ee4714316f]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] No VIF found with MAC fa:16:3e:e6:4c:64, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[6888f5cd-34cf-48be-b45b-faead5306228]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] SCSI volumes sdb have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee0a31d-9c25-4c1b-93c9-1cf62c7a5466]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8285b7-1413-4c3b-bf39-740010cc8abd]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a, portal: 172.16.0.220,3260]
Aug 14 16:45:20 user nova-compute[73056]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a, portal: 172.16.0.220,3260] successful.
Aug 14 16:45:20 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60d4a30-00f7-4874-8488-716b466b4b3a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[86495d34-d991-42a0-929f-b155575c270d]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] <== disconnect_volume: return (739ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:45:20 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Deleting instance files /opt/stack/data/nova/instances/10b527b0-a7f1-4149-9859-69dac9f481e3_del
Aug 14 16:45:20 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Deletion of /opt/stack/data/nova/instances/10b527b0-a7f1-4149-9859-69dac9f481e3_del complete
Aug 14 16:45:20 user nova-compute[73056]: INFO nova.compute.manager [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Took 1.66 seconds to destroy the instance on the hypervisor.
Aug 14 16:45:20 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 16:45:20 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 16:45:21 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:21 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:45:21 user nova-compute[73056]: DEBUG nova.compute.manager [req-2f2d4851-289a-477f-beb6-9b54ebe99549 req-afd577ce-170c-4d9b-a168-bc785b1fcfec service nova] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Received event network-vif-deleted-b97ec96e-9506-4427-b9b1-38f2233a320c {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:45:21 user nova-compute[73056]: INFO nova.compute.manager [req-2f2d4851-289a-477f-beb6-9b54ebe99549 req-afd577ce-170c-4d9b-a168-bc785b1fcfec service nova] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Neutron deleted interface b97ec96e-9506-4427-b9b1-38f2233a320c; detaching it from the instance and deleting it from the info cache
Aug 14 16:45:21 user nova-compute[73056]: DEBUG nova.network.neutron [req-2f2d4851-289a-477f-beb6-9b54ebe99549 req-afd577ce-170c-4d9b-a168-bc785b1fcfec service nova] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:45:21 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Took 0.66 seconds to deallocate network for instance.
Aug 14 16:45:21 user nova-compute[73056]: DEBUG nova.compute.manager [req-2f2d4851-289a-477f-beb6-9b54ebe99549 req-afd577ce-170c-4d9b-a168-bc785b1fcfec service nova] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Detach interface failed, port_id=b97ec96e-9506-4427-b9b1-38f2233a320c, reason: Instance 10b527b0-a7f1-4149-9859-69dac9f481e3 could not be found. {{(pid=73056) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 16:45:21 user nova-compute[73056]: DEBUG nova.compute.manager [req-2efd92f6-c140-40e1-83c2-00aef30b33f7 req-e50d7243-b538-447b-a569-ebf3331f8150 service nova] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Received event network-vif-plugged-b97ec96e-9506-4427-b9b1-38f2233a320c {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:45:21 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2efd92f6-c140-40e1-83c2-00aef30b33f7 req-e50d7243-b538-447b-a569-ebf3331f8150 service nova] Acquiring lock "10b527b0-a7f1-4149-9859-69dac9f481e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:21 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2efd92f6-c140-40e1-83c2-00aef30b33f7 req-e50d7243-b538-447b-a569-ebf3331f8150 service nova] Lock "10b527b0-a7f1-4149-9859-69dac9f481e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:21 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2efd92f6-c140-40e1-83c2-00aef30b33f7 req-e50d7243-b538-447b-a569-ebf3331f8150 service nova] Lock "10b527b0-a7f1-4149-9859-69dac9f481e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:21 user nova-compute[73056]: DEBUG nova.compute.manager [req-2efd92f6-c140-40e1-83c2-00aef30b33f7 req-e50d7243-b538-447b-a569-ebf3331f8150 service nova] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] No waiting events found dispatching network-vif-plugged-b97ec96e-9506-4427-b9b1-38f2233a320c {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:45:21 user nova-compute[73056]: WARNING nova.compute.manager [req-2efd92f6-c140-40e1-83c2-00aef30b33f7 req-e50d7243-b538-447b-a569-ebf3331f8150 service nova] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Received unexpected event network-vif-plugged-b97ec96e-9506-4427-b9b1-38f2233a320c for instance with vm_state active and task_state deleting.
Aug 14 16:45:21 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:21 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:21 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:22 user nova-compute[73056]: DEBUG nova.compute.manager [req-371d54bc-ab17-4721-85f7-ffa2ad91b32b req-6eb038ea-5879-4707-8734-c9d220f1f2ba service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Received event network-vif-plugged-8491a73c-f38b-4cb4-ab87-d6e41992319d {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:45:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-371d54bc-ab17-4721-85f7-ffa2ad91b32b req-6eb038ea-5879-4707-8734-c9d220f1f2ba service nova] Acquiring lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-371d54bc-ab17-4721-85f7-ffa2ad91b32b req-6eb038ea-5879-4707-8734-c9d220f1f2ba service nova] Lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-371d54bc-ab17-4721-85f7-ffa2ad91b32b req-6eb038ea-5879-4707-8734-c9d220f1f2ba service nova] Lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:22 user nova-compute[73056]: DEBUG nova.compute.manager [req-371d54bc-ab17-4721-85f7-ffa2ad91b32b req-6eb038ea-5879-4707-8734-c9d220f1f2ba service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] No waiting events found dispatching network-vif-plugged-8491a73c-f38b-4cb4-ab87-d6e41992319d {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:45:22 user nova-compute[73056]: WARNING nova.compute.manager [req-371d54bc-ab17-4721-85f7-ffa2ad91b32b req-6eb038ea-5879-4707-8734-c9d220f1f2ba service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Received unexpected event network-vif-plugged-8491a73c-f38b-4cb4-ab87-d6e41992319d for instance with vm_state active and task_state resize_finish.
Aug 14 16:45:22 user nova-compute[73056]: INFO nova.compute.manager [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Took 1.11 seconds to detach 1 volumes for instance.
Aug 14 16:45:22 user nova-compute[73056]: DEBUG nova.compute.manager [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Deleting volume: a60d4a30-00f7-4874-8488-716b466b4b3a {{(pid=73056) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 16:45:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:22 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:22 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:22 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:22 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:22 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:23 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:45:23 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:45:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.542s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:23 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Deleted allocations for instance 10b527b0-a7f1-4149-9859-69dac9f481e3
Aug 14 16:45:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d85e9964-c745-42f5-9eca-77625274f7ff tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "10b527b0-a7f1-4149-9859-69dac9f481e3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.344s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:24 user nova-compute[73056]: DEBUG nova.compute.manager [req-9cbd153d-41a0-4654-803c-53b913ce9c42 req-ac51ad0d-fc1b-46ef-96ff-25b3a567c70c service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Received event network-vif-plugged-8491a73c-f38b-4cb4-ab87-d6e41992319d {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:45:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9cbd153d-41a0-4654-803c-53b913ce9c42 req-ac51ad0d-fc1b-46ef-96ff-25b3a567c70c service nova] Acquiring lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9cbd153d-41a0-4654-803c-53b913ce9c42 req-ac51ad0d-fc1b-46ef-96ff-25b3a567c70c service nova] Lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9cbd153d-41a0-4654-803c-53b913ce9c42 req-ac51ad0d-fc1b-46ef-96ff-25b3a567c70c service nova] Lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:24 user nova-compute[73056]: DEBUG nova.compute.manager [req-9cbd153d-41a0-4654-803c-53b913ce9c42 req-ac51ad0d-fc1b-46ef-96ff-25b3a567c70c service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] No waiting events found dispatching network-vif-plugged-8491a73c-f38b-4cb4-ab87-d6e41992319d {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:45:24 user nova-compute[73056]: WARNING nova.compute.manager [req-9cbd153d-41a0-4654-803c-53b913ce9c42 req-ac51ad0d-fc1b-46ef-96ff-25b3a567c70c service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Received unexpected event network-vif-plugged-8491a73c-f38b-4cb4-ab87-d6e41992319d for instance with vm_state active and task_state resize_finish.
Aug 14 16:45:24 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031524.520586, 9c11423c-88d3-4fae-8917-c0d57021d194 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:45:24 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] VM Resumed (Lifecycle Event)
Aug 14 16:45:24 user nova-compute[73056]: DEBUG nova.compute.manager [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:45:24 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Instance running successfully.
Aug 14 16:45:24 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Failed to set time: agent not configured {{(pid=73056) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 14 16:45:24 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-0a33d233-5e10-4b98-93f7-c90fafa4a362 tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] finish_migration finished successfully. {{(pid=73056) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 14 16:45:24 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:45:24 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:45:24 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 16:45:24 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031524.523668, 9c11423c-88d3-4fae-8917-c0d57021d194 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:45:24 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] VM Started (Lifecycle Event)
Aug 14 16:45:24 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:45:24 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:45:24 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 16:45:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:26 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:45:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LNjpRwiH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:45:26 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:45:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:45:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:45:26 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:45:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:45:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:45:26 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:45:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984 -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:26 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[22122af8-3347-4d7e-8ef3-357aeb98be8d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:45:26 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:45:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984 -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:26 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce1a9bb-eb70-4a81-965f-5fb1891df6cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984] added
Aug 14 16:45:26 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:45:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:26 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b0e512-2f6b-4f3f-bf7a-70b5f0700341]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:45:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:26 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0e9504-1692-426e-83d7-f0d4fbdd722d]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:45:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LNjpRwiH {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LNjpRwiH" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:26 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa2c679-0fbe-47ee-962b-49ccc843c914]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LNjpRwiH'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:45:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:27 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:27 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ccdb61-b824-4003-9fc4-bf3985c0db36]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:27 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:45:27 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:27 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:27 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb24963f-45b2-4b80-af67-1241d374b3f3]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:27 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)
Aug 14 16:45:27 user nova-compute[73056]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:45:27 user nova-compute[73056]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)
Aug 14 16:45:27 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:45:27 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)
Aug 14 16:45:27 user nova-compute[73056]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:45:27 user nova-compute[73056]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)
Aug 14 16:45:27 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:45:27 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984 -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:27 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:27 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[320ba602-dcf2-4958-9b04-69266fdce8e8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:27 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984, portal: 172.16.0.220,3260]
Aug 14 16:45:27 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984, portal: 172.16.0.220,3260] successful.
Aug 14 16:45:27 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:45:27 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:27 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:27 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[411a4cb5-3f7a-4ea9-b626-807a83e855ad]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:27 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:45:27 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:27 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:27 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5716d418-7814-42f4-9de1-df3a0d433255]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:27 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)
Aug 14 16:45:27 user nova-compute[73056]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:45:27 user nova-compute[73056]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)
Aug 14 16:45:27 user nova-compute[73056]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984 (non-flash)
Aug 14 16:45:27 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:45:27 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)
Aug 14 16:45:27 user nova-compute[73056]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:45:27 user nova-compute[73056]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)
Aug 14 16:45:27 user nova-compute[73056]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984 (non-flash)
Aug 14 16:45:27 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:45:27 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:45:27 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:45:27 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:45:27 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:45:27 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:27 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:27 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7686c0b4-a4c6-4ba9-a63e-fa1a7743e627]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:27 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: None {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:45:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquiring lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:28 user nova-compute[73056]: DEBUG nova.objects.instance [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lazy-loading 'flavor' on Instance uuid d5dbfa63-5061-4304-b8eb-4565ad9f0a96 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:45:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:28 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:45:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LNjpRwiH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:45:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:45:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] <== connect_volume: return (1412ms) {'type': 'block', 'scsi_wwn': '23466616562363966', 'path': '/dev/sdb'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:45:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466616562363966', 'path': '/dev/sdb'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:45:28 user nova-compute[73056]: DEBUG nova.objects.instance [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Lazy-loading 'flavor' on Instance uuid a6108d44-11ef-4414-889b-35a105195b8e {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:45:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquiring lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:28 user nova-compute[73056]: INFO nova.compute.manager [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Attaching volume 16760dbc-9409-492f-92cc-8d38004d5b3b to /dev/vdb
Aug 14 16:45:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 16:45:28 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:45:28 user nova-compute[73056]:   <source dev="/dev/sdb"/>
Aug 14 16:45:28 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:45:28 user nova-compute[73056]:   <serial>53c3d17d-ee51-4bcb-a0e9-e744f6b3e984</serial>
Aug 14 16:45:28 user nova-compute[73056]: </disk>
Aug 14 16:45:28 user nova-compute[73056]:  {{(pid=73056) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 16:45:28 user nova-compute[73056]: DEBUG os_brick.utils [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:45:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b63d7f4-c67a-47b7-806a-2fd74ba3c31a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fe20ab-86f6-4617-95ed-e9466cf507af]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2718a33-40f8-4997-9424-3ba987597c2a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b5b3ba-eab9-4b42-9225-84a9812a5a15]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:45:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:45:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:45:28 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:45:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[0226a42d-9408-499a-82a3-5fb26b1a65bd]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:45:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:45:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:45:28 user nova-compute[73056]: DEBUG os_brick.utils [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:45:28 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Updating existing volume attachment record: 1035c42b-b03d-4626-943b-28dce3325ce4 {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 16:45:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:45:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:45:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] No VIF found with MAC fa:16:3e:a0:4c:46, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:45:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-247d076f-11b2-4cc9-9248-6310a579a8cc tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Lock "a6108d44-11ef-4414-889b-35a105195b8e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.201s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-1ec28c35-399a-4868-875b-1c279abedbbf tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Acquiring lock "a6108d44-11ef-4414-889b-35a105195b8e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-1ec28c35-399a-4868-875b-1c279abedbbf tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Lock "a6108d44-11ef-4414-889b-35a105195b8e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:31 user nova-compute[73056]: INFO nova.compute.manager [None req-1ec28c35-399a-4868-875b-1c279abedbbf tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Detaching volume 53c3d17d-ee51-4bcb-a0e9-e744f6b3e984
Aug 14 16:45:31 user nova-compute[73056]: INFO nova.virt.block_device [None req-1ec28c35-399a-4868-875b-1c279abedbbf tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Attempting to driver detach volume 53c3d17d-ee51-4bcb-a0e9-e744f6b3e984 from mountpoint /dev/vdb
Aug 14 16:45:31 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-1ec28c35-399a-4868-875b-1c279abedbbf tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Attempting to detach device vdb from instance a6108d44-11ef-4414-889b-35a105195b8e from the persistent domain config. {{(pid=73056) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 16:45:31 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-1ec28c35-399a-4868-875b-1c279abedbbf tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 16:45:31 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:45:31 user nova-compute[73056]:   <source dev="/dev/sdb"/>
Aug 14 16:45:31 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:45:31 user nova-compute[73056]:   <serial>53c3d17d-ee51-4bcb-a0e9-e744f6b3e984</serial>
Aug 14 16:45:31 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 16:45:31 user nova-compute[73056]: </disk>
Aug 14 16:45:31 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 16:45:31 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-1ec28c35-399a-4868-875b-1c279abedbbf tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Successfully detached device vdb from instance a6108d44-11ef-4414-889b-35a105195b8e from the persistent domain config.
Aug 14 16:45:31 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-1ec28c35-399a-4868-875b-1c279abedbbf tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a6108d44-11ef-4414-889b-35a105195b8e from the live domain config. {{(pid=73056) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 16:45:31 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-1ec28c35-399a-4868-875b-1c279abedbbf tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 16:45:31 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:45:31 user nova-compute[73056]:   <source dev="/dev/sdb"/>
Aug 14 16:45:31 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:45:31 user nova-compute[73056]:   <serial>53c3d17d-ee51-4bcb-a0e9-e744f6b3e984</serial>
Aug 14 16:45:31 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 16:45:31 user nova-compute[73056]: </disk>
Aug 14 16:45:31 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 16:45:31 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Received event <DeviceRemovedEvent: 1692031531.9342282, a6108d44-11ef-4414-889b-35a105195b8e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73056) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 16:45:31 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-1ec28c35-399a-4868-875b-1c279abedbbf tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a6108d44-11ef-4414-889b-35a105195b8e {{(pid=73056) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 16:45:31 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-1ec28c35-399a-4868-875b-1c279abedbbf tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Successfully detached device vdb from instance a6108d44-11ef-4414-889b-35a105195b8e from the live domain config.
Aug 14 16:45:31 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ec28c35-399a-4868-875b-1c279abedbbf tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:45:31 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec28c35-399a-4868-875b-1c279abedbbf tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LNjpRwiH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:45:31 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-1ec28c35-399a-4868-875b-1c279abedbbf tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:45:31 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-1ec28c35-399a-4868-875b-1c279abedbbf tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:45:31 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-1ec28c35-399a-4868-875b-1c279abedbbf tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:45:31 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec28c35-399a-4868-875b-1c279abedbbf tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:45:31 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:31 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:31 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[482ca124-3bb9-4c65-803d-ad51c064f61f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:31 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b250264f-db51-417d-9d5a-db475083fc4e]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec28c35-399a-4868-875b-1c279abedbbf tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)
Aug 14 16:45:32 user nova-compute[73056]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:45:32 user nova-compute[73056]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)
Aug 14 16:45:32 user nova-compute[73056]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984 (non-flash)
Aug 14 16:45:32 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:45:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec28c35-399a-4868-875b-1c279abedbbf tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)
Aug 14 16:45:32 user nova-compute[73056]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:45:32 user nova-compute[73056]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)
Aug 14 16:45:32 user nova-compute[73056]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984 (non-flash)
Aug 14 16:45:32 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:45:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec28c35-399a-4868-875b-1c279abedbbf tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff300555f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984'): ({'sdb'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:45:32 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-1ec28c35-399a-4868-875b-1c279abedbbf tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Removing single pathed devices sdb {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:45:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d48367b-fc69-4f34-a2c6-f4ab32dbb65c]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba6434d-5cb9-4cc1-b2d4-4fa6efb4a372]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:32 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-1ec28c35-399a-4868-875b-1c279abedbbf tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Flushing IO for device /dev/sdb {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:45:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d30999-0836-4e84-a4c0-8bf8b6ec07bb]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:32 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-1ec28c35-399a-4868-875b-1c279abedbbf tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:45:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5063d129-635b-456f-bc9d-30c294b8d806]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:32 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-1ec28c35-399a-4868-875b-1c279abedbbf tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:45:32 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-1ec28c35-399a-4868-875b-1c279abedbbf tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] SCSI volumes sdb have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:45:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec28c35-399a-4868-875b-1c279abedbbf tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:45:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2313f9f3-3b99-4e92-bf9e-298aaa1cd5c9]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec28c35-399a-4868-875b-1c279abedbbf tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:45:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984 -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c70daf-4557-4bb8-8476-5858c5c6184d]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec28c35-399a-4868-875b-1c279abedbbf tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984, portal: 172.16.0.220,3260]
Aug 14 16:45:32 user nova-compute[73056]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984, portal: 172.16.0.220,3260] successful.
Aug 14 16:45:32 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:45:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984 -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c3d17d-ee51-4bcb-a0e9-e744f6b3e984 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51d46e7-1aba-4d77-b755-cc3d87ff639f]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec28c35-399a-4868-875b-1c279abedbbf tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:45:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-1ec28c35-399a-4868-875b-1c279abedbbf tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:45:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec28c35-399a-4868-875b-1c279abedbbf tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] <== disconnect_volume: return (334ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:45:32 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ec28c35-399a-4868-875b-1c279abedbbf tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:45:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:34 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692031519.7779205, 10b527b0-a7f1-4149-9859-69dac9f481e3 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:45:34 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] VM Stopped (Lifecycle Event)
Aug 14 16:45:34 user nova-compute[73056]: DEBUG nova.compute.manager [None req-6bfdaf18-b893-4448-aa05-a12b6ef21068 None None] [instance: 10b527b0-a7f1-4149-9859-69dac9f481e3] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:45:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:37 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mnlJqCAo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:45:39 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:45:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:45:39 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:45:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:45:39 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:45:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b -p 172.16.0.220:3260" returned: 21 in 0.031s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6e440f-bbaf-4455-a5ec-8ea5094ccb0d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:45:39 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.059s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8b728a-b8f0-4138-bd52-df50a5a905b0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b] added
Aug 14 16:45:39 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b2131c-97aa-4df7-83e9-00e8eeae3e35]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[410be6b0-2fc4-41fd-b228-7ddc0a269a57]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mnlJqCAo {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG nova.objects.instance [None req-1ec28c35-399a-4868-875b-1c279abedbbf tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Lazy-loading 'flavor' on Instance uuid a6108d44-11ef-4414-889b-35a105195b8e {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mnlJqCAo" returned: 0 in 0.031s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd8daa4-0541-490b-8c3b-4682afc4bdfb]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mnlJqCAo'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c922c81-c341-4e8c-bfde-b5976f8bd1d3]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-1ec28c35-399a-4868-875b-1c279abedbbf tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Lock "a6108d44-11ef-4414-889b-35a105195b8e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.981s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3778de-8235-480d-ac16-878776d3c2ab]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)
Aug 14 16:45:39 user nova-compute[73056]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:45:39 user nova-compute[73056]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)
Aug 14 16:45:39 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)
Aug 14 16:45:39 user nova-compute[73056]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:45:39 user nova-compute[73056]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)
Aug 14 16:45:39 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e4d101-f35e-4e17-bd63-e29fa6381cd5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b, portal: 172.16.0.220,3260]
Aug 14 16:45:39 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b, portal: 172.16.0.220,3260] successful.
Aug 14 16:45:39 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ee096b-1335-4da7-b74c-bb2deb23cbd4]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f771f7d6-b62a-4dbe-a4c0-3d8f7bf38a84]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)
Aug 14 16:45:39 user nova-compute[73056]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:45:39 user nova-compute[73056]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)
Aug 14 16:45:39 user nova-compute[73056]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b (non-flash)
Aug 14 16:45:39 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)
Aug 14 16:45:39 user nova-compute[73056]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:45:39 user nova-compute[73056]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)
Aug 14 16:45:39 user nova-compute[73056]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b (non-flash)
Aug 14 16:45:39 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.388s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec4b315-21e3-4b0d-96b4-82b6edbd8d03]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:45:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mnlJqCAo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:45:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:40 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.424s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:45:40 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] <== connect_volume: return (1426ms) {'type': 'block', 'scsi_wwn': '23639616431633730', 'path': '/dev/sdb'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:45:40 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639616431633730', 'path': '/dev/sdb'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:45:40 user nova-compute[73056]: DEBUG nova.objects.instance [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lazy-loading 'flavor' on Instance uuid d5dbfa63-5061-4304-b8eb-4565ad9f0a96 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:45:40 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 16:45:40 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:45:40 user nova-compute[73056]:   <source dev="/dev/sdb"/>
Aug 14 16:45:40 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:45:40 user nova-compute[73056]:   <serial>16760dbc-9409-492f-92cc-8d38004d5b3b</serial>
Aug 14 16:45:40 user nova-compute[73056]: </disk>
Aug 14 16:45:40 user nova-compute[73056]:  {{(pid=73056) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 16:45:40 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:45:40 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:45:40 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] No VIF found with MAC fa:16:3e:fa:9c:91, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:45:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6fd89a83-a8a7-4a06-970c-f181b90747f4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.768s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:43 user nova-compute[73056]: INFO nova.compute.manager [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Rescuing
Aug 14 16:45:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "refresh_cache-92c34cf0-fd39-49fc-9244-4da8ccae6eec" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:45:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquired lock "refresh_cache-92c34cf0-fd39-49fc-9244-4da8ccae6eec" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:45:43 user nova-compute[73056]: DEBUG nova.network.neutron [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:45:44 user nova-compute[73056]: DEBUG nova.compute.manager [req-3c9f24ff-a831-4ec1-a513-7fba940d18bc req-0dcce623-7fdf-4353-ba0f-23fbc94e1537 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Received event network-changed-4d2af65d-3317-4411-a99d-13f81c27cc4c {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:45:44 user nova-compute[73056]: DEBUG nova.compute.manager [req-3c9f24ff-a831-4ec1-a513-7fba940d18bc req-0dcce623-7fdf-4353-ba0f-23fbc94e1537 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Refreshing instance network info cache due to event network-changed-4d2af65d-3317-4411-a99d-13f81c27cc4c. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:45:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3c9f24ff-a831-4ec1-a513-7fba940d18bc req-0dcce623-7fdf-4353-ba0f-23fbc94e1537 service nova] Acquiring lock "refresh_cache-d5dbfa63-5061-4304-b8eb-4565ad9f0a96" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:45:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3c9f24ff-a831-4ec1-a513-7fba940d18bc req-0dcce623-7fdf-4353-ba0f-23fbc94e1537 service nova] Acquired lock "refresh_cache-d5dbfa63-5061-4304-b8eb-4565ad9f0a96" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:45:44 user nova-compute[73056]: DEBUG nova.network.neutron [req-3c9f24ff-a831-4ec1-a513-7fba940d18bc req-0dcce623-7fdf-4353-ba0f-23fbc94e1537 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Refreshing network info cache for port 4d2af65d-3317-4411-a99d-13f81c27cc4c {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:45:44 user nova-compute[73056]: DEBUG nova.network.neutron [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Updating instance_info_cache with network_info: [{"id": "2a57f016-2b33-46f4-a885-51c4ac8658bb", "address": "fa:16:3e:11:b2:3a", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a57f016-2b", "ovs_interfaceid": "2a57f016-2b33-46f4-a885-51c4ac8658bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:45:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Releasing lock "refresh_cache-92c34cf0-fd39-49fc-9244-4da8ccae6eec" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:45:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:44 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Instance destroyed successfully.
Aug 14 16:45:44 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Attempting rescue
Aug 14 16:45:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73056) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 16:45:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Instance directory exists: not creating {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 16:45:44 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Creating image(s)
Aug 14 16:45:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "/opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "/opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "/opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:44 user nova-compute[73056]: DEBUG nova.objects.instance [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lazy-loading 'trusted_certs' on Instance uuid 92c34cf0-fd39-49fc-9244-4da8ccae6eec {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:45:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "c889592ab94cd0b0ce896f27a2af0323771db234" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:45 user nova-compute[73056]: DEBUG nova.compute.manager [req-577cf4e3-38c3-4863-83f9-00274a2ca8f4 req-64582488-9a53-40b2-b868-99866e0cf520 service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Received event network-vif-unplugged-2a57f016-2b33-46f4-a885-51c4ac8658bb {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:45:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-577cf4e3-38c3-4863-83f9-00274a2ca8f4 req-64582488-9a53-40b2-b868-99866e0cf520 service nova] Acquiring lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-577cf4e3-38c3-4863-83f9-00274a2ca8f4 req-64582488-9a53-40b2-b868-99866e0cf520 service nova] Lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-577cf4e3-38c3-4863-83f9-00274a2ca8f4 req-64582488-9a53-40b2-b868-99866e0cf520 service nova] Lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:45 user nova-compute[73056]: DEBUG nova.compute.manager [req-577cf4e3-38c3-4863-83f9-00274a2ca8f4 req-64582488-9a53-40b2-b868-99866e0cf520 service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] No waiting events found dispatching network-vif-unplugged-2a57f016-2b33-46f4-a885-51c4ac8658bb {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:45:45 user nova-compute[73056]: WARNING nova.compute.manager [req-577cf4e3-38c3-4863-83f9-00274a2ca8f4 req-64582488-9a53-40b2-b868-99866e0cf520 service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Received unexpected event network-vif-unplugged-2a57f016-2b33-46f4-a885-51c4ac8658bb for instance with vm_state active and task_state rescuing.
Aug 14 16:45:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.230s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue" returned: 0 in 0.062s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.298s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:45 user nova-compute[73056]: DEBUG nova.objects.instance [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lazy-loading 'migration_context' on Instance uuid 92c34cf0-fd39-49fc-9244-4da8ccae6eec {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:45:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 16:45:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Start _get_guest_xml network_info=[{"id": "2a57f016-2b33-46f4-a885-51c4ac8658bb", "address": "fa:16:3e:11:b2:3a", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "vif_mac": "fa:16:3e:11:b2:3a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a57f016-2b", "ovs_interfaceid": "2a57f016-2b33-46f4-a885-51c4ac8658bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:45:45 user nova-compute[73056]: DEBUG nova.objects.instance [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lazy-loading 'resources' on Instance uuid 92c34cf0-fd39-49fc-9244-4da8ccae6eec {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:45:45 user nova-compute[73056]: DEBUG nova.objects.instance [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lazy-loading 'numa_topology' on Instance uuid 92c34cf0-fd39-49fc-9244-4da8ccae6eec {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:45:45 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:45:45 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:45:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:45:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:45:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:45:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:45:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:45:45 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:45:45 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:45:45 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:45:45 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:45:45 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:45:45 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:45:45 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:45:45 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:45:45 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:45:45 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:45:45 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:45:45 user nova-compute[73056]: DEBUG nova.objects.instance [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lazy-loading 'vcpu_model' on Instance uuid 92c34cf0-fd39-49fc-9244-4da8ccae6eec {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:45:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:43:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1644142487',display_name='tempest-ServerRescueNegativeTestJSON-server-1644142487',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1644142487',id=23,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:44:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09b7b0f153a945ac9ce96fe462b17fd5',ramdisk_id='',reservation_id='r-sdr5vmlk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-201205905',owner_user_name='tempest-ServerRescueNegativeTestJSON-201205905-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:44:04Z,user_data=None,user_id='e9f89462f2734ec48d78921ab3d654b2',uuid=92c34cf0-fd39-49fc-9244-4da8ccae6eec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a57f016-2b33-46f4-a885-51c4ac8658bb", "address": "fa:16:3e:11:b2:3a", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "vif_mac": "fa:16:3e:11:b2:3a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a57f016-2b", "ovs_interfaceid": "2a57f016-2b33-46f4-a885-51c4ac8658bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:45:45 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Converting VIF {"id": "2a57f016-2b33-46f4-a885-51c4ac8658bb", "address": "fa:16:3e:11:b2:3a", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "vif_mac": "fa:16:3e:11:b2:3a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a57f016-2b", "ovs_interfaceid": "2a57f016-2b33-46f4-a885-51c4ac8658bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:45:45 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:b2:3a,bridge_name='br-int',has_traffic_filtering=True,id=2a57f016-2b33-46f4-a885-51c4ac8658bb,network=Network(9f4305e9-4b75-4f5d-b1b2-f1184c408739),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a57f016-2b') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:45:45 user nova-compute[73056]: DEBUG nova.objects.instance [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lazy-loading 'pci_devices' on Instance uuid 92c34cf0-fd39-49fc-9244-4da8ccae6eec {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:45:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:45:45 user nova-compute[73056]:   <uuid>92c34cf0-fd39-49fc-9244-4da8ccae6eec</uuid>
Aug 14 16:45:45 user nova-compute[73056]:   <name>instance-00000017</name>
Aug 14 16:45:45 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:45:45 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:45:45 user nova-compute[73056]:   <metadata>
Aug 14 16:45:45 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:45:45 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:45:45 user nova-compute[73056]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1644142487</nova:name>
Aug 14 16:45:45 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:45:45</nova:creationTime>
Aug 14 16:45:45 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:45:45 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:45:45 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:45:45 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:45:45 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:45:45 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:45:45 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:45:45 user nova-compute[73056]:       <nova:owner>
Aug 14 16:45:45 user nova-compute[73056]:         <nova:user uuid="e9f89462f2734ec48d78921ab3d654b2">tempest-ServerRescueNegativeTestJSON-201205905-project-member</nova:user>
Aug 14 16:45:45 user nova-compute[73056]:         <nova:project uuid="09b7b0f153a945ac9ce96fe462b17fd5">tempest-ServerRescueNegativeTestJSON-201205905</nova:project>
Aug 14 16:45:45 user nova-compute[73056]:       </nova:owner>
Aug 14 16:45:45 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:45:45 user nova-compute[73056]:       <nova:ports>
Aug 14 16:45:45 user nova-compute[73056]:         <nova:port uuid="2a57f016-2b33-46f4-a885-51c4ac8658bb">
Aug 14 16:45:45 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 16:45:45 user nova-compute[73056]:         </nova:port>
Aug 14 16:45:45 user nova-compute[73056]:       </nova:ports>
Aug 14 16:45:45 user nova-compute[73056]:     </nova:instance>
Aug 14 16:45:45 user nova-compute[73056]:   </metadata>
Aug 14 16:45:45 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:45:45 user nova-compute[73056]:     <system>
Aug 14 16:45:45 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:45:45 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:45:45 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:45:45 user nova-compute[73056]:       <entry name="serial">92c34cf0-fd39-49fc-9244-4da8ccae6eec</entry>
Aug 14 16:45:45 user nova-compute[73056]:       <entry name="uuid">92c34cf0-fd39-49fc-9244-4da8ccae6eec</entry>
Aug 14 16:45:45 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:45:45 user nova-compute[73056]:     </system>
Aug 14 16:45:45 user nova-compute[73056]:   </sysinfo>
Aug 14 16:45:45 user nova-compute[73056]:   <os>
Aug 14 16:45:45 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:45:45 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:45:45 user nova-compute[73056]:   </os>
Aug 14 16:45:45 user nova-compute[73056]:   <features>
Aug 14 16:45:45 user nova-compute[73056]:     <acpi/>
Aug 14 16:45:45 user nova-compute[73056]:     <apic/>
Aug 14 16:45:45 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:45:45 user nova-compute[73056]:   </features>
Aug 14 16:45:45 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:45:45 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:45:45 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:45:45 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:45:45 user nova-compute[73056]:   </clock>
Aug 14 16:45:45 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:45:45 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:45:45 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:45:45 user nova-compute[73056]:   </cpu>
Aug 14 16:45:45 user nova-compute[73056]:   <devices>
Aug 14 16:45:45 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:45:45 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:45:45 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue"/>
Aug 14 16:45:45 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:45:45 user nova-compute[73056]:     </disk>
Aug 14 16:45:45 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:45:45 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:45:45 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk"/>
Aug 14 16:45:45 user nova-compute[73056]:       <target dev="vdb" bus="virtio"/>
Aug 14 16:45:45 user nova-compute[73056]:     </disk>
Aug 14 16:45:45 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:45:45 user nova-compute[73056]:       <mac address="fa:16:3e:11:b2:3a"/>
Aug 14 16:45:45 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:45:45 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:45:45 user nova-compute[73056]:       <target dev="tap2a57f016-2b"/>
Aug 14 16:45:45 user nova-compute[73056]:     </interface>
Aug 14 16:45:45 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:45:45 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/console.log" append="off"/>
Aug 14 16:45:45 user nova-compute[73056]:     </serial>
Aug 14 16:45:45 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:45:45 user nova-compute[73056]:     <video>
Aug 14 16:45:45 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:45:45 user nova-compute[73056]:     </video>
Aug 14 16:45:45 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:45:45 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:45:45 user nova-compute[73056]:     </rng>
Aug 14 16:45:45 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:45:45 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:45:45 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:45:45 user nova-compute[73056]:     </memballoon>
Aug 14 16:45:45 user nova-compute[73056]:   </devices>
Aug 14 16:45:45 user nova-compute[73056]: </domain>
Aug 14 16:45:45 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:45:45 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Instance destroyed successfully.
Aug 14 16:45:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:45:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:45:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] No VIF found with MAC fa:16:3e:11:b2:3a, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:45:46 user nova-compute[73056]: DEBUG nova.network.neutron [req-3c9f24ff-a831-4ec1-a513-7fba940d18bc req-0dcce623-7fdf-4353-ba0f-23fbc94e1537 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Updated VIF entry in instance network info cache for port 4d2af65d-3317-4411-a99d-13f81c27cc4c. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:45:46 user nova-compute[73056]: DEBUG nova.network.neutron [req-3c9f24ff-a831-4ec1-a513-7fba940d18bc req-0dcce623-7fdf-4353-ba0f-23fbc94e1537 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Updating instance_info_cache with network_info: [{"id": "4d2af65d-3317-4411-a99d-13f81c27cc4c", "address": "fa:16:3e:fa:9c:91", "network": {"id": "dd844e8d-9264-4868-819d-0b01ad3b1d41", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-568480417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e6131531ab4553b55ea090d5e7f47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2af65d-33", "ovs_interfaceid": "4d2af65d-3317-4411-a99d-13f81c27cc4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:45:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3c9f24ff-a831-4ec1-a513-7fba940d18bc req-0dcce623-7fdf-4353-ba0f-23fbc94e1537 service nova] Releasing lock "refresh_cache-d5dbfa63-5061-4304-b8eb-4565ad9f0a96" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:45:46 user nova-compute[73056]: DEBUG nova.compute.manager [req-3502a06e-da06-4d88-92a3-ef9ecf40b4c0 req-4cee5fd4-73c2-47b2-9e36-8cddec9b6bd0 service nova] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Received event network-changed-82102e20-784e-4435-9c32-381ae24600f4 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:45:46 user nova-compute[73056]: DEBUG nova.compute.manager [req-3502a06e-da06-4d88-92a3-ef9ecf40b4c0 req-4cee5fd4-73c2-47b2-9e36-8cddec9b6bd0 service nova] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Refreshing instance network info cache due to event network-changed-82102e20-784e-4435-9c32-381ae24600f4. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:45:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3502a06e-da06-4d88-92a3-ef9ecf40b4c0 req-4cee5fd4-73c2-47b2-9e36-8cddec9b6bd0 service nova] Acquiring lock "refresh_cache-e07cfc63-1ce9-466b-aa01-d967be383f45" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:45:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3502a06e-da06-4d88-92a3-ef9ecf40b4c0 req-4cee5fd4-73c2-47b2-9e36-8cddec9b6bd0 service nova] Acquired lock "refresh_cache-e07cfc63-1ce9-466b-aa01-d967be383f45" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:45:46 user nova-compute[73056]: DEBUG nova.network.neutron [req-3502a06e-da06-4d88-92a3-ef9ecf40b4c0 req-4cee5fd4-73c2-47b2-9e36-8cddec9b6bd0 service nova] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Refreshing network info cache for port 82102e20-784e-4435-9c32-381ae24600f4 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:45:46 user nova-compute[73056]: DEBUG nova.network.neutron [req-3502a06e-da06-4d88-92a3-ef9ecf40b4c0 req-4cee5fd4-73c2-47b2-9e36-8cddec9b6bd0 service nova] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Updated VIF entry in instance network info cache for port 82102e20-784e-4435-9c32-381ae24600f4. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:45:46 user nova-compute[73056]: DEBUG nova.network.neutron [req-3502a06e-da06-4d88-92a3-ef9ecf40b4c0 req-4cee5fd4-73c2-47b2-9e36-8cddec9b6bd0 service nova] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Updating instance_info_cache with network_info: [{"id": "82102e20-784e-4435-9c32-381ae24600f4", "address": "fa:16:3e:a7:27:9a", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82102e20-78", "ovs_interfaceid": "82102e20-784e-4435-9c32-381ae24600f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:45:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3502a06e-da06-4d88-92a3-ef9ecf40b4c0 req-4cee5fd4-73c2-47b2-9e36-8cddec9b6bd0 service nova] Releasing lock "refresh_cache-e07cfc63-1ce9-466b-aa01-d967be383f45" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:45:46 user nova-compute[73056]: DEBUG nova.compute.manager [req-7fba8c49-1251-41b1-a059-772cde8ff769 req-7105ebde-0b02-4dc7-9f31-05d8ad3821e6 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Received event network-changed-4d2af65d-3317-4411-a99d-13f81c27cc4c {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:45:46 user nova-compute[73056]: DEBUG nova.compute.manager [req-7fba8c49-1251-41b1-a059-772cde8ff769 req-7105ebde-0b02-4dc7-9f31-05d8ad3821e6 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Refreshing instance network info cache due to event network-changed-4d2af65d-3317-4411-a99d-13f81c27cc4c. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:45:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-7fba8c49-1251-41b1-a059-772cde8ff769 req-7105ebde-0b02-4dc7-9f31-05d8ad3821e6 service nova] Acquiring lock "refresh_cache-d5dbfa63-5061-4304-b8eb-4565ad9f0a96" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:45:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-7fba8c49-1251-41b1-a059-772cde8ff769 req-7105ebde-0b02-4dc7-9f31-05d8ad3821e6 service nova] Acquired lock "refresh_cache-d5dbfa63-5061-4304-b8eb-4565ad9f0a96" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:45:46 user nova-compute[73056]: DEBUG nova.network.neutron [req-7fba8c49-1251-41b1-a059-772cde8ff769 req-7105ebde-0b02-4dc7-9f31-05d8ad3821e6 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Refreshing network info cache for port 4d2af65d-3317-4411-a99d-13f81c27cc4c {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:45:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:47 user nova-compute[73056]: DEBUG nova.compute.manager [req-33222ade-6abc-4f32-9ff4-ade85d7f3534 req-fe775a38-8df2-4563-95df-a9e2887a90d0 service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Received event network-vif-plugged-2a57f016-2b33-46f4-a885-51c4ac8658bb {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:45:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-33222ade-6abc-4f32-9ff4-ade85d7f3534 req-fe775a38-8df2-4563-95df-a9e2887a90d0 service nova] Acquiring lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-33222ade-6abc-4f32-9ff4-ade85d7f3534 req-fe775a38-8df2-4563-95df-a9e2887a90d0 service nova] Lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-33222ade-6abc-4f32-9ff4-ade85d7f3534 req-fe775a38-8df2-4563-95df-a9e2887a90d0 service nova] Lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:47 user nova-compute[73056]: DEBUG nova.compute.manager [req-33222ade-6abc-4f32-9ff4-ade85d7f3534 req-fe775a38-8df2-4563-95df-a9e2887a90d0 service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] No waiting events found dispatching network-vif-plugged-2a57f016-2b33-46f4-a885-51c4ac8658bb {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:45:47 user nova-compute[73056]: WARNING nova.compute.manager [req-33222ade-6abc-4f32-9ff4-ade85d7f3534 req-fe775a38-8df2-4563-95df-a9e2887a90d0 service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Received unexpected event network-vif-plugged-2a57f016-2b33-46f4-a885-51c4ac8658bb for instance with vm_state active and task_state rescuing.
Aug 14 16:45:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-06121fa8-2412-4113-aa88-d23d82eb2fe7 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "e07cfc63-1ce9-466b-aa01-d967be383f45" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-06121fa8-2412-4113-aa88-d23d82eb2fe7 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "e07cfc63-1ce9-466b-aa01-d967be383f45" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-06121fa8-2412-4113-aa88-d23d82eb2fe7 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "e07cfc63-1ce9-466b-aa01-d967be383f45-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-06121fa8-2412-4113-aa88-d23d82eb2fe7 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "e07cfc63-1ce9-466b-aa01-d967be383f45-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-06121fa8-2412-4113-aa88-d23d82eb2fe7 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "e07cfc63-1ce9-466b-aa01-d967be383f45-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:47 user nova-compute[73056]: INFO nova.compute.manager [None req-06121fa8-2412-4113-aa88-d23d82eb2fe7 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Terminating instance
Aug 14 16:45:47 user nova-compute[73056]: DEBUG nova.compute.manager [None req-06121fa8-2412-4113-aa88-d23d82eb2fe7 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 16:45:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-96623d5f-f017-4670-9ca8-4595458fa19d tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquiring lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-96623d5f-f017-4670-9ca8-4595458fa19d tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:47 user nova-compute[73056]: INFO nova.compute.manager [None req-96623d5f-f017-4670-9ca8-4595458fa19d tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Rebooting instance
Aug 14 16:45:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-96623d5f-f017-4670-9ca8-4595458fa19d tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquiring lock "refresh_cache-d5dbfa63-5061-4304-b8eb-4565ad9f0a96" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:45:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:47 user nova-compute[73056]: DEBUG nova.network.neutron [req-7fba8c49-1251-41b1-a059-772cde8ff769 req-7105ebde-0b02-4dc7-9f31-05d8ad3821e6 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Updated VIF entry in instance network info cache for port 4d2af65d-3317-4411-a99d-13f81c27cc4c. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:45:47 user nova-compute[73056]: DEBUG nova.network.neutron [req-7fba8c49-1251-41b1-a059-772cde8ff769 req-7105ebde-0b02-4dc7-9f31-05d8ad3821e6 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Updating instance_info_cache with network_info: [{"id": "4d2af65d-3317-4411-a99d-13f81c27cc4c", "address": "fa:16:3e:fa:9c:91", "network": {"id": "dd844e8d-9264-4868-819d-0b01ad3b1d41", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-568480417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e6131531ab4553b55ea090d5e7f47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2af65d-33", "ovs_interfaceid": "4d2af65d-3317-4411-a99d-13f81c27cc4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:45:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-7fba8c49-1251-41b1-a059-772cde8ff769 req-7105ebde-0b02-4dc7-9f31-05d8ad3821e6 service nova] Releasing lock "refresh_cache-d5dbfa63-5061-4304-b8eb-4565ad9f0a96" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:45:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-96623d5f-f017-4670-9ca8-4595458fa19d tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquired lock "refresh_cache-d5dbfa63-5061-4304-b8eb-4565ad9f0a96" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:45:47 user nova-compute[73056]: DEBUG nova.network.neutron [None req-96623d5f-f017-4670-9ca8-4595458fa19d tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:45:48 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Instance destroyed successfully.
Aug 14 16:45:48 user nova-compute[73056]: DEBUG nova.objects.instance [None req-06121fa8-2412-4113-aa88-d23d82eb2fe7 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lazy-loading 'resources' on Instance uuid e07cfc63-1ce9-466b-aa01-d967be383f45 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:45:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-06121fa8-2412-4113-aa88-d23d82eb2fe7 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:43:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-553857250',display_name='tempest-AttachVolumeNegativeTest-server-553857250',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-553857250',id=24,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIe3182qMidWG86P4SQvq7Inq83ggFpuOR/R5zHMZ1p+W02VIcyEqOfjD/R7QVMksSnkBWrRqPR18S1znRVa3ooRtWQ9nDAnF9XNBneY3h9KQY+7rdSx6S9T2Z397Suhig==',key_name='tempest-keypair-1409094913',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:44:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d5a8e599b3141339ed0ae6729031b36',ramdisk_id='',reservation_id='r-74p70b5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-860464885',owner_user_name='tempest-AttachVolumeNegativeTest-860464885-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:44:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dad45adee1047bda7350d8a3f8a2f54',uuid=e07cfc63-1ce9-466b-aa01-d967be383f45,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82102e20-784e-4435-9c32-381ae24600f4", "address": "fa:16:3e:a7:27:9a", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82102e20-78", "ovs_interfaceid": "82102e20-784e-4435-9c32-381ae24600f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:45:48 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-06121fa8-2412-4113-aa88-d23d82eb2fe7 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Converting VIF {"id": "82102e20-784e-4435-9c32-381ae24600f4", "address": "fa:16:3e:a7:27:9a", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82102e20-78", "ovs_interfaceid": "82102e20-784e-4435-9c32-381ae24600f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:45:48 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-06121fa8-2412-4113-aa88-d23d82eb2fe7 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:27:9a,bridge_name='br-int',has_traffic_filtering=True,id=82102e20-784e-4435-9c32-381ae24600f4,network=Network(ad323a8d-7318-46f5-8af4-cbc61ae589b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82102e20-78') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:45:48 user nova-compute[73056]: DEBUG os_vif [None req-06121fa8-2412-4113-aa88-d23d82eb2fe7 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:27:9a,bridge_name='br-int',has_traffic_filtering=True,id=82102e20-784e-4435-9c32-381ae24600f4,network=Network(ad323a8d-7318-46f5-8af4-cbc61ae589b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82102e20-78') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:45:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap82102e20-78, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:45:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:45:48 user nova-compute[73056]: INFO os_vif [None req-06121fa8-2412-4113-aa88-d23d82eb2fe7 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:27:9a,bridge_name='br-int',has_traffic_filtering=True,id=82102e20-784e-4435-9c32-381ae24600f4,network=Network(ad323a8d-7318-46f5-8af4-cbc61ae589b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82102e20-78')
Aug 14 16:45:48 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-06121fa8-2412-4113-aa88-d23d82eb2fe7 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Deleting instance files /opt/stack/data/nova/instances/e07cfc63-1ce9-466b-aa01-d967be383f45_del
Aug 14 16:45:48 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-06121fa8-2412-4113-aa88-d23d82eb2fe7 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Deletion of /opt/stack/data/nova/instances/e07cfc63-1ce9-466b-aa01-d967be383f45_del complete
Aug 14 16:45:48 user nova-compute[73056]: INFO nova.compute.manager [None req-06121fa8-2412-4113-aa88-d23d82eb2fe7 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 14 16:45:48 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-06121fa8-2412-4113-aa88-d23d82eb2fe7 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 16:45:48 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 16:45:48 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 16:45:48 user nova-compute[73056]: DEBUG nova.network.neutron [None req-96623d5f-f017-4670-9ca8-4595458fa19d tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Updating instance_info_cache with network_info: [{"id": "4d2af65d-3317-4411-a99d-13f81c27cc4c", "address": "fa:16:3e:fa:9c:91", "network": {"id": "dd844e8d-9264-4868-819d-0b01ad3b1d41", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-568480417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e6131531ab4553b55ea090d5e7f47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2af65d-33", "ovs_interfaceid": "4d2af65d-3317-4411-a99d-13f81c27cc4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:45:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-96623d5f-f017-4670-9ca8-4595458fa19d tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Releasing lock "refresh_cache-d5dbfa63-5061-4304-b8eb-4565ad9f0a96" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:45:48 user nova-compute[73056]: DEBUG nova.compute.manager [None req-96623d5f-f017-4670-9ca8-4595458fa19d tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:45:49 user nova-compute[73056]: DEBUG nova.compute.manager [req-6d1d5fb5-7816-47c3-b34c-78276a056f39 req-4a528aac-3ae7-422e-aea7-a62bfa1c3045 service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Received event network-vif-plugged-2a57f016-2b33-46f4-a885-51c4ac8658bb {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:45:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6d1d5fb5-7816-47c3-b34c-78276a056f39 req-4a528aac-3ae7-422e-aea7-a62bfa1c3045 service nova] Acquiring lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6d1d5fb5-7816-47c3-b34c-78276a056f39 req-4a528aac-3ae7-422e-aea7-a62bfa1c3045 service nova] Lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6d1d5fb5-7816-47c3-b34c-78276a056f39 req-4a528aac-3ae7-422e-aea7-a62bfa1c3045 service nova] Lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:49 user nova-compute[73056]: DEBUG nova.compute.manager [req-6d1d5fb5-7816-47c3-b34c-78276a056f39 req-4a528aac-3ae7-422e-aea7-a62bfa1c3045 service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] No waiting events found dispatching network-vif-plugged-2a57f016-2b33-46f4-a885-51c4ac8658bb {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:45:49 user nova-compute[73056]: WARNING nova.compute.manager [req-6d1d5fb5-7816-47c3-b34c-78276a056f39 req-4a528aac-3ae7-422e-aea7-a62bfa1c3045 service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Received unexpected event network-vif-plugged-2a57f016-2b33-46f4-a885-51c4ac8658bb for instance with vm_state active and task_state rescuing.
Aug 14 16:45:49 user nova-compute[73056]: DEBUG nova.compute.manager [req-6d1d5fb5-7816-47c3-b34c-78276a056f39 req-4a528aac-3ae7-422e-aea7-a62bfa1c3045 service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Received event network-vif-plugged-2a57f016-2b33-46f4-a885-51c4ac8658bb {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:45:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6d1d5fb5-7816-47c3-b34c-78276a056f39 req-4a528aac-3ae7-422e-aea7-a62bfa1c3045 service nova] Acquiring lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6d1d5fb5-7816-47c3-b34c-78276a056f39 req-4a528aac-3ae7-422e-aea7-a62bfa1c3045 service nova] Lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6d1d5fb5-7816-47c3-b34c-78276a056f39 req-4a528aac-3ae7-422e-aea7-a62bfa1c3045 service nova] Lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:49 user nova-compute[73056]: DEBUG nova.compute.manager [req-6d1d5fb5-7816-47c3-b34c-78276a056f39 req-4a528aac-3ae7-422e-aea7-a62bfa1c3045 service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] No waiting events found dispatching network-vif-plugged-2a57f016-2b33-46f4-a885-51c4ac8658bb {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:45:49 user nova-compute[73056]: WARNING nova.compute.manager [req-6d1d5fb5-7816-47c3-b34c-78276a056f39 req-4a528aac-3ae7-422e-aea7-a62bfa1c3045 service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Received unexpected event network-vif-plugged-2a57f016-2b33-46f4-a885-51c4ac8658bb for instance with vm_state active and task_state rescuing.
Aug 14 16:45:49 user nova-compute[73056]: DEBUG nova.compute.manager [req-66a59968-9d17-4423-b691-6c4c7f8c0de7 req-61ef50c9-aeee-4cec-8513-f1466b9bf8fa service nova] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Received event network-vif-unplugged-82102e20-784e-4435-9c32-381ae24600f4 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:45:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-66a59968-9d17-4423-b691-6c4c7f8c0de7 req-61ef50c9-aeee-4cec-8513-f1466b9bf8fa service nova] Acquiring lock "e07cfc63-1ce9-466b-aa01-d967be383f45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-66a59968-9d17-4423-b691-6c4c7f8c0de7 req-61ef50c9-aeee-4cec-8513-f1466b9bf8fa service nova] Lock "e07cfc63-1ce9-466b-aa01-d967be383f45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-66a59968-9d17-4423-b691-6c4c7f8c0de7 req-61ef50c9-aeee-4cec-8513-f1466b9bf8fa service nova] Lock "e07cfc63-1ce9-466b-aa01-d967be383f45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:49 user nova-compute[73056]: DEBUG nova.compute.manager [req-66a59968-9d17-4423-b691-6c4c7f8c0de7 req-61ef50c9-aeee-4cec-8513-f1466b9bf8fa service nova] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] No waiting events found dispatching network-vif-unplugged-82102e20-784e-4435-9c32-381ae24600f4 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:45:49 user nova-compute[73056]: DEBUG nova.compute.manager [req-66a59968-9d17-4423-b691-6c4c7f8c0de7 req-61ef50c9-aeee-4cec-8513-f1466b9bf8fa service nova] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Received event network-vif-unplugged-82102e20-784e-4435-9c32-381ae24600f4 for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:45:49 user nova-compute[73056]: DEBUG nova.compute.manager [req-66a59968-9d17-4423-b691-6c4c7f8c0de7 req-61ef50c9-aeee-4cec-8513-f1466b9bf8fa service nova] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Received event network-vif-plugged-82102e20-784e-4435-9c32-381ae24600f4 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:45:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-66a59968-9d17-4423-b691-6c4c7f8c0de7 req-61ef50c9-aeee-4cec-8513-f1466b9bf8fa service nova] Acquiring lock "e07cfc63-1ce9-466b-aa01-d967be383f45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-66a59968-9d17-4423-b691-6c4c7f8c0de7 req-61ef50c9-aeee-4cec-8513-f1466b9bf8fa service nova] Lock "e07cfc63-1ce9-466b-aa01-d967be383f45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-66a59968-9d17-4423-b691-6c4c7f8c0de7 req-61ef50c9-aeee-4cec-8513-f1466b9bf8fa service nova] Lock "e07cfc63-1ce9-466b-aa01-d967be383f45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:49 user nova-compute[73056]: DEBUG nova.compute.manager [req-66a59968-9d17-4423-b691-6c4c7f8c0de7 req-61ef50c9-aeee-4cec-8513-f1466b9bf8fa service nova] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] No waiting events found dispatching network-vif-plugged-82102e20-784e-4435-9c32-381ae24600f4 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:45:49 user nova-compute[73056]: WARNING nova.compute.manager [req-66a59968-9d17-4423-b691-6c4c7f8c0de7 req-61ef50c9-aeee-4cec-8513-f1466b9bf8fa service nova] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Received unexpected event network-vif-plugged-82102e20-784e-4435-9c32-381ae24600f4 for instance with vm_state active and task_state deleting.
Aug 14 16:45:49 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Removed pending event for 92c34cf0-fd39-49fc-9244-4da8ccae6eec due to event {{(pid=73056) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 16:45:49 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031549.5760138, 92c34cf0-fd39-49fc-9244-4da8ccae6eec => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:45:49 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] VM Resumed (Lifecycle Event)
Aug 14 16:45:49 user nova-compute[73056]: DEBUG nova.compute.manager [None req-7f19eb74-a17e-434f-a7fe-1f72f5faaa47 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:45:49 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:45:49 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:45:49 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 16:45:49 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031549.5773718, 92c34cf0-fd39-49fc-9244-4da8ccae6eec => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:45:49 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] VM Started (Lifecycle Event)
Aug 14 16:45:49 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:45:49 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:45:49 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:45:49 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Took 1.51 seconds to deallocate network for instance.
Aug 14 16:45:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-06121fa8-2412-4113-aa88-d23d82eb2fe7 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-06121fa8-2412-4113-aa88-d23d82eb2fe7 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:50 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-06121fa8-2412-4113-aa88-d23d82eb2fe7 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:45:50 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-06121fa8-2412-4113-aa88-d23d82eb2fe7 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:45:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-06121fa8-2412-4113-aa88-d23d82eb2fe7 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.413s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:50 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-06121fa8-2412-4113-aa88-d23d82eb2fe7 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Deleted allocations for instance e07cfc63-1ce9-466b-aa01-d967be383f45
Aug 14 16:45:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-06121fa8-2412-4113-aa88-d23d82eb2fe7 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "e07cfc63-1ce9-466b-aa01-d967be383f45" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.131s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-0cd9ebbd-2768-4697-8dd7-a355209731f4 req-6b47d86f-0792-481e-bbcf-1e5ca69dd775 service nova] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Received event network-vif-deleted-82102e20-784e-4435-9c32-381ae24600f4 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:45:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-0cd9ebbd-2768-4697-8dd7-a355209731f4 req-6b47d86f-0792-481e-bbcf-1e5ca69dd775 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Received event network-vif-unplugged-4d2af65d-3317-4411-a99d-13f81c27cc4c {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:45:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0cd9ebbd-2768-4697-8dd7-a355209731f4 req-6b47d86f-0792-481e-bbcf-1e5ca69dd775 service nova] Acquiring lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0cd9ebbd-2768-4697-8dd7-a355209731f4 req-6b47d86f-0792-481e-bbcf-1e5ca69dd775 service nova] Lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0cd9ebbd-2768-4697-8dd7-a355209731f4 req-6b47d86f-0792-481e-bbcf-1e5ca69dd775 service nova] Lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-0cd9ebbd-2768-4697-8dd7-a355209731f4 req-6b47d86f-0792-481e-bbcf-1e5ca69dd775 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] No waiting events found dispatching network-vif-unplugged-4d2af65d-3317-4411-a99d-13f81c27cc4c {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:45:51 user nova-compute[73056]: WARNING nova.compute.manager [req-0cd9ebbd-2768-4697-8dd7-a355209731f4 req-6b47d86f-0792-481e-bbcf-1e5ca69dd775 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Received unexpected event network-vif-unplugged-4d2af65d-3317-4411-a99d-13f81c27cc4c for instance with vm_state active and task_state reboot_started.
Aug 14 16:45:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:51 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-96623d5f-f017-4670-9ca8-4595458fa19d tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Instance shutdown successfully.
Aug 14 16:45:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-8d792794-92d7-42c2-ae02-2dd9d1339ac2 req-70851d42-827c-476c-90b9-494b279d61a6 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Received event network-vif-plugged-4d2af65d-3317-4411-a99d-13f81c27cc4c {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:45:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8d792794-92d7-42c2-ae02-2dd9d1339ac2 req-70851d42-827c-476c-90b9-494b279d61a6 service nova] Acquiring lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8d792794-92d7-42c2-ae02-2dd9d1339ac2 req-70851d42-827c-476c-90b9-494b279d61a6 service nova] Lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8d792794-92d7-42c2-ae02-2dd9d1339ac2 req-70851d42-827c-476c-90b9-494b279d61a6 service nova] Lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-8d792794-92d7-42c2-ae02-2dd9d1339ac2 req-70851d42-827c-476c-90b9-494b279d61a6 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] No waiting events found dispatching network-vif-plugged-4d2af65d-3317-4411-a99d-13f81c27cc4c {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:45:53 user nova-compute[73056]: WARNING nova.compute.manager [req-8d792794-92d7-42c2-ae02-2dd9d1339ac2 req-70851d42-827c-476c-90b9-494b279d61a6 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Received unexpected event network-vif-plugged-4d2af65d-3317-4411-a99d-13f81c27cc4c for instance with vm_state active and task_state reboot_started.
Aug 14 16:45:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-8d792794-92d7-42c2-ae02-2dd9d1339ac2 req-70851d42-827c-476c-90b9-494b279d61a6 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Received event network-vif-plugged-4d2af65d-3317-4411-a99d-13f81c27cc4c {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:45:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8d792794-92d7-42c2-ae02-2dd9d1339ac2 req-70851d42-827c-476c-90b9-494b279d61a6 service nova] Acquiring lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8d792794-92d7-42c2-ae02-2dd9d1339ac2 req-70851d42-827c-476c-90b9-494b279d61a6 service nova] Lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8d792794-92d7-42c2-ae02-2dd9d1339ac2 req-70851d42-827c-476c-90b9-494b279d61a6 service nova] Lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-8d792794-92d7-42c2-ae02-2dd9d1339ac2 req-70851d42-827c-476c-90b9-494b279d61a6 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] No waiting events found dispatching network-vif-plugged-4d2af65d-3317-4411-a99d-13f81c27cc4c {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:45:53 user nova-compute[73056]: WARNING nova.compute.manager [req-8d792794-92d7-42c2-ae02-2dd9d1339ac2 req-70851d42-827c-476c-90b9-494b279d61a6 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Received unexpected event network-vif-plugged-4d2af65d-3317-4411-a99d-13f81c27cc4c for instance with vm_state active and task_state reboot_started.
Aug 14 16:45:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-8d792794-92d7-42c2-ae02-2dd9d1339ac2 req-70851d42-827c-476c-90b9-494b279d61a6 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Received event network-vif-plugged-4d2af65d-3317-4411-a99d-13f81c27cc4c {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:45:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8d792794-92d7-42c2-ae02-2dd9d1339ac2 req-70851d42-827c-476c-90b9-494b279d61a6 service nova] Acquiring lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8d792794-92d7-42c2-ae02-2dd9d1339ac2 req-70851d42-827c-476c-90b9-494b279d61a6 service nova] Lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8d792794-92d7-42c2-ae02-2dd9d1339ac2 req-70851d42-827c-476c-90b9-494b279d61a6 service nova] Lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-8d792794-92d7-42c2-ae02-2dd9d1339ac2 req-70851d42-827c-476c-90b9-494b279d61a6 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] No waiting events found dispatching network-vif-plugged-4d2af65d-3317-4411-a99d-13f81c27cc4c {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:45:53 user nova-compute[73056]: WARNING nova.compute.manager [req-8d792794-92d7-42c2-ae02-2dd9d1339ac2 req-70851d42-827c-476c-90b9-494b279d61a6 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Received unexpected event network-vif-plugged-4d2af65d-3317-4411-a99d-13f81c27cc4c for instance with vm_state active and task_state reboot_started.
Aug 14 16:45:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-8d792794-92d7-42c2-ae02-2dd9d1339ac2 req-70851d42-827c-476c-90b9-494b279d61a6 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Received event network-vif-unplugged-4d2af65d-3317-4411-a99d-13f81c27cc4c {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:45:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8d792794-92d7-42c2-ae02-2dd9d1339ac2 req-70851d42-827c-476c-90b9-494b279d61a6 service nova] Acquiring lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8d792794-92d7-42c2-ae02-2dd9d1339ac2 req-70851d42-827c-476c-90b9-494b279d61a6 service nova] Lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8d792794-92d7-42c2-ae02-2dd9d1339ac2 req-70851d42-827c-476c-90b9-494b279d61a6 service nova] Lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-8d792794-92d7-42c2-ae02-2dd9d1339ac2 req-70851d42-827c-476c-90b9-494b279d61a6 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] No waiting events found dispatching network-vif-unplugged-4d2af65d-3317-4411-a99d-13f81c27cc4c {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:45:53 user nova-compute[73056]: WARNING nova.compute.manager [req-8d792794-92d7-42c2-ae02-2dd9d1339ac2 req-70851d42-827c-476c-90b9-494b279d61a6 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Received unexpected event network-vif-unplugged-4d2af65d-3317-4411-a99d-13f81c27cc4c for instance with vm_state active and task_state reboot_started.
Aug 14 16:45:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-8d792794-92d7-42c2-ae02-2dd9d1339ac2 req-70851d42-827c-476c-90b9-494b279d61a6 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Received event network-vif-plugged-4d2af65d-3317-4411-a99d-13f81c27cc4c {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:45:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8d792794-92d7-42c2-ae02-2dd9d1339ac2 req-70851d42-827c-476c-90b9-494b279d61a6 service nova] Acquiring lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8d792794-92d7-42c2-ae02-2dd9d1339ac2 req-70851d42-827c-476c-90b9-494b279d61a6 service nova] Lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8d792794-92d7-42c2-ae02-2dd9d1339ac2 req-70851d42-827c-476c-90b9-494b279d61a6 service nova] Lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-8d792794-92d7-42c2-ae02-2dd9d1339ac2 req-70851d42-827c-476c-90b9-494b279d61a6 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] No waiting events found dispatching network-vif-plugged-4d2af65d-3317-4411-a99d-13f81c27cc4c {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:45:53 user nova-compute[73056]: WARNING nova.compute.manager [req-8d792794-92d7-42c2-ae02-2dd9d1339ac2 req-70851d42-827c-476c-90b9-494b279d61a6 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Received unexpected event network-vif-plugged-4d2af65d-3317-4411-a99d-13f81c27cc4c for instance with vm_state active and task_state reboot_started.
Aug 14 16:45:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:54 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:54 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:45:54 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:45:54 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:45:54 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 16:45:55 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:45:55 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:45:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:55 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 16:45:55 user nova-compute[73056]: DEBUG nova.compute.manager [req-57ea4f56-a9e6-489d-8b94-3a3671d7ce09 req-fbec086f-56d9-48ae-a9d7-b9be6fc8e8f0 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Received event network-vif-plugged-4d2af65d-3317-4411-a99d-13f81c27cc4c {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:45:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-57ea4f56-a9e6-489d-8b94-3a3671d7ce09 req-fbec086f-56d9-48ae-a9d7-b9be6fc8e8f0 service nova] Acquiring lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-57ea4f56-a9e6-489d-8b94-3a3671d7ce09 req-fbec086f-56d9-48ae-a9d7-b9be6fc8e8f0 service nova] Lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-57ea4f56-a9e6-489d-8b94-3a3671d7ce09 req-fbec086f-56d9-48ae-a9d7-b9be6fc8e8f0 service nova] Lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:55 user nova-compute[73056]: DEBUG nova.compute.manager [req-57ea4f56-a9e6-489d-8b94-3a3671d7ce09 req-fbec086f-56d9-48ae-a9d7-b9be6fc8e8f0 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] No waiting events found dispatching network-vif-plugged-4d2af65d-3317-4411-a99d-13f81c27cc4c {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:45:55 user nova-compute[73056]: WARNING nova.compute.manager [req-57ea4f56-a9e6-489d-8b94-3a3671d7ce09 req-fbec086f-56d9-48ae-a9d7-b9be6fc8e8f0 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Received unexpected event network-vif-plugged-4d2af65d-3317-4411-a99d-13f81c27cc4c for instance with vm_state active and task_state reboot_started.
Aug 14 16:45:55 user nova-compute[73056]: DEBUG nova.compute.manager [req-57ea4f56-a9e6-489d-8b94-3a3671d7ce09 req-fbec086f-56d9-48ae-a9d7-b9be6fc8e8f0 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Received event network-vif-plugged-4d2af65d-3317-4411-a99d-13f81c27cc4c {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:45:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-57ea4f56-a9e6-489d-8b94-3a3671d7ce09 req-fbec086f-56d9-48ae-a9d7-b9be6fc8e8f0 service nova] Acquiring lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:45:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-57ea4f56-a9e6-489d-8b94-3a3671d7ce09 req-fbec086f-56d9-48ae-a9d7-b9be6fc8e8f0 service nova] Lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:45:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-57ea4f56-a9e6-489d-8b94-3a3671d7ce09 req-fbec086f-56d9-48ae-a9d7-b9be6fc8e8f0 service nova] Lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:55 user nova-compute[73056]: DEBUG nova.compute.manager [req-57ea4f56-a9e6-489d-8b94-3a3671d7ce09 req-fbec086f-56d9-48ae-a9d7-b9be6fc8e8f0 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] No waiting events found dispatching network-vif-plugged-4d2af65d-3317-4411-a99d-13f81c27cc4c {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:45:55 user nova-compute[73056]: WARNING nova.compute.manager [req-57ea4f56-a9e6-489d-8b94-3a3671d7ce09 req-fbec086f-56d9-48ae-a9d7-b9be6fc8e8f0 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Received unexpected event network-vif-plugged-4d2af65d-3317-4411-a99d-13f81c27cc4c for instance with vm_state active and task_state reboot_started.
Aug 14 16:45:55 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Removed pending event for d5dbfa63-5061-4304-b8eb-4565ad9f0a96 due to event {{(pid=73056) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 16:45:55 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031555.6615508, d5dbfa63-5061-4304-b8eb-4565ad9f0a96 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:45:55 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] VM Resumed (Lifecycle Event)
Aug 14 16:45:55 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Instance running successfully.
Aug 14 16:45:55 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-96623d5f-f017-4670-9ca8-4595458fa19d tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Instance soft rebooted successfully.
Aug 14 16:45:55 user nova-compute[73056]: DEBUG nova.compute.manager [None req-96623d5f-f017-4670-9ca8-4595458fa19d tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:45:55 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:45:55 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:45:55 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 14 16:45:55 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031555.661987, d5dbfa63-5061-4304-b8eb-4565ad9f0a96 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:45:55 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] VM Started (Lifecycle Event)
Aug 14 16:45:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-96623d5f-f017-4670-9ca8-4595458fa19d tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.294s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:45:55 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:45:55 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:45:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6108d44-11ef-4414-889b-35a105195b8e/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6108d44-11ef-4414-889b-35a105195b8e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6108d44-11ef-4414-889b-35a105195b8e/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6108d44-11ef-4414-889b-35a105195b8e/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feea14e-10f2-4282-8137-2a5a289eda41/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feea14e-10f2-4282-8137-2a5a289eda41/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feea14e-10f2-4282-8137-2a5a289eda41/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feea14e-10f2-4282-8137-2a5a289eda41/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dbfa63-5061-4304-b8eb-4565ad9f0a96/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dbfa63-5061-4304-b8eb-4565ad9f0a96/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dbfa63-5061-4304-b8eb-4565ad9f0a96/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dbfa63-5061-4304-b8eb-4565ad9f0a96/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:45:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:45:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:58 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:45:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:45:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:45:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk.rescue --force-share --output=json" returned: 0 in 0.234s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:45:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3270811-8241-47a6-aa36-0ec3feddf0fc/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3270811-8241-47a6-aa36-0ec3feddf0fc/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3270811-8241-47a6-aa36-0ec3feddf0fc/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3270811-8241-47a6-aa36-0ec3feddf0fc/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:46:01 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:46:01 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:46:01 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=7229MB free_disk=25.23687744140625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 16:46:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:46:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:46:01 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Applying migration context for instance 9c11423c-88d3-4fae-8917-c0d57021d194 as it has an incoming, in-progress migration 701fbf5b-29e5-4606-87a2-d8733de0a2f1. Migration status is finished {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 14 16:46:01 user nova-compute[73056]: INFO nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Updating resource usage from migration 701fbf5b-29e5-4606-87a2-d8733de0a2f1
Aug 14 16:46:01 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 9f3a7f8a-e3b9-4918-9663-968677fe5c90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:46:01 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 4731f355-9307-4176-910b-cf35beb85e75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:46:01 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance b3270811-8241-47a6-aa36-0ec3feddf0fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:46:01 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance a6108d44-11ef-4414-889b-35a105195b8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:46:01 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance d5dbfa63-5061-4304-b8eb-4565ad9f0a96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:46:01 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance b580e3d0-88b5-42a3-a953-84b94c088f41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:46:01 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 92c34cf0-fd39-49fc-9244-4da8ccae6eec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:46:01 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Migration 701fbf5b-29e5-4606-87a2-d8733de0a2f1 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 14 16:46:01 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 9c11423c-88d3-4fae-8917-c0d57021d194 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:46:01 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 1feea14e-10f2-4282-8137-2a5a289eda41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:46:01 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 16:46:01 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 16:46:01 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:46:01 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:46:01 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 16:46:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.698s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:46:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:03 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692031548.0867374, e07cfc63-1ce9-466b-aa01-d967be383f45 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:46:03 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] VM Stopped (Lifecycle Event)
Aug 14 16:46:03 user nova-compute[73056]: DEBUG nova.compute.manager [None req-1e833719-f62c-4d04-9804-bab1ef7521bf None None] [instance: e07cfc63-1ce9-466b-aa01-d967be383f45] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:46:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:03 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:46:03 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:46:03 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 16:46:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-4731f355-9307-4176-910b-cf35beb85e75" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:46:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-4731f355-9307-4176-910b-cf35beb85e75" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:46:04 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 16:46:05 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Updating instance_info_cache with network_info: [{"id": "83386dcc-c4f0-49aa-8bd0-43fd3b202c46", "address": "fa:16:3e:2d:f9:8e", "network": {"id": "cf5d30f2-97c6-4785-83d2-549eeb6eca88", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1151628801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd5d50a2601044b5aef50a0d0c6e311a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83386dcc-c4", "ovs_interfaceid": "83386dcc-c4f0-49aa-8bd0-43fd3b202c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:46:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-4731f355-9307-4176-910b-cf35beb85e75" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:46:05 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 16:46:05 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:46:05 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:46:05 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:46:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:22 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:32 user nova-compute[73056]: INFO nova.compute.manager [None req-ce2ac820-aecb-48ae-8be4-56ffa268eca0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Unrescuing
Aug 14 16:46:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ce2ac820-aecb-48ae-8be4-56ffa268eca0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Acquiring lock "refresh_cache-4731f355-9307-4176-910b-cf35beb85e75" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:46:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ce2ac820-aecb-48ae-8be4-56ffa268eca0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Acquired lock "refresh_cache-4731f355-9307-4176-910b-cf35beb85e75" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:46:32 user nova-compute[73056]: DEBUG nova.network.neutron [None req-ce2ac820-aecb-48ae-8be4-56ffa268eca0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:46:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:33 user nova-compute[73056]: DEBUG nova.network.neutron [None req-ce2ac820-aecb-48ae-8be4-56ffa268eca0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Updating instance_info_cache with network_info: [{"id": "83386dcc-c4f0-49aa-8bd0-43fd3b202c46", "address": "fa:16:3e:2d:f9:8e", "network": {"id": "cf5d30f2-97c6-4785-83d2-549eeb6eca88", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1151628801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd5d50a2601044b5aef50a0d0c6e311a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83386dcc-c4", "ovs_interfaceid": "83386dcc-c4f0-49aa-8bd0-43fd3b202c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:46:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ce2ac820-aecb-48ae-8be4-56ffa268eca0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Releasing lock "refresh_cache-4731f355-9307-4176-910b-cf35beb85e75" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:46:33 user nova-compute[73056]: DEBUG nova.objects.instance [None req-ce2ac820-aecb-48ae-8be4-56ffa268eca0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lazy-loading 'flavor' on Instance uuid 4731f355-9307-4176-910b-cf35beb85e75 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:46:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:33 user nova-compute[73056]: DEBUG nova.compute.manager [req-baaad3c3-03b4-404f-bf74-d7988e90e9b6 req-d80c0766-3f54-4e3f-a532-4d6c2d72d338 service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Received event network-vif-unplugged-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:46:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-baaad3c3-03b4-404f-bf74-d7988e90e9b6 req-d80c0766-3f54-4e3f-a532-4d6c2d72d338 service nova] Acquiring lock "4731f355-9307-4176-910b-cf35beb85e75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:46:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-baaad3c3-03b4-404f-bf74-d7988e90e9b6 req-d80c0766-3f54-4e3f-a532-4d6c2d72d338 service nova] Lock "4731f355-9307-4176-910b-cf35beb85e75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:46:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-baaad3c3-03b4-404f-bf74-d7988e90e9b6 req-d80c0766-3f54-4e3f-a532-4d6c2d72d338 service nova] Lock "4731f355-9307-4176-910b-cf35beb85e75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:46:33 user nova-compute[73056]: DEBUG nova.compute.manager [req-baaad3c3-03b4-404f-bf74-d7988e90e9b6 req-d80c0766-3f54-4e3f-a532-4d6c2d72d338 service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] No waiting events found dispatching network-vif-unplugged-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:46:33 user nova-compute[73056]: WARNING nova.compute.manager [req-baaad3c3-03b4-404f-bf74-d7988e90e9b6 req-d80c0766-3f54-4e3f-a532-4d6c2d72d338 service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Received unexpected event network-vif-unplugged-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 for instance with vm_state rescued and task_state unrescuing.
Aug 14 16:46:34 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Instance destroyed successfully.
Aug 14 16:46:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c4067812-59e4-4f4c-adda-52286e71cbc6 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Acquiring lock "a6108d44-11ef-4414-889b-35a105195b8e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:46:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c4067812-59e4-4f4c-adda-52286e71cbc6 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Lock "a6108d44-11ef-4414-889b-35a105195b8e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:46:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c4067812-59e4-4f4c-adda-52286e71cbc6 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Acquiring lock "a6108d44-11ef-4414-889b-35a105195b8e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:46:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c4067812-59e4-4f4c-adda-52286e71cbc6 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Lock "a6108d44-11ef-4414-889b-35a105195b8e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:46:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c4067812-59e4-4f4c-adda-52286e71cbc6 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Lock "a6108d44-11ef-4414-889b-35a105195b8e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:46:34 user nova-compute[73056]: INFO nova.compute.manager [None req-c4067812-59e4-4f4c-adda-52286e71cbc6 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Terminating instance
Aug 14 16:46:34 user nova-compute[73056]: DEBUG nova.compute.manager [None req-c4067812-59e4-4f4c-adda-52286e71cbc6 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 16:46:34 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:34 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:34 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:34 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:35 user nova-compute[73056]: DEBUG nova.compute.manager [req-1d7f50ea-a57e-4c2e-8715-2b6ecae3a64d req-b057d41d-f1a6-4951-a695-95258c5818da service nova] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Received event network-vif-unplugged-4fc1f417-10f1-4ebc-a065-0933dbd1863d {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:46:35 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1d7f50ea-a57e-4c2e-8715-2b6ecae3a64d req-b057d41d-f1a6-4951-a695-95258c5818da service nova] Acquiring lock "a6108d44-11ef-4414-889b-35a105195b8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:46:35 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1d7f50ea-a57e-4c2e-8715-2b6ecae3a64d req-b057d41d-f1a6-4951-a695-95258c5818da service nova] Lock "a6108d44-11ef-4414-889b-35a105195b8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:46:35 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1d7f50ea-a57e-4c2e-8715-2b6ecae3a64d req-b057d41d-f1a6-4951-a695-95258c5818da service nova] Lock "a6108d44-11ef-4414-889b-35a105195b8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:46:35 user nova-compute[73056]: DEBUG nova.compute.manager [req-1d7f50ea-a57e-4c2e-8715-2b6ecae3a64d req-b057d41d-f1a6-4951-a695-95258c5818da service nova] [instance: a6108d44-11ef-4414-889b-35a105195b8e] No waiting events found dispatching network-vif-unplugged-4fc1f417-10f1-4ebc-a065-0933dbd1863d {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:46:35 user nova-compute[73056]: DEBUG nova.compute.manager [req-1d7f50ea-a57e-4c2e-8715-2b6ecae3a64d req-b057d41d-f1a6-4951-a695-95258c5818da service nova] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Received event network-vif-unplugged-4fc1f417-10f1-4ebc-a065-0933dbd1863d for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:46:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:36 user nova-compute[73056]: DEBUG nova.compute.manager [req-12037273-5b2c-4f83-8595-0bfe104f3b6a req-2c6299ac-1ef0-488a-afa2-0ea5b6e30eb8 service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Received event network-changed-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:46:36 user nova-compute[73056]: DEBUG nova.compute.manager [req-12037273-5b2c-4f83-8595-0bfe104f3b6a req-2c6299ac-1ef0-488a-afa2-0ea5b6e30eb8 service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Refreshing instance network info cache due to event network-changed-83386dcc-c4f0-49aa-8bd0-43fd3b202c46. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:46:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-12037273-5b2c-4f83-8595-0bfe104f3b6a req-2c6299ac-1ef0-488a-afa2-0ea5b6e30eb8 service nova] Acquiring lock "refresh_cache-4731f355-9307-4176-910b-cf35beb85e75" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:46:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-12037273-5b2c-4f83-8595-0bfe104f3b6a req-2c6299ac-1ef0-488a-afa2-0ea5b6e30eb8 service nova] Acquired lock "refresh_cache-4731f355-9307-4176-910b-cf35beb85e75" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:46:36 user nova-compute[73056]: DEBUG nova.network.neutron [req-12037273-5b2c-4f83-8595-0bfe104f3b6a req-2c6299ac-1ef0-488a-afa2-0ea5b6e30eb8 service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Refreshing network info cache for port 83386dcc-c4f0-49aa-8bd0-43fd3b202c46 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:46:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:36 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Instance destroyed successfully.
Aug 14 16:46:36 user nova-compute[73056]: DEBUG nova.objects.instance [None req-c4067812-59e4-4f4c-adda-52286e71cbc6 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Lazy-loading 'resources' on Instance uuid a6108d44-11ef-4414-889b-35a105195b8e {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:46:36 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-c4067812-59e4-4f4c-adda-52286e71cbc6 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:43:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1136724839',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1136724839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1136724',id=19,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWnHvIQCO52FVUf+EAhkXbM8jo8Tcslaz4JHRYbpp+cmKAIQEkxWR7ZK6ZiRhDOOk35KrIbV1W+rpdZkq18fkiYWBlj68hhk2fxwFDtu2lZuySXZNsHQhbeIeaOjlHtug==',key_name='tempest-keypair-810595386',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:43:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dcccd44594f64557856a1d64fc7f0a11',ramdisk_id='',reservation_id='r-7zurb1oy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1453299050',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:43:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='302b84a0d2ec4bddb2e3ccbeeb853747',uuid=a6108d44-11ef-4414-889b-35a105195b8e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4fc1f417-10f1-4ebc-a065-0933dbd1863d", "address": "fa:16:3e:a0:4c:46", "network": {"id": "f32dab76-cccd-47e6-9a3a-86c15eec31ec", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1998522699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcccd44594f64557856a1d64fc7f0a11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc1f417-10", "ovs_interfaceid": "4fc1f417-10f1-4ebc-a065-0933dbd1863d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:46:36 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-c4067812-59e4-4f4c-adda-52286e71cbc6 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Converting VIF {"id": "4fc1f417-10f1-4ebc-a065-0933dbd1863d", "address": "fa:16:3e:a0:4c:46", "network": {"id": "f32dab76-cccd-47e6-9a3a-86c15eec31ec", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1998522699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcccd44594f64557856a1d64fc7f0a11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc1f417-10", "ovs_interfaceid": "4fc1f417-10f1-4ebc-a065-0933dbd1863d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:46:36 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-c4067812-59e4-4f4c-adda-52286e71cbc6 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:4c:46,bridge_name='br-int',has_traffic_filtering=True,id=4fc1f417-10f1-4ebc-a065-0933dbd1863d,network=Network(f32dab76-cccd-47e6-9a3a-86c15eec31ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fc1f417-10') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:46:36 user nova-compute[73056]: DEBUG os_vif [None req-c4067812-59e4-4f4c-adda-52286e71cbc6 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:4c:46,bridge_name='br-int',has_traffic_filtering=True,id=4fc1f417-10f1-4ebc-a065-0933dbd1863d,network=Network(f32dab76-cccd-47e6-9a3a-86c15eec31ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fc1f417-10') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:46:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4fc1f417-10, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:46:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:46:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:36 user nova-compute[73056]: INFO os_vif [None req-c4067812-59e4-4f4c-adda-52286e71cbc6 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:4c:46,bridge_name='br-int',has_traffic_filtering=True,id=4fc1f417-10f1-4ebc-a065-0933dbd1863d,network=Network(f32dab76-cccd-47e6-9a3a-86c15eec31ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fc1f417-10')
Aug 14 16:46:36 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-c4067812-59e4-4f4c-adda-52286e71cbc6 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Deleting instance files /opt/stack/data/nova/instances/a6108d44-11ef-4414-889b-35a105195b8e_del
Aug 14 16:46:36 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-c4067812-59e4-4f4c-adda-52286e71cbc6 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Deletion of /opt/stack/data/nova/instances/a6108d44-11ef-4414-889b-35a105195b8e_del complete
Aug 14 16:46:36 user nova-compute[73056]: INFO nova.compute.manager [None req-c4067812-59e4-4f4c-adda-52286e71cbc6 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Took 1.64 seconds to destroy the instance on the hypervisor.
Aug 14 16:46:36 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-c4067812-59e4-4f4c-adda-52286e71cbc6 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 16:46:36 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 16:46:36 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: a6108d44-11ef-4414-889b-35a105195b8e] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 16:46:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:36 user nova-compute[73056]: DEBUG nova.network.neutron [req-12037273-5b2c-4f83-8595-0bfe104f3b6a req-2c6299ac-1ef0-488a-afa2-0ea5b6e30eb8 service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Updated VIF entry in instance network info cache for port 83386dcc-c4f0-49aa-8bd0-43fd3b202c46. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:46:36 user nova-compute[73056]: DEBUG nova.network.neutron [req-12037273-5b2c-4f83-8595-0bfe104f3b6a req-2c6299ac-1ef0-488a-afa2-0ea5b6e30eb8 service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Updating instance_info_cache with network_info: [{"id": "83386dcc-c4f0-49aa-8bd0-43fd3b202c46", "address": "fa:16:3e:2d:f9:8e", "network": {"id": "cf5d30f2-97c6-4785-83d2-549eeb6eca88", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1151628801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd5d50a2601044b5aef50a0d0c6e311a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83386dcc-c4", "ovs_interfaceid": "83386dcc-c4f0-49aa-8bd0-43fd3b202c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:46:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-12037273-5b2c-4f83-8595-0bfe104f3b6a req-2c6299ac-1ef0-488a-afa2-0ea5b6e30eb8 service nova] Releasing lock "refresh_cache-4731f355-9307-4176-910b-cf35beb85e75" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:46:36 user nova-compute[73056]: DEBUG nova.compute.manager [req-12037273-5b2c-4f83-8595-0bfe104f3b6a req-2c6299ac-1ef0-488a-afa2-0ea5b6e30eb8 service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Received event network-changed-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:46:36 user nova-compute[73056]: DEBUG nova.compute.manager [req-12037273-5b2c-4f83-8595-0bfe104f3b6a req-2c6299ac-1ef0-488a-afa2-0ea5b6e30eb8 service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Refreshing instance network info cache due to event network-changed-83386dcc-c4f0-49aa-8bd0-43fd3b202c46. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:46:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-12037273-5b2c-4f83-8595-0bfe104f3b6a req-2c6299ac-1ef0-488a-afa2-0ea5b6e30eb8 service nova] Acquiring lock "refresh_cache-4731f355-9307-4176-910b-cf35beb85e75" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:46:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-12037273-5b2c-4f83-8595-0bfe104f3b6a req-2c6299ac-1ef0-488a-afa2-0ea5b6e30eb8 service nova] Acquired lock "refresh_cache-4731f355-9307-4176-910b-cf35beb85e75" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:46:36 user nova-compute[73056]: DEBUG nova.network.neutron [req-12037273-5b2c-4f83-8595-0bfe104f3b6a req-2c6299ac-1ef0-488a-afa2-0ea5b6e30eb8 service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Refreshing network info cache for port 83386dcc-c4f0-49aa-8bd0-43fd3b202c46 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:46:37 user nova-compute[73056]: DEBUG nova.compute.manager [req-cd8f9b3f-85fd-4eff-958d-70e7994c6fb4 req-0d570f51-a664-414f-bed2-354abf358ec7 service nova] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Received event network-vif-plugged-4fc1f417-10f1-4ebc-a065-0933dbd1863d {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:46:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cd8f9b3f-85fd-4eff-958d-70e7994c6fb4 req-0d570f51-a664-414f-bed2-354abf358ec7 service nova] Acquiring lock "a6108d44-11ef-4414-889b-35a105195b8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:46:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cd8f9b3f-85fd-4eff-958d-70e7994c6fb4 req-0d570f51-a664-414f-bed2-354abf358ec7 service nova] Lock "a6108d44-11ef-4414-889b-35a105195b8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:46:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cd8f9b3f-85fd-4eff-958d-70e7994c6fb4 req-0d570f51-a664-414f-bed2-354abf358ec7 service nova] Lock "a6108d44-11ef-4414-889b-35a105195b8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:46:37 user nova-compute[73056]: DEBUG nova.compute.manager [req-cd8f9b3f-85fd-4eff-958d-70e7994c6fb4 req-0d570f51-a664-414f-bed2-354abf358ec7 service nova] [instance: a6108d44-11ef-4414-889b-35a105195b8e] No waiting events found dispatching network-vif-plugged-4fc1f417-10f1-4ebc-a065-0933dbd1863d {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:46:37 user nova-compute[73056]: WARNING nova.compute.manager [req-cd8f9b3f-85fd-4eff-958d-70e7994c6fb4 req-0d570f51-a664-414f-bed2-354abf358ec7 service nova] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Received unexpected event network-vif-plugged-4fc1f417-10f1-4ebc-a065-0933dbd1863d for instance with vm_state active and task_state deleting.
Aug 14 16:46:37 user nova-compute[73056]: DEBUG nova.compute.manager [req-cd8f9b3f-85fd-4eff-958d-70e7994c6fb4 req-0d570f51-a664-414f-bed2-354abf358ec7 service nova] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Received event network-vif-plugged-4fc1f417-10f1-4ebc-a065-0933dbd1863d {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:46:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cd8f9b3f-85fd-4eff-958d-70e7994c6fb4 req-0d570f51-a664-414f-bed2-354abf358ec7 service nova] Acquiring lock "a6108d44-11ef-4414-889b-35a105195b8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:46:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cd8f9b3f-85fd-4eff-958d-70e7994c6fb4 req-0d570f51-a664-414f-bed2-354abf358ec7 service nova] Lock "a6108d44-11ef-4414-889b-35a105195b8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:46:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cd8f9b3f-85fd-4eff-958d-70e7994c6fb4 req-0d570f51-a664-414f-bed2-354abf358ec7 service nova] Lock "a6108d44-11ef-4414-889b-35a105195b8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:46:37 user nova-compute[73056]: DEBUG nova.compute.manager [req-cd8f9b3f-85fd-4eff-958d-70e7994c6fb4 req-0d570f51-a664-414f-bed2-354abf358ec7 service nova] [instance: a6108d44-11ef-4414-889b-35a105195b8e] No waiting events found dispatching network-vif-plugged-4fc1f417-10f1-4ebc-a065-0933dbd1863d {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:46:37 user nova-compute[73056]: WARNING nova.compute.manager [req-cd8f9b3f-85fd-4eff-958d-70e7994c6fb4 req-0d570f51-a664-414f-bed2-354abf358ec7 service nova] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Received unexpected event network-vif-plugged-4fc1f417-10f1-4ebc-a065-0933dbd1863d for instance with vm_state active and task_state deleting.
Aug 14 16:46:37 user nova-compute[73056]: DEBUG nova.compute.manager [req-cd8f9b3f-85fd-4eff-958d-70e7994c6fb4 req-0d570f51-a664-414f-bed2-354abf358ec7 service nova] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Received event network-vif-plugged-4fc1f417-10f1-4ebc-a065-0933dbd1863d {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:46:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cd8f9b3f-85fd-4eff-958d-70e7994c6fb4 req-0d570f51-a664-414f-bed2-354abf358ec7 service nova] Acquiring lock "a6108d44-11ef-4414-889b-35a105195b8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:46:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cd8f9b3f-85fd-4eff-958d-70e7994c6fb4 req-0d570f51-a664-414f-bed2-354abf358ec7 service nova] Lock "a6108d44-11ef-4414-889b-35a105195b8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:46:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cd8f9b3f-85fd-4eff-958d-70e7994c6fb4 req-0d570f51-a664-414f-bed2-354abf358ec7 service nova] Lock "a6108d44-11ef-4414-889b-35a105195b8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:46:37 user nova-compute[73056]: DEBUG nova.compute.manager [req-cd8f9b3f-85fd-4eff-958d-70e7994c6fb4 req-0d570f51-a664-414f-bed2-354abf358ec7 service nova] [instance: a6108d44-11ef-4414-889b-35a105195b8e] No waiting events found dispatching network-vif-plugged-4fc1f417-10f1-4ebc-a065-0933dbd1863d {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:46:37 user nova-compute[73056]: WARNING nova.compute.manager [req-cd8f9b3f-85fd-4eff-958d-70e7994c6fb4 req-0d570f51-a664-414f-bed2-354abf358ec7 service nova] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Received unexpected event network-vif-plugged-4fc1f417-10f1-4ebc-a065-0933dbd1863d for instance with vm_state active and task_state deleting.
Aug 14 16:46:37 user nova-compute[73056]: DEBUG nova.compute.manager [req-cd8f9b3f-85fd-4eff-958d-70e7994c6fb4 req-0d570f51-a664-414f-bed2-354abf358ec7 service nova] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Received event network-vif-unplugged-4fc1f417-10f1-4ebc-a065-0933dbd1863d {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:46:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cd8f9b3f-85fd-4eff-958d-70e7994c6fb4 req-0d570f51-a664-414f-bed2-354abf358ec7 service nova] Acquiring lock "a6108d44-11ef-4414-889b-35a105195b8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:46:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cd8f9b3f-85fd-4eff-958d-70e7994c6fb4 req-0d570f51-a664-414f-bed2-354abf358ec7 service nova] Lock "a6108d44-11ef-4414-889b-35a105195b8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:46:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cd8f9b3f-85fd-4eff-958d-70e7994c6fb4 req-0d570f51-a664-414f-bed2-354abf358ec7 service nova] Lock "a6108d44-11ef-4414-889b-35a105195b8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:46:37 user nova-compute[73056]: DEBUG nova.compute.manager [req-cd8f9b3f-85fd-4eff-958d-70e7994c6fb4 req-0d570f51-a664-414f-bed2-354abf358ec7 service nova] [instance: a6108d44-11ef-4414-889b-35a105195b8e] No waiting events found dispatching network-vif-unplugged-4fc1f417-10f1-4ebc-a065-0933dbd1863d {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:46:37 user nova-compute[73056]: DEBUG nova.compute.manager [req-cd8f9b3f-85fd-4eff-958d-70e7994c6fb4 req-0d570f51-a664-414f-bed2-354abf358ec7 service nova] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Received event network-vif-unplugged-4fc1f417-10f1-4ebc-a065-0933dbd1863d for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:46:37 user nova-compute[73056]: DEBUG nova.compute.manager [req-cd8f9b3f-85fd-4eff-958d-70e7994c6fb4 req-0d570f51-a664-414f-bed2-354abf358ec7 service nova] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Received event network-vif-plugged-4fc1f417-10f1-4ebc-a065-0933dbd1863d {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:46:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cd8f9b3f-85fd-4eff-958d-70e7994c6fb4 req-0d570f51-a664-414f-bed2-354abf358ec7 service nova] Acquiring lock "a6108d44-11ef-4414-889b-35a105195b8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:46:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cd8f9b3f-85fd-4eff-958d-70e7994c6fb4 req-0d570f51-a664-414f-bed2-354abf358ec7 service nova] Lock "a6108d44-11ef-4414-889b-35a105195b8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:46:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cd8f9b3f-85fd-4eff-958d-70e7994c6fb4 req-0d570f51-a664-414f-bed2-354abf358ec7 service nova] Lock "a6108d44-11ef-4414-889b-35a105195b8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:46:37 user nova-compute[73056]: DEBUG nova.compute.manager [req-cd8f9b3f-85fd-4eff-958d-70e7994c6fb4 req-0d570f51-a664-414f-bed2-354abf358ec7 service nova] [instance: a6108d44-11ef-4414-889b-35a105195b8e] No waiting events found dispatching network-vif-plugged-4fc1f417-10f1-4ebc-a065-0933dbd1863d {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:46:37 user nova-compute[73056]: WARNING nova.compute.manager [req-cd8f9b3f-85fd-4eff-958d-70e7994c6fb4 req-0d570f51-a664-414f-bed2-354abf358ec7 service nova] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Received unexpected event network-vif-plugged-4fc1f417-10f1-4ebc-a065-0933dbd1863d for instance with vm_state active and task_state deleting.
Aug 14 16:46:37 user nova-compute[73056]: DEBUG nova.network.neutron [req-12037273-5b2c-4f83-8595-0bfe104f3b6a req-2c6299ac-1ef0-488a-afa2-0ea5b6e30eb8 service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Updated VIF entry in instance network info cache for port 83386dcc-c4f0-49aa-8bd0-43fd3b202c46. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:46:37 user nova-compute[73056]: DEBUG nova.network.neutron [req-12037273-5b2c-4f83-8595-0bfe104f3b6a req-2c6299ac-1ef0-488a-afa2-0ea5b6e30eb8 service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Updating instance_info_cache with network_info: [{"id": "83386dcc-c4f0-49aa-8bd0-43fd3b202c46", "address": "fa:16:3e:2d:f9:8e", "network": {"id": "cf5d30f2-97c6-4785-83d2-549eeb6eca88", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1151628801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd5d50a2601044b5aef50a0d0c6e311a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83386dcc-c4", "ovs_interfaceid": "83386dcc-c4f0-49aa-8bd0-43fd3b202c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:46:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-12037273-5b2c-4f83-8595-0bfe104f3b6a req-2c6299ac-1ef0-488a-afa2-0ea5b6e30eb8 service nova] Releasing lock "refresh_cache-4731f355-9307-4176-910b-cf35beb85e75" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:46:37 user nova-compute[73056]: DEBUG nova.compute.manager [req-12037273-5b2c-4f83-8595-0bfe104f3b6a req-2c6299ac-1ef0-488a-afa2-0ea5b6e30eb8 service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Received event network-vif-plugged-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:46:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-12037273-5b2c-4f83-8595-0bfe104f3b6a req-2c6299ac-1ef0-488a-afa2-0ea5b6e30eb8 service nova] Acquiring lock "4731f355-9307-4176-910b-cf35beb85e75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:46:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-12037273-5b2c-4f83-8595-0bfe104f3b6a req-2c6299ac-1ef0-488a-afa2-0ea5b6e30eb8 service nova] Lock "4731f355-9307-4176-910b-cf35beb85e75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:46:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-12037273-5b2c-4f83-8595-0bfe104f3b6a req-2c6299ac-1ef0-488a-afa2-0ea5b6e30eb8 service nova] Lock "4731f355-9307-4176-910b-cf35beb85e75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:46:37 user nova-compute[73056]: DEBUG nova.compute.manager [req-12037273-5b2c-4f83-8595-0bfe104f3b6a req-2c6299ac-1ef0-488a-afa2-0ea5b6e30eb8 service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] No waiting events found dispatching network-vif-plugged-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:46:37 user nova-compute[73056]: WARNING nova.compute.manager [req-12037273-5b2c-4f83-8595-0bfe104f3b6a req-2c6299ac-1ef0-488a-afa2-0ea5b6e30eb8 service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Received unexpected event network-vif-plugged-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 for instance with vm_state rescued and task_state unrescuing.
Aug 14 16:46:37 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:37 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:37 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:37 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:37 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:37 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:46:37 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:37 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Took 1.60 seconds to deallocate network for instance.
Aug 14 16:46:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c4067812-59e4-4f4c-adda-52286e71cbc6 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:46:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c4067812-59e4-4f4c-adda-52286e71cbc6 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:46:38 user nova-compute[73056]: DEBUG nova.compute.manager [req-fbafac98-15bd-44ea-ba88-48ecfa4c8e20 req-35c46a5e-0a68-492b-9687-62aea7491a1e service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Received event network-vif-plugged-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:46:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-fbafac98-15bd-44ea-ba88-48ecfa4c8e20 req-35c46a5e-0a68-492b-9687-62aea7491a1e service nova] Acquiring lock "4731f355-9307-4176-910b-cf35beb85e75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:46:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-fbafac98-15bd-44ea-ba88-48ecfa4c8e20 req-35c46a5e-0a68-492b-9687-62aea7491a1e service nova] Lock "4731f355-9307-4176-910b-cf35beb85e75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:46:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-fbafac98-15bd-44ea-ba88-48ecfa4c8e20 req-35c46a5e-0a68-492b-9687-62aea7491a1e service nova] Lock "4731f355-9307-4176-910b-cf35beb85e75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:46:38 user nova-compute[73056]: DEBUG nova.compute.manager [req-fbafac98-15bd-44ea-ba88-48ecfa4c8e20 req-35c46a5e-0a68-492b-9687-62aea7491a1e service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] No waiting events found dispatching network-vif-plugged-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:46:38 user nova-compute[73056]: WARNING nova.compute.manager [req-fbafac98-15bd-44ea-ba88-48ecfa4c8e20 req-35c46a5e-0a68-492b-9687-62aea7491a1e service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Received unexpected event network-vif-plugged-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 for instance with vm_state rescued and task_state unrescuing.
Aug 14 16:46:38 user nova-compute[73056]: DEBUG nova.compute.manager [req-fbafac98-15bd-44ea-ba88-48ecfa4c8e20 req-35c46a5e-0a68-492b-9687-62aea7491a1e service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Received event network-vif-plugged-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:46:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-fbafac98-15bd-44ea-ba88-48ecfa4c8e20 req-35c46a5e-0a68-492b-9687-62aea7491a1e service nova] Acquiring lock "4731f355-9307-4176-910b-cf35beb85e75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:46:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-fbafac98-15bd-44ea-ba88-48ecfa4c8e20 req-35c46a5e-0a68-492b-9687-62aea7491a1e service nova] Lock "4731f355-9307-4176-910b-cf35beb85e75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:46:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-fbafac98-15bd-44ea-ba88-48ecfa4c8e20 req-35c46a5e-0a68-492b-9687-62aea7491a1e service nova] Lock "4731f355-9307-4176-910b-cf35beb85e75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:46:38 user nova-compute[73056]: DEBUG nova.compute.manager [req-fbafac98-15bd-44ea-ba88-48ecfa4c8e20 req-35c46a5e-0a68-492b-9687-62aea7491a1e service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] No waiting events found dispatching network-vif-plugged-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:46:38 user nova-compute[73056]: WARNING nova.compute.manager [req-fbafac98-15bd-44ea-ba88-48ecfa4c8e20 req-35c46a5e-0a68-492b-9687-62aea7491a1e service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Received unexpected event network-vif-plugged-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 for instance with vm_state rescued and task_state unrescuing.
Aug 14 16:46:38 user nova-compute[73056]: DEBUG nova.compute.manager [req-fbafac98-15bd-44ea-ba88-48ecfa4c8e20 req-35c46a5e-0a68-492b-9687-62aea7491a1e service nova] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Received event network-vif-deleted-4fc1f417-10f1-4ebc-a065-0933dbd1863d {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:46:38 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-c4067812-59e4-4f4c-adda-52286e71cbc6 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:46:38 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-c4067812-59e4-4f4c-adda-52286e71cbc6 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:46:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c4067812-59e4-4f4c-adda-52286e71cbc6 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.414s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:46:38 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-c4067812-59e4-4f4c-adda-52286e71cbc6 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Deleted allocations for instance a6108d44-11ef-4414-889b-35a105195b8e
Aug 14 16:46:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c4067812-59e4-4f4c-adda-52286e71cbc6 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050 tempest-TestServerVolumeAttachScenarioOldVersion-1453299050-project-member] Lock "a6108d44-11ef-4414-889b-35a105195b8e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.869s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:46:38 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Removed pending event for 4731f355-9307-4176-910b-cf35beb85e75 due to event {{(pid=73056) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 16:46:38 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031598.6276457, 4731f355-9307-4176-910b-cf35beb85e75 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:46:38 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 4731f355-9307-4176-910b-cf35beb85e75] VM Resumed (Lifecycle Event)
Aug 14 16:46:38 user nova-compute[73056]: DEBUG nova.compute.manager [None req-ce2ac820-aecb-48ae-8be4-56ffa268eca0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:46:38 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:46:38 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:46:38 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 4731f355-9307-4176-910b-cf35beb85e75] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 16:46:38 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031598.6317508, 4731f355-9307-4176-910b-cf35beb85e75 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:46:38 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 4731f355-9307-4176-910b-cf35beb85e75] VM Started (Lifecycle Event)
Aug 14 16:46:38 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:46:38 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:46:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2e4a782a-dfe3-4efa-88ba-24a1a45543e9 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "b3270811-8241-47a6-aa36-0ec3feddf0fc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:46:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2e4a782a-dfe3-4efa-88ba-24a1a45543e9 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "b3270811-8241-47a6-aa36-0ec3feddf0fc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:46:38 user nova-compute[73056]: INFO nova.compute.manager [None req-2e4a782a-dfe3-4efa-88ba-24a1a45543e9 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Detaching volume 8508e582-59c1-4b34-8cb9-6954a3d6c14b
Aug 14 16:46:39 user nova-compute[73056]: INFO nova.virt.block_device [None req-2e4a782a-dfe3-4efa-88ba-24a1a45543e9 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Attempting to driver detach volume 8508e582-59c1-4b34-8cb9-6954a3d6c14b from mountpoint /dev/vdb
Aug 14 16:46:39 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2e4a782a-dfe3-4efa-88ba-24a1a45543e9 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Attempting to detach device vdb from instance b3270811-8241-47a6-aa36-0ec3feddf0fc from the persistent domain config. {{(pid=73056) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-2e4a782a-dfe3-4efa-88ba-24a1a45543e9 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 16:46:39 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:46:39 user nova-compute[73056]:   <source dev="/dev/sdd"/>
Aug 14 16:46:39 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:46:39 user nova-compute[73056]:   <serial>8508e582-59c1-4b34-8cb9-6954a3d6c14b</serial>
Aug 14 16:46:39 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 16:46:39 user nova-compute[73056]: </disk>
Aug 14 16:46:39 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 16:46:39 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-2e4a782a-dfe3-4efa-88ba-24a1a45543e9 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Successfully detached device vdb from instance b3270811-8241-47a6-aa36-0ec3feddf0fc from the persistent domain config.
Aug 14 16:46:39 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2e4a782a-dfe3-4efa-88ba-24a1a45543e9 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b3270811-8241-47a6-aa36-0ec3feddf0fc from the live domain config. {{(pid=73056) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-2e4a782a-dfe3-4efa-88ba-24a1a45543e9 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 16:46:39 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:46:39 user nova-compute[73056]:   <source dev="/dev/sdd"/>
Aug 14 16:46:39 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:46:39 user nova-compute[73056]:   <serial>8508e582-59c1-4b34-8cb9-6954a3d6c14b</serial>
Aug 14 16:46:39 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 16:46:39 user nova-compute[73056]: </disk>
Aug 14 16:46:39 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Received event <DeviceRemovedEvent: 1692031599.5427392, b3270811-8241-47a6-aa36-0ec3feddf0fc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73056) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2e4a782a-dfe3-4efa-88ba-24a1a45543e9 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b3270811-8241-47a6-aa36-0ec3feddf0fc {{(pid=73056) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 16:46:39 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-2e4a782a-dfe3-4efa-88ba-24a1a45543e9 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Successfully detached device vdb from instance b3270811-8241-47a6-aa36-0ec3feddf0fc from the live domain config.
Aug 14 16:46:39 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e4a782a-dfe3-4efa-88ba-24a1a45543e9 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4a782a-dfe3-4efa-88ba-24a1a45543e9 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmCWShAp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:46:39 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-2e4a782a-dfe3-4efa-88ba-24a1a45543e9 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:46:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-2e4a782a-dfe3-4efa-88ba-24a1a45543e9 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-2e4a782a-dfe3-4efa-88ba-24a1a45543e9 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4a782a-dfe3-4efa-88ba-24a1a45543e9 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25ae6d4-b686-4235-9fdb-ab1b6b43a9c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e71e4f-a0c9-471f-90d1-040228e3ca92]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4a782a-dfe3-4efa-88ba-24a1a45543e9 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)
Aug 14 16:46:39 user nova-compute[73056]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:46:39 user nova-compute[73056]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)
Aug 14 16:46:39 user nova-compute[73056]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b (non-flash)
Aug 14 16:46:39 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4a782a-dfe3-4efa-88ba-24a1a45543e9 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b (non-flash)
Aug 14 16:46:39 user nova-compute[73056]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:46:39 user nova-compute[73056]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)
Aug 14 16:46:39 user nova-compute[73056]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b (non-flash)
Aug 14 16:46:39 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4a782a-dfe3-4efa-88ba-24a1a45543e9 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff2dcd125f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b'): ({'sdd'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-2e4a782a-dfe3-4efa-88ba-24a1a45543e9 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Removing single pathed devices sdd {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ddec16-30ee-495f-bc92-44c5bacf9c96]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba93bf78-b802-4cd0-994f-1696e526d016]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-2e4a782a-dfe3-4efa-88ba-24a1a45543e9 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Flushing IO for device /dev/sdd {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3193fb-2ab8-4e0e-89bb-46768424cdb9]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-2e4a782a-dfe3-4efa-88ba-24a1a45543e9 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[94808322-07fb-43c5-9675-d2ead8ab54ac]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-2e4a782a-dfe3-4efa-88ba-24a1a45543e9 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-2e4a782a-dfe3-4efa-88ba-24a1a45543e9 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] SCSI volumes sdd have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4a782a-dfe3-4efa-88ba-24a1a45543e9 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee523f1-852d-452b-961f-e3ee4eb8b4d5]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4a782a-dfe3-4efa-88ba-24a1a45543e9 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa19519a-e122-41a1-bdfd-a724a37e40f2]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4a782a-dfe3-4efa-88ba-24a1a45543e9 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b, portal: 172.16.0.220,3260]
Aug 14 16:46:39 user nova-compute[73056]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b, portal: 172.16.0.220,3260] successful.
Aug 14 16:46:39 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8508e582-59c1-4b34-8cb9-6954a3d6c14b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6df0024-ae6a-4523-92ad-7b225c3f54e0]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4a782a-dfe3-4efa-88ba-24a1a45543e9 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-2e4a782a-dfe3-4efa-88ba-24a1a45543e9 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4a782a-dfe3-4efa-88ba-24a1a45543e9 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] <== disconnect_volume: return (312ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:46:39 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e4a782a-dfe3-4efa-88ba-24a1a45543e9 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:46:40 user nova-compute[73056]: DEBUG nova.objects.instance [None req-2e4a782a-dfe3-4efa-88ba-24a1a45543e9 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lazy-loading 'flavor' on Instance uuid b3270811-8241-47a6-aa36-0ec3feddf0fc {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:46:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2e4a782a-dfe3-4efa-88ba-24a1a45543e9 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "b3270811-8241-47a6-aa36-0ec3feddf0fc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.964s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:46:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "7526c6c3-6d3c-435e-8fc7-742c08be44d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:46:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "7526c6c3-6d3c-435e-8fc7-742c08be44d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:46:46 user nova-compute[73056]: DEBUG nova.compute.manager [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:46:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:46:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:46:47 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:46:47 user nova-compute[73056]: INFO nova.compute.claims [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Claim successful on node user
Aug 14 16:46:47 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:46:47 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:46:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.458s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:46:47 user nova-compute[73056]: DEBUG nova.compute.manager [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:46:47 user nova-compute[73056]: DEBUG nova.compute.manager [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:46:47 user nova-compute[73056]: DEBUG nova.network.neutron [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:46:47 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:46:47 user nova-compute[73056]: DEBUG nova.compute.manager [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:46:47 user nova-compute[73056]: INFO nova.virt.block_device [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Booting with volume 00866544-b804-42b6-9c18-e2217e311cff at /dev/vda
Aug 14 16:46:47 user nova-compute[73056]: DEBUG nova.policy [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2be1b098ca9f4232bd198b515630f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffb5203b9284500b8add8a6586cad49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:46:47 user nova-compute[73056]: DEBUG os_brick.utils [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:46:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:47 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c092ee8f-7714-4c72-84b8-24e048b66706]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:47 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ce59f6-13b0-47e7-af9d-3b1f390830ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:47 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[435ddf12-f5d2-4582-b12c-ff7ecf6071d2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:47 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab29e49-eee4-4202-a755-afd11d06c24b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:46:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:46:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:46:47 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:46:47 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5939f87-dc28-4ccf-8f5e-67a06dc7d856]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:46:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:46:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:46:48 user nova-compute[73056]: DEBUG os_brick.utils [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:46:48 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Updating existing volume attachment record: 5c96f73e-864e-4919-986e-c3bdd1b04e9d {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 16:46:48 user nova-compute[73056]: DEBUG nova.network.neutron [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Port 8491a73c-f38b-4cb4-ab87-d6e41992319d binding to destination host user is already ACTIVE {{(pid=73056) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 14 16:46:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Acquiring lock "refresh_cache-9c11423c-88d3-4fae-8917-c0d57021d194" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:46:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Acquired lock "refresh_cache-9c11423c-88d3-4fae-8917-c0d57021d194" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:46:48 user nova-compute[73056]: DEBUG nova.network.neutron [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:46:48 user nova-compute[73056]: DEBUG nova.network.neutron [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Successfully created port: a97a3360-819f-4ea9-98e9-2f475b260008 {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:46:48 user nova-compute[73056]: DEBUG nova.network.neutron [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Updating instance_info_cache with network_info: [{"id": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "address": "fa:16:3e:e6:4c:64", "network": {"id": "db548415-fd97-4612-8699-d431cfe3c1ec", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-66082327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af3a3df4b8641c1ac0d02df893b524d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8491a73c-f3", "ovs_interfaceid": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:46:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Releasing lock "refresh_cache-9c11423c-88d3-4fae-8917-c0d57021d194" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:46:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Creating tmpfile /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/tmp0p4wmywe to verify with other compute node that the instance is on the same shared storage. {{(pid=73056) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 14 16:46:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG nova.compute.manager [req-56ac1326-f80a-495e-8518-2562c3647209 req-3687bc8c-a37a-44a9-9e56-a9bcd63d9edc service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Received event network-vif-unplugged-8491a73c-f38b-4cb4-ab87-d6e41992319d {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-56ac1326-f80a-495e-8518-2562c3647209 req-3687bc8c-a37a-44a9-9e56-a9bcd63d9edc service nova] Acquiring lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-56ac1326-f80a-495e-8518-2562c3647209 req-3687bc8c-a37a-44a9-9e56-a9bcd63d9edc service nova] Lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-56ac1326-f80a-495e-8518-2562c3647209 req-3687bc8c-a37a-44a9-9e56-a9bcd63d9edc service nova] Lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG nova.compute.manager [req-56ac1326-f80a-495e-8518-2562c3647209 req-3687bc8c-a37a-44a9-9e56-a9bcd63d9edc service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] No waiting events found dispatching network-vif-unplugged-8491a73c-f38b-4cb4-ab87-d6e41992319d {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:46:49 user nova-compute[73056]: WARNING nova.compute.manager [req-56ac1326-f80a-495e-8518-2562c3647209 req-3687bc8c-a37a-44a9-9e56-a9bcd63d9edc service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Received unexpected event network-vif-unplugged-8491a73c-f38b-4cb4-ab87-d6e41992319d for instance with vm_state resized and task_state resize_reverting.
Aug 14 16:46:49 user nova-compute[73056]: DEBUG nova.network.neutron [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Successfully updated port: a97a3360-819f-4ea9-98e9-2f475b260008 {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "refresh_cache-7526c6c3-6d3c-435e-8fc7-742c08be44d0" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquired lock "refresh_cache-7526c6c3-6d3c-435e-8fc7-742c08be44d0" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG nova.network.neutron [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG nova.compute.manager [req-290c0ac3-50a1-4424-b1db-de97112f4f4a req-36e21609-6ec6-44be-9ca9-01056c8ee41e service nova] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Received event network-changed-a97a3360-819f-4ea9-98e9-2f475b260008 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG nova.compute.manager [req-290c0ac3-50a1-4424-b1db-de97112f4f4a req-36e21609-6ec6-44be-9ca9-01056c8ee41e service nova] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Refreshing instance network info cache due to event network-changed-a97a3360-819f-4ea9-98e9-2f475b260008. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-290c0ac3-50a1-4424-b1db-de97112f4f4a req-36e21609-6ec6-44be-9ca9-01056c8ee41e service nova] Acquiring lock "refresh_cache-7526c6c3-6d3c-435e-8fc7-742c08be44d0" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG nova.network.neutron [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:49 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Instance destroyed successfully.
Aug 14 16:46:49 user nova-compute[73056]: DEBUG nova.objects.instance [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lazy-loading 'resources' on Instance uuid 9c11423c-88d3-4fae-8917-c0d57021d194 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:40:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1141868820',display_name='tempest-ServerActionsTestOtherB-server-1141868820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1141868820',id=16,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsc3Uaz7vmbmV86lMnvYNdRaSVfJcdYXdG4vY0wVNgR/VZPzr09+A51tF4EmKhmmLDKglhmcpoAJJc05z8zlcL3Fqhx5uVkS7BbyNbqt0mNNKT7ar0AXFL2PnABSrfDLg==',key_name='tempest-keypair-1532112814',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:45:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4af3a3df4b8641c1ac0d02df893b524d',ramdisk_id='',reservation_id='r-z7s601zt',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1168667086',owner_user_name='tempest-ServerActionsTestOtherB-1168667086-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:45:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c39b09d624bb4977b6d1b396f425f737',uuid=9c11423c-88d3-4fae-8917-c0d57021d194,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "address": "fa:16:3e:e6:4c:64", "network": {"id": "db548415-fd97-4612-8699-d431cfe3c1ec", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-66082327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af3a3df4b8641c1ac0d02df893b524d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8491a73c-f3", "ovs_interfaceid": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Converting VIF {"id": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "address": "fa:16:3e:e6:4c:64", "network": {"id": "db548415-fd97-4612-8699-d431cfe3c1ec", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-66082327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af3a3df4b8641c1ac0d02df893b524d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8491a73c-f3", "ovs_interfaceid": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:4c:64,bridge_name='br-int',has_traffic_filtering=True,id=8491a73c-f38b-4cb4-ab87-d6e41992319d,network=Network(db548415-fd97-4612-8699-d431cfe3c1ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8491a73c-f3') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG os_vif [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:4c:64,bridge_name='br-int',has_traffic_filtering=True,id=8491a73c-f38b-4cb4-ab87-d6e41992319d,network=Network(db548415-fd97-4612-8699-d431cfe3c1ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8491a73c-f3') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8491a73c-f3, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:46:49 user nova-compute[73056]: INFO os_vif [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:4c:64,bridge_name='br-int',has_traffic_filtering=True,id=8491a73c-f38b-4cb4-ab87-d6e41992319d,network=Network(db548415-fd97-4612-8699-d431cfe3c1ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8491a73c-f3')
Aug 14 16:46:49 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iThIoFVw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:46:49 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:46:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd54b38-d85a-4328-9e48-8631305bbe7b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[52772213-9403-40ad-b6dd-8bd679e0b429]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:46:49 user nova-compute[73056]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)
Aug 14 16:46:49 user nova-compute[73056]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b (non-flash)
Aug 14 16:46:49 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:46:49 user nova-compute[73056]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)
Aug 14 16:46:49 user nova-compute[73056]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b (non-flash)
Aug 14 16:46:49 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff2dcec3490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0'): ({'sde'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Removing single pathed devices sde {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7807a7bd-d2a7-4061-8211-ca91d00e66da]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.035s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c276ff3c-72c4-4429-9fab-e87c5f4ced10]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Flushing IO for device /dev/sde {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.026s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[1157db2b-d1f5-400f-839a-cd3433e9891e]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de2bc57-2eea-467b-bf80-20cb8c7e716a]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] SCSI volumes sde have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dad3f33-5825-4660-a12d-ca6a0ee839d1]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff51eb4-33b5-4328-8e3c-3a8618624bbd]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0, portal: 172.16.0.220,3260]
Aug 14 16:46:50 user nova-compute[73056]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0, portal: 172.16.0.220,3260] successful.
Aug 14 16:46:50 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG nova.network.neutron [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Updating instance_info_cache with network_info: [{"id": "a97a3360-819f-4ea9-98e9-2f475b260008", "address": "fa:16:3e:41:58:29", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa97a3360-81", "ovs_interfaceid": "a97a3360-819f-4ea9-98e9-2f475b260008", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e5893f-84f0-430c-944c-19a4419bc8ad]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] <== disconnect_volume: return (383ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Releasing lock "refresh_cache-7526c6c3-6d3c-435e-8fc7-742c08be44d0" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG nova.compute.manager [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Instance network_info: |[{"id": "a97a3360-819f-4ea9-98e9-2f475b260008", "address": "fa:16:3e:41:58:29", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa97a3360-81", "ovs_interfaceid": "a97a3360-819f-4ea9-98e9-2f475b260008", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-290c0ac3-50a1-4424-b1db-de97112f4f4a req-36e21609-6ec6-44be-9ca9-01056c8ee41e service nova] Acquired lock "refresh_cache-7526c6c3-6d3c-435e-8fc7-742c08be44d0" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG nova.network.neutron [req-290c0ac3-50a1-4424-b1db-de97112f4f4a req-36e21609-6ec6-44be-9ca9-01056c8ee41e service nova] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Refreshing network info cache for port a97a3360-819f-4ea9-98e9-2f475b260008 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG nova.network.neutron [req-290c0ac3-50a1-4424-b1db-de97112f4f4a req-36e21609-6ec6-44be-9ca9-01056c8ee41e service nova] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Updated VIF entry in instance network info cache for port a97a3360-819f-4ea9-98e9-2f475b260008. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG nova.network.neutron [req-290c0ac3-50a1-4424-b1db-de97112f4f4a req-36e21609-6ec6-44be-9ca9-01056c8ee41e service nova] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Updating instance_info_cache with network_info: [{"id": "a97a3360-819f-4ea9-98e9-2f475b260008", "address": "fa:16:3e:41:58:29", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa97a3360-81", "ovs_interfaceid": "a97a3360-819f-4ea9-98e9-2f475b260008", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:46:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-290c0ac3-50a1-4424-b1db-de97112f4f4a req-36e21609-6ec6-44be-9ca9-01056c8ee41e service nova] Releasing lock "refresh_cache-7526c6c3-6d3c-435e-8fc7-742c08be44d0" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:46:51 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692031596.1020374, a6108d44-11ef-4414-889b-35a105195b8e => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:46:51 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: a6108d44-11ef-4414-889b-35a105195b8e] VM Stopped (Lifecycle Event)
Aug 14 16:46:51 user nova-compute[73056]: DEBUG nova.compute.manager [None req-0dd7c0c1-7335-4e97-bcf6-616cf1601b5a None None] [instance: a6108d44-11ef-4414-889b-35a105195b8e] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:46:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-0d854f7f-2968-4436-8c45-6a1ac0897475 req-fe71d111-2dfe-44fb-a88a-f7a98ca7eeeb service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Received event network-vif-plugged-8491a73c-f38b-4cb4-ab87-d6e41992319d {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:46:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0d854f7f-2968-4436-8c45-6a1ac0897475 req-fe71d111-2dfe-44fb-a88a-f7a98ca7eeeb service nova] Acquiring lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:46:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0d854f7f-2968-4436-8c45-6a1ac0897475 req-fe71d111-2dfe-44fb-a88a-f7a98ca7eeeb service nova] Lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:46:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0d854f7f-2968-4436-8c45-6a1ac0897475 req-fe71d111-2dfe-44fb-a88a-f7a98ca7eeeb service nova] Lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:46:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-0d854f7f-2968-4436-8c45-6a1ac0897475 req-fe71d111-2dfe-44fb-a88a-f7a98ca7eeeb service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] No waiting events found dispatching network-vif-plugged-8491a73c-f38b-4cb4-ab87-d6e41992319d {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:46:51 user nova-compute[73056]: WARNING nova.compute.manager [req-0d854f7f-2968-4436-8c45-6a1ac0897475 req-fe71d111-2dfe-44fb-a88a-f7a98ca7eeeb service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Received unexpected event network-vif-plugged-8491a73c-f38b-4cb4-ab87-d6e41992319d for instance with vm_state resized and task_state resize_reverting.
Aug 14 16:46:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-0d854f7f-2968-4436-8c45-6a1ac0897475 req-fe71d111-2dfe-44fb-a88a-f7a98ca7eeeb service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Received event network-vif-plugged-8491a73c-f38b-4cb4-ab87-d6e41992319d {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:46:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0d854f7f-2968-4436-8c45-6a1ac0897475 req-fe71d111-2dfe-44fb-a88a-f7a98ca7eeeb service nova] Acquiring lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:46:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0d854f7f-2968-4436-8c45-6a1ac0897475 req-fe71d111-2dfe-44fb-a88a-f7a98ca7eeeb service nova] Lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:46:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0d854f7f-2968-4436-8c45-6a1ac0897475 req-fe71d111-2dfe-44fb-a88a-f7a98ca7eeeb service nova] Lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:46:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-0d854f7f-2968-4436-8c45-6a1ac0897475 req-fe71d111-2dfe-44fb-a88a-f7a98ca7eeeb service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] No waiting events found dispatching network-vif-plugged-8491a73c-f38b-4cb4-ab87-d6e41992319d {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:46:51 user nova-compute[73056]: WARNING nova.compute.manager [req-0d854f7f-2968-4436-8c45-6a1ac0897475 req-fe71d111-2dfe-44fb-a88a-f7a98ca7eeeb service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Received unexpected event network-vif-plugged-8491a73c-f38b-4cb4-ab87-d6e41992319d for instance with vm_state resized and task_state resize_reverting.
Aug 14 16:46:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-0d854f7f-2968-4436-8c45-6a1ac0897475 req-fe71d111-2dfe-44fb-a88a-f7a98ca7eeeb service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Received event network-vif-plugged-8491a73c-f38b-4cb4-ab87-d6e41992319d {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:46:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0d854f7f-2968-4436-8c45-6a1ac0897475 req-fe71d111-2dfe-44fb-a88a-f7a98ca7eeeb service nova] Acquiring lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:46:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0d854f7f-2968-4436-8c45-6a1ac0897475 req-fe71d111-2dfe-44fb-a88a-f7a98ca7eeeb service nova] Lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:46:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0d854f7f-2968-4436-8c45-6a1ac0897475 req-fe71d111-2dfe-44fb-a88a-f7a98ca7eeeb service nova] Lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:46:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-0d854f7f-2968-4436-8c45-6a1ac0897475 req-fe71d111-2dfe-44fb-a88a-f7a98ca7eeeb service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] No waiting events found dispatching network-vif-plugged-8491a73c-f38b-4cb4-ab87-d6e41992319d {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:46:51 user nova-compute[73056]: WARNING nova.compute.manager [req-0d854f7f-2968-4436-8c45-6a1ac0897475 req-fe71d111-2dfe-44fb-a88a-f7a98ca7eeeb service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Received unexpected event network-vif-plugged-8491a73c-f38b-4cb4-ab87-d6e41992319d for instance with vm_state resized and task_state resize_reverting.
Aug 14 16:46:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-0d854f7f-2968-4436-8c45-6a1ac0897475 req-fe71d111-2dfe-44fb-a88a-f7a98ca7eeeb service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Received event network-vif-unplugged-8491a73c-f38b-4cb4-ab87-d6e41992319d {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:46:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0d854f7f-2968-4436-8c45-6a1ac0897475 req-fe71d111-2dfe-44fb-a88a-f7a98ca7eeeb service nova] Acquiring lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:46:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0d854f7f-2968-4436-8c45-6a1ac0897475 req-fe71d111-2dfe-44fb-a88a-f7a98ca7eeeb service nova] Lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:46:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0d854f7f-2968-4436-8c45-6a1ac0897475 req-fe71d111-2dfe-44fb-a88a-f7a98ca7eeeb service nova] Lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:46:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-0d854f7f-2968-4436-8c45-6a1ac0897475 req-fe71d111-2dfe-44fb-a88a-f7a98ca7eeeb service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] No waiting events found dispatching network-vif-unplugged-8491a73c-f38b-4cb4-ab87-d6e41992319d {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:46:51 user nova-compute[73056]: WARNING nova.compute.manager [req-0d854f7f-2968-4436-8c45-6a1ac0897475 req-fe71d111-2dfe-44fb-a88a-f7a98ca7eeeb service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Received unexpected event network-vif-unplugged-8491a73c-f38b-4cb4-ab87-d6e41992319d for instance with vm_state resized and task_state resize_reverting.
Aug 14 16:46:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-0d854f7f-2968-4436-8c45-6a1ac0897475 req-fe71d111-2dfe-44fb-a88a-f7a98ca7eeeb service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Received event network-vif-plugged-8491a73c-f38b-4cb4-ab87-d6e41992319d {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:46:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0d854f7f-2968-4436-8c45-6a1ac0897475 req-fe71d111-2dfe-44fb-a88a-f7a98ca7eeeb service nova] Acquiring lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:46:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0d854f7f-2968-4436-8c45-6a1ac0897475 req-fe71d111-2dfe-44fb-a88a-f7a98ca7eeeb service nova] Lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:46:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0d854f7f-2968-4436-8c45-6a1ac0897475 req-fe71d111-2dfe-44fb-a88a-f7a98ca7eeeb service nova] Lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:46:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-0d854f7f-2968-4436-8c45-6a1ac0897475 req-fe71d111-2dfe-44fb-a88a-f7a98ca7eeeb service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] No waiting events found dispatching network-vif-plugged-8491a73c-f38b-4cb4-ab87-d6e41992319d {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:46:51 user nova-compute[73056]: WARNING nova.compute.manager [req-0d854f7f-2968-4436-8c45-6a1ac0897475 req-fe71d111-2dfe-44fb-a88a-f7a98ca7eeeb service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Received unexpected event network-vif-plugged-8491a73c-f38b-4cb4-ab87-d6e41992319d for instance with vm_state resized and task_state resize_reverting.
Aug 14 16:46:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:46:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:46:51 user nova-compute[73056]: DEBUG nova.objects.instance [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lazy-loading 'migration_context' on Instance uuid 9c11423c-88d3-4fae-8917-c0d57021d194 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:46:51 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:46:51 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:46:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.483s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:46:52 user nova-compute[73056]: INFO nova.compute.manager [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Swapping old allocation on dict_keys(['2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b']) held by migration 701fbf5b-29e5-4606-87a2-d8733de0a2f1 for instance
Aug 14 16:46:52 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Overwriting current allocation {'allocations': {'2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 30}}, 'project_id': '4af3a3df4b8641c1ac0d02df893b524d', 'user_id': 'c39b09d624bb4977b6d1b396f425f737', 'consumer_generation': 1} on consumer 9c11423c-88d3-4fae-8917-c0d57021d194 {{(pid=73056) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 14 16:46:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Acquiring lock "refresh_cache-9c11423c-88d3-4fae-8917-c0d57021d194" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:46:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Acquired lock "refresh_cache-9c11423c-88d3-4fae-8917-c0d57021d194" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:46:52 user nova-compute[73056]: DEBUG nova.network.neutron [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:46:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "d79c2f2c-0870-4d8e-b468-36e63496b769" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:46:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "d79c2f2c-0870-4d8e-b468-36e63496b769" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:46:52 user nova-compute[73056]: DEBUG nova.compute.manager [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:46:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:46:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:46:52 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:46:52 user nova-compute[73056]: INFO nova.compute.claims [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Claim successful on node user
Aug 14 16:46:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:52 user nova-compute[73056]: DEBUG nova.network.neutron [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Updating instance_info_cache with network_info: [{"id": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "address": "fa:16:3e:e6:4c:64", "network": {"id": "db548415-fd97-4612-8699-d431cfe3c1ec", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-66082327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af3a3df4b8641c1ac0d02df893b524d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8491a73c-f3", "ovs_interfaceid": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:46:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Releasing lock "refresh_cache-9c11423c-88d3-4fae-8917-c0d57021d194" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:46:52 user nova-compute[73056]: DEBUG os_brick.utils [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:46:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:52 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b4d27b-4694-4334-ab22-e5156e8c8c57]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:52 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:46:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:52 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[870574f4-a037-4975-b1cc-0b85e74c6b22]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:52 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:46:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:53 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5290a63-4f51-4b80-8b40-a9c6d35bb1cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:53 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ffeadb-9c58-4a4a-b260-678898e585f8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:46:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:46:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.564s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:46:53 user nova-compute[73056]: DEBUG nova.compute.manager [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:46:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:46:53 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:46:53 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd958721-29bd-4b24-87b4-bf7c8d82639a]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:46:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:46:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:46:53 user nova-compute[73056]: DEBUG os_brick.utils [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:46:53 user nova-compute[73056]: DEBUG nova.compute.manager [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:46:53 user nova-compute[73056]: DEBUG nova.network.neutron [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:46:53 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:46:53 user nova-compute[73056]: DEBUG nova.compute.manager [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:46:53 user nova-compute[73056]: INFO nova.virt.block_device [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Booting with volume 523a4349-d411-42d5-82c8-e6182588a603 at /dev/vda
Aug 14 16:46:53 user nova-compute[73056]: DEBUG nova.policy [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9404ed7386e14eed8d046e8c45942c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd5723fb8384aa985cf401d95aa7d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:46:53 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:46:53 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73056) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 16:46:53 user nova-compute[73056]: DEBUG os_brick.utils [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:46:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:53 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe7afa7-540c-4332-bf4f-cbefdc0f3ffb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:53 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdfa8d5-a52b-4a41-9640-60d34998fa08]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:53 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0001d9-8523-481a-a12d-dabaf11d5ec9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:53 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[39119de2-20f9-4eef-b6ab-345bdf1818c1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:46:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:46:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:46:53 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:46:53 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d8748e-5139-4800-9e78-7352395a99a4]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:46:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:46:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:46:53 user nova-compute[73056]: DEBUG os_brick.utils [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:46:53 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Updating existing volume attachment record: 3fa30c07-bd27-4a68-96f8-18b83ac3f5ae {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 16:46:54 user nova-compute[73056]: DEBUG nova.network.neutron [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Successfully created port: c7a36ac9-68dc-462c-9e90-4eb844971548 {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:46:54 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:46:54 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 16:46:54 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:55 user nova-compute[73056]: DEBUG nova.network.neutron [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Successfully updated port: c7a36ac9-68dc-462c-9e90-4eb844971548 {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:46:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "refresh_cache-d79c2f2c-0870-4d8e-b468-36e63496b769" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:46:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquired lock "refresh_cache-d79c2f2c-0870-4d8e-b468-36e63496b769" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:46:55 user nova-compute[73056]: DEBUG nova.network.neutron [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:46:55 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:46:55 user nova-compute[73056]: DEBUG nova.compute.manager [req-835420a5-e027-49b4-a347-2dff5f08fa84 req-d655c710-d192-471e-8a04-b977a214b9d3 service nova] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Received event network-changed-c7a36ac9-68dc-462c-9e90-4eb844971548 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:46:55 user nova-compute[73056]: DEBUG nova.compute.manager [req-835420a5-e027-49b4-a347-2dff5f08fa84 req-d655c710-d192-471e-8a04-b977a214b9d3 service nova] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Refreshing instance network info cache due to event network-changed-c7a36ac9-68dc-462c-9e90-4eb844971548. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:46:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-835420a5-e027-49b4-a347-2dff5f08fa84 req-d655c710-d192-471e-8a04-b977a214b9d3 service nova] Acquiring lock "refresh_cache-d79c2f2c-0870-4d8e-b468-36e63496b769" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:46:55 user nova-compute[73056]: DEBUG nova.network.neutron [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:46:55 user nova-compute[73056]: DEBUG nova.network.neutron [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Updating instance_info_cache with network_info: [{"id": "c7a36ac9-68dc-462c-9e90-4eb844971548", "address": "fa:16:3e:44:b8:c2", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a36ac9-68", "ovs_interfaceid": "c7a36ac9-68dc-462c-9e90-4eb844971548", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:46:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Releasing lock "refresh_cache-d79c2f2c-0870-4d8e-b468-36e63496b769" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:46:55 user nova-compute[73056]: DEBUG nova.compute.manager [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Instance network_info: |[{"id": "c7a36ac9-68dc-462c-9e90-4eb844971548", "address": "fa:16:3e:44:b8:c2", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a36ac9-68", "ovs_interfaceid": "c7a36ac9-68dc-462c-9e90-4eb844971548", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:46:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-835420a5-e027-49b4-a347-2dff5f08fa84 req-d655c710-d192-471e-8a04-b977a214b9d3 service nova] Acquired lock "refresh_cache-d79c2f2c-0870-4d8e-b468-36e63496b769" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:46:55 user nova-compute[73056]: DEBUG nova.network.neutron [req-835420a5-e027-49b4-a347-2dff5f08fa84 req-d655c710-d192-471e-8a04-b977a214b9d3 service nova] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Refreshing network info cache for port c7a36ac9-68dc-462c-9e90-4eb844971548 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:46:56 user nova-compute[73056]: DEBUG nova.network.neutron [req-835420a5-e027-49b4-a347-2dff5f08fa84 req-d655c710-d192-471e-8a04-b977a214b9d3 service nova] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Updated VIF entry in instance network info cache for port c7a36ac9-68dc-462c-9e90-4eb844971548. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:46:56 user nova-compute[73056]: DEBUG nova.network.neutron [req-835420a5-e027-49b4-a347-2dff5f08fa84 req-d655c710-d192-471e-8a04-b977a214b9d3 service nova] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Updating instance_info_cache with network_info: [{"id": "c7a36ac9-68dc-462c-9e90-4eb844971548", "address": "fa:16:3e:44:b8:c2", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a36ac9-68", "ovs_interfaceid": "c7a36ac9-68dc-462c-9e90-4eb844971548", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:46:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-835420a5-e027-49b4-a347-2dff5f08fa84 req-d655c710-d192-471e-8a04-b977a214b9d3 service nova] Releasing lock "refresh_cache-d79c2f2c-0870-4d8e-b468-36e63496b769" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:46:56 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:46:57 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:46:57 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:46:57 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 16:46:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-9c11423c-88d3-4fae-8917-c0d57021d194" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:46:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-9c11423c-88d3-4fae-8917-c0d57021d194" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:46:57 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 16:46:57 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Updating instance_info_cache with network_info: [{"id": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "address": "fa:16:3e:e6:4c:64", "network": {"id": "db548415-fd97-4612-8699-d431cfe3c1ec", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-66082327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af3a3df4b8641c1ac0d02df893b524d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8491a73c-f3", "ovs_interfaceid": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:46:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-9c11423c-88d3-4fae-8917-c0d57021d194" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:46:57 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 16:46:57 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:46:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:46:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:46:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:46:57 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 16:46:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feea14e-10f2-4282-8137-2a5a289eda41/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG nova.compute.manager [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:46:58 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Creating image(s)
Aug 14 16:46:58 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Did not create local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Ensure instance console log exists: /opt/stack/data/nova/instances/7526c6c3-6d3c-435e-8fc7-742c08be44d0/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Start _get_guest_xml network_info=[{"id": "a97a3360-819f-4ea9-98e9-2f475b260008", "address": "fa:16:3e:41:58:29", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa97a3360-81", "ovs_interfaceid": "a97a3360-819f-4ea9-98e9-2f475b260008", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tqNQTZOd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7526c6c3-6d3c-435e-8fc7-742c08be44d0', 'attached_at': '', 'detached_at': '', 'volume_id': '00866544-b804-42b6-9c18-e2217e311cff', 'serial': '00866544-b804-42b6-9c18-e2217e311cff'}, 'attachment_id': '5c96f73e-864e-4919-986e-c3bdd1b04e9d', 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feea14e-10f2-4282-8137-2a5a289eda41/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feea14e-10f2-4282-8137-2a5a289eda41/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:58 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:46:58 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:46:58 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tqNQTZOd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:46:58 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:46:58 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:46:58 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:46:58 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:46:58 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b6ef05-2c43-46bd-a30c-ea7b99caefd3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:46:58 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f639a547-1a42-4872-a678-faa764f66ecd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff] added
Aug 14 16:46:58 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[551fb810-2b76-4feb-8765-bbe820a5144f]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feea14e-10f2-4282-8137-2a5a289eda41/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dbfa63-5061-4304-b8eb-4565ad9f0a96/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[547acc32-d122-4880-86ca-b0ed5027641c]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tqNQTZOd {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tqNQTZOd" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c15056d-cf97-4e94-9065-acdc6a4658b4]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tqNQTZOd'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[428f9efc-7a93-4a77-b01c-f04a5c0b2399]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba45ead-0ec2-4c5b-9c92-29425449001b]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:46:58 user nova-compute[73056]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b (non-flash)
Aug 14 16:46:58 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:46:58 user nova-compute[73056]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b (non-flash)
Aug 14 16:46:58 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c296abbb-569e-46b6-a8cf-399571fd36a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff, portal: 172.16.0.220,3260]
Aug 14 16:46:58 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff, portal: 172.16.0.220,3260] successful.
Aug 14 16:46:58 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dbfa63-5061-4304-b8eb-4565ad9f0a96/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dbfa63-5061-4304-b8eb-4565ad9f0a96/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[57005f85-c6f9-4aef-9dc9-2c430730593e]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fc320de5-59ea-4f8e-8ee4-ddfd22d27037 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Acquiring lock "1feea14e-10f2-4282-8137-2a5a289eda41" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fc320de5-59ea-4f8e-8ee4-ddfd22d27037 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Lock "1feea14e-10f2-4282-8137-2a5a289eda41" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.005s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fc320de5-59ea-4f8e-8ee4-ddfd22d27037 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Acquiring lock "1feea14e-10f2-4282-8137-2a5a289eda41-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fc320de5-59ea-4f8e-8ee4-ddfd22d27037 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Lock "1feea14e-10f2-4282-8137-2a5a289eda41-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fc320de5-59ea-4f8e-8ee4-ddfd22d27037 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Lock "1feea14e-10f2-4282-8137-2a5a289eda41-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6399166-7371-40b7-bd70-1e4e4543d38f]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:46:58 user nova-compute[73056]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b (non-flash)
Aug 14 16:46:58 user nova-compute[73056]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:46:58 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:46:58 user nova-compute[73056]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b (non-flash)
Aug 14 16:46:58 user nova-compute[73056]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:46:58 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:46:58 user nova-compute[73056]: INFO nova.compute.manager [None req-fc320de5-59ea-4f8e-8ee4-ddfd22d27037 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Terminating instance
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG nova.compute.manager [None req-fc320de5-59ea-4f8e-8ee4-ddfd22d27037 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.027s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf31861-e3cc-4b3f-8357-639a95115dd8]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tqNQTZOd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dbfa63-5061-4304-b8eb-4565ad9f0a96/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:46:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG nova.compute.manager [req-612208e9-f14c-445f-a863-d2dfb65ddfa6 req-ece552cb-aedc-42c4-9b3f-cd3fdd09f2a5 service nova] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Received event network-vif-unplugged-8d863621-6a6e-4464-93bd-62b02305ef0a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-612208e9-f14c-445f-a863-d2dfb65ddfa6 req-ece552cb-aedc-42c4-9b3f-cd3fdd09f2a5 service nova] Acquiring lock "1feea14e-10f2-4282-8137-2a5a289eda41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-612208e9-f14c-445f-a863-d2dfb65ddfa6 req-ece552cb-aedc-42c4-9b3f-cd3fdd09f2a5 service nova] Lock "1feea14e-10f2-4282-8137-2a5a289eda41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-612208e9-f14c-445f-a863-d2dfb65ddfa6 req-ece552cb-aedc-42c4-9b3f-cd3fdd09f2a5 service nova] Lock "1feea14e-10f2-4282-8137-2a5a289eda41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG nova.compute.manager [req-612208e9-f14c-445f-a863-d2dfb65ddfa6 req-ece552cb-aedc-42c4-9b3f-cd3fdd09f2a5 service nova] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] No waiting events found dispatching network-vif-unplugged-8d863621-6a6e-4464-93bd-62b02305ef0a {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG nova.compute.manager [req-612208e9-f14c-445f-a863-d2dfb65ddfa6 req-ece552cb-aedc-42c4-9b3f-cd3fdd09f2a5 service nova] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Received event network-vif-unplugged-8d863621-6a6e-4464-93bd-62b02305ef0a for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:59 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Instance destroyed successfully.
Aug 14 16:46:59 user nova-compute[73056]: DEBUG nova.objects.instance [None req-fc320de5-59ea-4f8e-8ee4-ddfd22d27037 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Lazy-loading 'resources' on Instance uuid 1feea14e-10f2-4282-8137-2a5a289eda41 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-fc320de5-59ea-4f8e-8ee4-ddfd22d27037 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:45:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1038994978',display_name='tempest-VolumesActionsTest-instance-1038994978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1038994978',id=25,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:45:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b1bd35329054f4793440e9a780a0a75',ramdisk_id='',reservation_id='r-nf58coxk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1822561302',owner_user_name='tempest-VolumesActionsTest-1822561302-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:45:14Z,user_data=None,user_id='6f3c0d0bffd749299fe0bf8ab5aaf8c5',uuid=1feea14e-10f2-4282-8137-2a5a289eda41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d863621-6a6e-4464-93bd-62b02305ef0a", "address": "fa:16:3e:7e:6a:2f", "network": {"id": "90290111-0089-4535-9ba5-97fb3b034dcd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1526741248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1bd35329054f4793440e9a780a0a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d863621-6a", "ovs_interfaceid": "8d863621-6a6e-4464-93bd-62b02305ef0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-fc320de5-59ea-4f8e-8ee4-ddfd22d27037 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Converting VIF {"id": "8d863621-6a6e-4464-93bd-62b02305ef0a", "address": "fa:16:3e:7e:6a:2f", "network": {"id": "90290111-0089-4535-9ba5-97fb3b034dcd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1526741248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1bd35329054f4793440e9a780a0a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d863621-6a", "ovs_interfaceid": "8d863621-6a6e-4464-93bd-62b02305ef0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-fc320de5-59ea-4f8e-8ee4-ddfd22d27037 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:6a:2f,bridge_name='br-int',has_traffic_filtering=True,id=8d863621-6a6e-4464-93bd-62b02305ef0a,network=Network(90290111-0089-4535-9ba5-97fb3b034dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d863621-6a') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG os_vif [None req-fc320de5-59ea-4f8e-8ee4-ddfd22d27037 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:6a:2f,bridge_name='br-int',has_traffic_filtering=True,id=8d863621-6a6e-4464-93bd-62b02305ef0a,network=Network(90290111-0089-4535-9ba5-97fb3b034dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d863621-6a') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d863621-6a, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:59 user nova-compute[73056]: INFO os_vif [None req-fc320de5-59ea-4f8e-8ee4-ddfd22d27037 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:6a:2f,bridge_name='br-int',has_traffic_filtering=True,id=8d863621-6a6e-4464-93bd-62b02305ef0a,network=Network(90290111-0089-4535-9ba5-97fb3b034dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d863621-6a')
Aug 14 16:46:59 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-fc320de5-59ea-4f8e-8ee4-ddfd22d27037 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Deleting instance files /opt/stack/data/nova/instances/1feea14e-10f2-4282-8137-2a5a289eda41_del
Aug 14 16:46:59 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-fc320de5-59ea-4f8e-8ee4-ddfd22d27037 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Deletion of /opt/stack/data/nova/instances/1feea14e-10f2-4282-8137-2a5a289eda41_del complete
Aug 14 16:46:59 user nova-compute[73056]: INFO nova.compute.manager [None req-fc320de5-59ea-4f8e-8ee4-ddfd22d27037 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Took 0.74 seconds to destroy the instance on the hypervisor.
Aug 14 16:46:59 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-fc320de5-59ea-4f8e-8ee4-ddfd22d27037 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] <== connect_volume: return (1425ms) {'type': 'block', 'scsi_wwn': '26533366137336238', 'path': '/dev/sdd'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533366137336238', 'path': '/dev/sdd'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:46:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-673849661',display_name='tempest-TestVolumeBootPattern-volume-backed-server-673849661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-673849661',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGc7IuopkjjzNdNcFWYuM084+Lh0vN7ilsIJcPWDW1pU/oFfmkDOYKLrJp4Lj+eeUU6uItZQ8qnQhQYc71F1yS0jmLrNC3bnFKXcNCrNv/tf2zN9lbhSXYD17UdPUitKag==',key_name='tempest-keypair-2082052248',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cffb5203b9284500b8add8a6586cad49',ramdisk_id='',reservation_id='r-ri5hlptr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1676214558',owner_user_name='tempest-TestVolumeBootPattern-1676214558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:46:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2be1b098ca9f4232bd198b515630f6ad',uuid=7526c6c3-6d3c-435e-8fc7-742c08be44d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a97a3360-819f-4ea9-98e9-2f475b260008", "address": "fa:16:3e:41:58:29", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa97a3360-81", "ovs_interfaceid": "a97a3360-819f-4ea9-98e9-2f475b260008", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Converting VIF {"id": "a97a3360-819f-4ea9-98e9-2f475b260008", "address": "fa:16:3e:41:58:29", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa97a3360-81", "ovs_interfaceid": "a97a3360-819f-4ea9-98e9-2f475b260008", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:58:29,bridge_name='br-int',has_traffic_filtering=True,id=a97a3360-819f-4ea9-98e9-2f475b260008,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa97a3360-81') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG nova.objects.instance [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lazy-loading 'pci_devices' on Instance uuid 7526c6c3-6d3c-435e-8fc7-742c08be44d0 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:46:59 user nova-compute[73056]:   <uuid>7526c6c3-6d3c-435e-8fc7-742c08be44d0</uuid>
Aug 14 16:46:59 user nova-compute[73056]:   <name>instance-0000001a</name>
Aug 14 16:46:59 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:46:59 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:46:59 user nova-compute[73056]:   <metadata>
Aug 14 16:46:59 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:46:59 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:46:59 user nova-compute[73056]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-673849661</nova:name>
Aug 14 16:46:59 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:46:58</nova:creationTime>
Aug 14 16:46:59 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:46:59 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:46:59 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:46:59 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:46:59 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:46:59 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:46:59 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:46:59 user nova-compute[73056]:       <nova:owner>
Aug 14 16:46:59 user nova-compute[73056]:         <nova:user uuid="2be1b098ca9f4232bd198b515630f6ad">tempest-TestVolumeBootPattern-1676214558-project-member</nova:user>
Aug 14 16:46:59 user nova-compute[73056]:         <nova:project uuid="cffb5203b9284500b8add8a6586cad49">tempest-TestVolumeBootPattern-1676214558</nova:project>
Aug 14 16:46:59 user nova-compute[73056]:       </nova:owner>
Aug 14 16:46:59 user nova-compute[73056]:       <nova:ports>
Aug 14 16:46:59 user nova-compute[73056]:         <nova:port uuid="a97a3360-819f-4ea9-98e9-2f475b260008">
Aug 14 16:46:59 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 16:46:59 user nova-compute[73056]:         </nova:port>
Aug 14 16:46:59 user nova-compute[73056]:       </nova:ports>
Aug 14 16:46:59 user nova-compute[73056]:     </nova:instance>
Aug 14 16:46:59 user nova-compute[73056]:   </metadata>
Aug 14 16:46:59 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:46:59 user nova-compute[73056]:     <system>
Aug 14 16:46:59 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:46:59 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:46:59 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:46:59 user nova-compute[73056]:       <entry name="serial">7526c6c3-6d3c-435e-8fc7-742c08be44d0</entry>
Aug 14 16:46:59 user nova-compute[73056]:       <entry name="uuid">7526c6c3-6d3c-435e-8fc7-742c08be44d0</entry>
Aug 14 16:46:59 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:46:59 user nova-compute[73056]:     </system>
Aug 14 16:46:59 user nova-compute[73056]:   </sysinfo>
Aug 14 16:46:59 user nova-compute[73056]:   <os>
Aug 14 16:46:59 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:46:59 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:46:59 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:46:59 user nova-compute[73056]:   </os>
Aug 14 16:46:59 user nova-compute[73056]:   <features>
Aug 14 16:46:59 user nova-compute[73056]:     <acpi/>
Aug 14 16:46:59 user nova-compute[73056]:     <apic/>
Aug 14 16:46:59 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:46:59 user nova-compute[73056]:   </features>
Aug 14 16:46:59 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:46:59 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:46:59 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:46:59 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:46:59 user nova-compute[73056]:   </clock>
Aug 14 16:46:59 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:46:59 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:46:59 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:46:59 user nova-compute[73056]:   </cpu>
Aug 14 16:46:59 user nova-compute[73056]:   <devices>
Aug 14 16:46:59 user nova-compute[73056]:     <disk type="block" device="disk">
Aug 14 16:46:59 user nova-compute[73056]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:46:59 user nova-compute[73056]:       <source dev="/dev/sdd"/>
Aug 14 16:46:59 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:46:59 user nova-compute[73056]:       <serial>00866544-b804-42b6-9c18-e2217e311cff</serial>
Aug 14 16:46:59 user nova-compute[73056]:     </disk>
Aug 14 16:46:59 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:46:59 user nova-compute[73056]:       <mac address="fa:16:3e:41:58:29"/>
Aug 14 16:46:59 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:46:59 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:46:59 user nova-compute[73056]:       <target dev="tapa97a3360-81"/>
Aug 14 16:46:59 user nova-compute[73056]:     </interface>
Aug 14 16:46:59 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:46:59 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/7526c6c3-6d3c-435e-8fc7-742c08be44d0/console.log" append="off"/>
Aug 14 16:46:59 user nova-compute[73056]:     </serial>
Aug 14 16:46:59 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:46:59 user nova-compute[73056]:     <video>
Aug 14 16:46:59 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:46:59 user nova-compute[73056]:     </video>
Aug 14 16:46:59 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:46:59 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:46:59 user nova-compute[73056]:     </rng>
Aug 14 16:46:59 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:46:59 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:46:59 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:46:59 user nova-compute[73056]:     </memballoon>
Aug 14 16:46:59 user nova-compute[73056]:   </devices>
Aug 14 16:46:59 user nova-compute[73056]: </domain>
Aug 14 16:46:59 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:46:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-673849661',display_name='tempest-TestVolumeBootPattern-volume-backed-server-673849661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-673849661',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGc7IuopkjjzNdNcFWYuM084+Lh0vN7ilsIJcPWDW1pU/oFfmkDOYKLrJp4Lj+eeUU6uItZQ8qnQhQYc71F1yS0jmLrNC3bnFKXcNCrNv/tf2zN9lbhSXYD17UdPUitKag==',key_name='tempest-keypair-2082052248',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cffb5203b9284500b8add8a6586cad49',ramdisk_id='',reservation_id='r-ri5hlptr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1676214558',owner_user_name='tempest-TestVolumeBootPattern-1676214558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:46:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2be1b098ca9f4232bd198b515630f6ad',uuid=7526c6c3-6d3c-435e-8fc7-742c08be44d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a97a3360-819f-4ea9-98e9-2f475b260008", "address": "fa:16:3e:41:58:29", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa97a3360-81", "ovs_interfaceid": "a97a3360-819f-4ea9-98e9-2f475b260008", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Converting VIF {"id": "a97a3360-819f-4ea9-98e9-2f475b260008", "address": "fa:16:3e:41:58:29", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa97a3360-81", "ovs_interfaceid": "a97a3360-819f-4ea9-98e9-2f475b260008", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:58:29,bridge_name='br-int',has_traffic_filtering=True,id=a97a3360-819f-4ea9-98e9-2f475b260008,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa97a3360-81') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG os_vif [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:58:29,bridge_name='br-int',has_traffic_filtering=True,id=a97a3360-819f-4ea9-98e9-2f475b260008,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa97a3360-81') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa97a3360-81, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa97a3360-81, col_values=(('external_ids', {'iface-id': 'a97a3360-819f-4ea9-98e9-2f475b260008', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:58:29', 'vm-uuid': '7526c6c3-6d3c-435e-8fc7-742c08be44d0'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:46:59 user nova-compute[73056]: INFO os_vif [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:58:29,bridge_name='br-int',has_traffic_filtering=True,id=a97a3360-819f-4ea9-98e9-2f475b260008,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa97a3360-81')
Aug 14 16:46:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:46:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:47:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] No VIF found with MAC fa:16:3e:41:58:29, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:47:00 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:47:00 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Took 0.61 seconds to deallocate network for instance.
Aug 14 16:47:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fc320de5-59ea-4f8e-8ee4-ddfd22d27037 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:47:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fc320de5-59ea-4f8e-8ee4-ddfd22d27037 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:47:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:00 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-fc320de5-59ea-4f8e-8ee4-ddfd22d27037 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:47:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:00 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-fc320de5-59ea-4f8e-8ee4-ddfd22d27037 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:47:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fc320de5-59ea-4f8e-8ee4-ddfd22d27037 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.695s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:47:00 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-fc320de5-59ea-4f8e-8ee4-ddfd22d27037 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Deleted allocations for instance 1feea14e-10f2-4282-8137-2a5a289eda41
Aug 14 16:47:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:01 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:47:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3270811-8241-47a6-aa36-0ec3feddf0fc/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fc320de5-59ea-4f8e-8ee4-ddfd22d27037 tempest-VolumesActionsTest-1822561302 tempest-VolumesActionsTest-1822561302-project-member] Lock "1feea14e-10f2-4282-8137-2a5a289eda41" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.320s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:47:01 user nova-compute[73056]: DEBUG nova.compute.manager [req-b50ec1de-a275-47d2-934f-674714c604e9 req-a328feff-7d29-4509-95be-38e1096af2af service nova] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Received event network-vif-plugged-8d863621-6a6e-4464-93bd-62b02305ef0a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:47:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-b50ec1de-a275-47d2-934f-674714c604e9 req-a328feff-7d29-4509-95be-38e1096af2af service nova] Acquiring lock "1feea14e-10f2-4282-8137-2a5a289eda41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:47:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-b50ec1de-a275-47d2-934f-674714c604e9 req-a328feff-7d29-4509-95be-38e1096af2af service nova] Lock "1feea14e-10f2-4282-8137-2a5a289eda41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:47:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-b50ec1de-a275-47d2-934f-674714c604e9 req-a328feff-7d29-4509-95be-38e1096af2af service nova] Lock "1feea14e-10f2-4282-8137-2a5a289eda41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:47:01 user nova-compute[73056]: DEBUG nova.compute.manager [req-b50ec1de-a275-47d2-934f-674714c604e9 req-a328feff-7d29-4509-95be-38e1096af2af service nova] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] No waiting events found dispatching network-vif-plugged-8d863621-6a6e-4464-93bd-62b02305ef0a {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:47:01 user nova-compute[73056]: WARNING nova.compute.manager [req-b50ec1de-a275-47d2-934f-674714c604e9 req-a328feff-7d29-4509-95be-38e1096af2af service nova] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Received unexpected event network-vif-plugged-8d863621-6a6e-4464-93bd-62b02305ef0a for instance with vm_state deleted and task_state None.
Aug 14 16:47:01 user nova-compute[73056]: DEBUG nova.compute.manager [req-b50ec1de-a275-47d2-934f-674714c604e9 req-a328feff-7d29-4509-95be-38e1096af2af service nova] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Received event network-vif-deleted-8d863621-6a6e-4464-93bd-62b02305ef0a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:47:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3270811-8241-47a6-aa36-0ec3feddf0fc/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3270811-8241-47a6-aa36-0ec3feddf0fc/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3270811-8241-47a6-aa36-0ec3feddf0fc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031623.6362388, 7526c6c3-6d3c-435e-8fc7-742c08be44d0 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:47:04 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] VM Resumed (Lifecycle Event)
Aug 14 16:47:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.compute.manager [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.compute.manager [req-56eb552c-ee2f-441b-bc6c-dbda9c128d90 req-550ac510-d9b7-47a5-8812-82e7b3b87f9b service nova] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Received event network-vif-plugged-a97a3360-819f-4ea9-98e9-2f475b260008 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-56eb552c-ee2f-441b-bc6c-dbda9c128d90 req-550ac510-d9b7-47a5-8812-82e7b3b87f9b service nova] Acquiring lock "7526c6c3-6d3c-435e-8fc7-742c08be44d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-56eb552c-ee2f-441b-bc6c-dbda9c128d90 req-550ac510-d9b7-47a5-8812-82e7b3b87f9b service nova] Lock "7526c6c3-6d3c-435e-8fc7-742c08be44d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-56eb552c-ee2f-441b-bc6c-dbda9c128d90 req-550ac510-d9b7-47a5-8812-82e7b3b87f9b service nova] Lock "7526c6c3-6d3c-435e-8fc7-742c08be44d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.compute.manager [req-56eb552c-ee2f-441b-bc6c-dbda9c128d90 req-550ac510-d9b7-47a5-8812-82e7b3b87f9b service nova] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] No waiting events found dispatching network-vif-plugged-a97a3360-819f-4ea9-98e9-2f475b260008 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:47:04 user nova-compute[73056]: WARNING nova.compute.manager [req-56eb552c-ee2f-441b-bc6c-dbda9c128d90 req-550ac510-d9b7-47a5-8812-82e7b3b87f9b service nova] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Received unexpected event network-vif-plugged-a97a3360-819f-4ea9-98e9-2f475b260008 for instance with vm_state building and task_state spawning.
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.compute.manager [req-cadee9ef-cad9-4727-b8d9-132abc4a129b req-fde80507-8a57-4d8b-92a7-702a85b0d2a0 service nova] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Received event network-vif-plugged-a97a3360-819f-4ea9-98e9-2f475b260008 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cadee9ef-cad9-4727-b8d9-132abc4a129b req-fde80507-8a57-4d8b-92a7-702a85b0d2a0 service nova] Acquiring lock "7526c6c3-6d3c-435e-8fc7-742c08be44d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cadee9ef-cad9-4727-b8d9-132abc4a129b req-fde80507-8a57-4d8b-92a7-702a85b0d2a0 service nova] Lock "7526c6c3-6d3c-435e-8fc7-742c08be44d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cadee9ef-cad9-4727-b8d9-132abc4a129b req-fde80507-8a57-4d8b-92a7-702a85b0d2a0 service nova] Lock "7526c6c3-6d3c-435e-8fc7-742c08be44d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.compute.manager [req-cadee9ef-cad9-4727-b8d9-132abc4a129b req-fde80507-8a57-4d8b-92a7-702a85b0d2a0 service nova] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] No waiting events found dispatching network-vif-plugged-a97a3360-819f-4ea9-98e9-2f475b260008 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:47:04 user nova-compute[73056]: WARNING nova.compute.manager [req-cadee9ef-cad9-4727-b8d9-132abc4a129b req-fde80507-8a57-4d8b-92a7-702a85b0d2a0 service nova] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Received unexpected event network-vif-plugged-a97a3360-819f-4ea9-98e9-2f475b260008 for instance with vm_state building and task_state spawning.
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:47:04 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:47:04 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=7450MB free_disk=25.259746551513672GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:47:04 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Instance spawned successfully.
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:47:04 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031623.6371765, 7526c6c3-6d3c-435e-8fc7-742c08be44d0 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:47:04 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] VM Started (Lifecycle Event)
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:47:04 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Starting finish_revert_migration {{(pid=73056) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 14 16:47:04 user nova-compute[73056]: INFO nova.compute.manager [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Took 5.94 seconds to spawn the instance on the hypervisor.
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.compute.manager [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Start _get_guest_xml network_info=[{"id": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "address": "fa:16:3e:e6:4c:64", "network": {"id": "db548415-fd97-4612-8699-d431cfe3c1ec", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-66082327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af3a3df4b8641c1ac0d02df893b524d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8491a73c-f3", "ovs_interfaceid": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iThIoFVw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '9c11423c-88d3-4fae-8917-c0d57021d194', 'attached_at': '2023-08-14T16:47:03.000000', 'detached_at': '', 'volume_id': '37a09be2-92fa-4429-a416-13d78c74eda0', 'serial': '37a09be2-92fa-4429-a416-13d78c74eda0'}, 'attachment_id': '64b15089-7617-4f38-8af6-518998a3bece', 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:47:04 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:47:04 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.compute.manager [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:47:04 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Creating image(s)
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Did not create local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Ensure instance console log exists: /opt/stack/data/nova/instances/d79c2f2c-0870-4d8e-b468-36e63496b769/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Start _get_guest_xml network_info=[{"id": "c7a36ac9-68dc-462c-9e90-4eb844971548", "address": "fa:16:3e:44:b8:c2", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a36ac9-68", "ovs_interfaceid": "c7a36ac9-68dc-462c-9e90-4eb844971548", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qsfKthHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd79c2f2c-0870-4d8e-b468-36e63496b769', 'attached_at': '', 'detached_at': '', 'volume_id': '523a4349-d411-42d5-82c8-e6182588a603', 'serial': '523a4349-d411-42d5-82c8-e6182588a603'}, 'attachment_id': '3fa30c07-bd27-4a68-96f8-18b83ac3f5ae', 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 9f3a7f8a-e3b9-4918-9663-968677fe5c90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 4731f355-9307-4176-910b-cf35beb85e75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance b3270811-8241-47a6-aa36-0ec3feddf0fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance d5dbfa63-5061-4304-b8eb-4565ad9f0a96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance b580e3d0-88b5-42a3-a953-84b94c088f41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 92c34cf0-fd39-49fc-9244-4da8ccae6eec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 9c11423c-88d3-4fae-8917-c0d57021d194 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 7526c6c3-6d3c-435e-8fc7-742c08be44d0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance d79c2f2c-0870-4d8e-b468-36e63496b769 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.objects.instance [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9c11423c-88d3-4fae-8917-c0d57021d194 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:47:04 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:47:04 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qsfKthHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:47:04 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:47:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:47:04 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:47:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:47:04 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iThIoFVw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:47:04 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:47:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:47:04 user nova-compute[73056]: INFO nova.compute.manager [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Took 17.41 seconds to build instance.
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d3668f-0e0d-420c-99d8-db12ee8f0957]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:47:04 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-cf6bb722-4049-4bcd-a958-71f3e52a949b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "7526c6c3-6d3c-435e-8fc7-742c08be44d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.539s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[9650ca82-a105-45c0-9d07-f21b33732510]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603] added
Aug 14 16:47:04 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5556aee1-be3a-458c-bfe7-4a1008b54d35]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ddc0b8-76b2-4218-837c-a04edcea9dd4]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qsfKthHT {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qsfKthHT" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75e27db-90e8-43d8-920c-ea8f402750d3]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qsfKthHT'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ca2ab9-ff08-4f9a-8109-afb97ddf41ea]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2939e5-936b-4915-b24d-057171edfac5]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:47:04 user nova-compute[73056]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b (non-flash)
Aug 14 16:47:04 user nova-compute[73056]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:47:04 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:47:04 user nova-compute[73056]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b (non-flash)
Aug 14 16:47:04 user nova-compute[73056]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:47:04 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[07aa5e49-e816-443e-af0d-86f54efcd92e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603, portal: 172.16.0.220,3260]
Aug 14 16:47:04 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603, portal: 172.16.0.220,3260] successful.
Aug 14 16:47:04 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa0454b-1dfa-4648-adf6-64841f7eeac6]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2a1453-c68c-42ee-93f4-a92bd73bc7d9]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:47:04 user nova-compute[73056]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b (non-flash)
Aug 14 16:47:04 user nova-compute[73056]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:47:04 user nova-compute[73056]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:47:04 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:47:04 user nova-compute[73056]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b (non-flash)
Aug 14 16:47:04 user nova-compute[73056]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:47:04 user nova-compute[73056]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:47:04 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.402s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.706s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692031609.808292, 9c11423c-88d3-4fae-8917-c0d57021d194 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:47:04 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] VM Stopped (Lifecycle Event)
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Cleaning up deleted instances {{(pid=73056) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[4904b018-dbf9-4cca-90f1-3bf74e9e39b3]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qsfKthHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.compute.manager [None req-dbb4c87b-6967-4a3b-8b1e-e4531de4e4d8 None None] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] There are 0 instances to clean {{(pid=73056) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:47:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.454s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] <== connect_volume: return (1457ms) {'type': 'block', 'scsi_wwn': '23932653739666532', 'path': '/dev/sde'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932653739666532', 'path': '/dev/sde'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.404s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:47:05 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:47:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:47:05 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:47:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a00991b-90e2-448f-81b3-e72aad232048]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:47:05 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:46:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1030984807',display_name='tempest-ServerActionsTestOtherA-server-1030984807',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1030984807',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDU6ne8W7YSxsWIOL2ltT8/3A4Lay+Fa3EBjGBahsu1+va9jX8aVIvfUTXS/QOiNmJPitbbWTrcI3+h3fj8j4zOwrNCeF7Pt0QIdwz/ogo81jcw9PMYL2yia/QSf+KeHhA==',key_name='tempest-keypair-1415046919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2dd5723fb8384aa985cf401d95aa7d08',ramdisk_id='',reservation_id='r-fwp2qpkf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-380813086',owner_user_name='tempest-ServerActionsTestOtherA-380813086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:46:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9404ed7386e14eed8d046e8c45942c75',uuid=d79c2f2c-0870-4d8e-b468-36e63496b769,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7a36ac9-68dc-462c-9e90-4eb844971548", "address": "fa:16:3e:44:b8:c2", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a36ac9-68", "ovs_interfaceid": "c7a36ac9-68dc-462c-9e90-4eb844971548", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Converting VIF {"id": "c7a36ac9-68dc-462c-9e90-4eb844971548", "address": "fa:16:3e:44:b8:c2", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a36ac9-68", "ovs_interfaceid": "c7a36ac9-68dc-462c-9e90-4eb844971548", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:b8:c2,bridge_name='br-int',has_traffic_filtering=True,id=c7a36ac9-68dc-462c-9e90-4eb844971548,network=Network(2c5f0d57-9485-4a0b-a847-49eea5cd17c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7a36ac9-68') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG nova.objects.instance [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lazy-loading 'pci_devices' on Instance uuid d79c2f2c-0870-4d8e-b468-36e63496b769 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:47:05 user nova-compute[73056]:   <uuid>d79c2f2c-0870-4d8e-b468-36e63496b769</uuid>
Aug 14 16:47:05 user nova-compute[73056]:   <name>instance-0000001b</name>
Aug 14 16:47:05 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:47:05 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:47:05 user nova-compute[73056]:   <metadata>
Aug 14 16:47:05 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:47:05 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:47:05 user nova-compute[73056]:       <nova:name>tempest-ServerActionsTestOtherA-server-1030984807</nova:name>
Aug 14 16:47:05 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:47:04</nova:creationTime>
Aug 14 16:47:05 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:47:05 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:47:05 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:47:05 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:47:05 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:47:05 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:47:05 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:47:05 user nova-compute[73056]:       <nova:owner>
Aug 14 16:47:05 user nova-compute[73056]:         <nova:user uuid="9404ed7386e14eed8d046e8c45942c75">tempest-ServerActionsTestOtherA-380813086-project-member</nova:user>
Aug 14 16:47:05 user nova-compute[73056]:         <nova:project uuid="2dd5723fb8384aa985cf401d95aa7d08">tempest-ServerActionsTestOtherA-380813086</nova:project>
Aug 14 16:47:05 user nova-compute[73056]:       </nova:owner>
Aug 14 16:47:05 user nova-compute[73056]:       <nova:ports>
Aug 14 16:47:05 user nova-compute[73056]:         <nova:port uuid="c7a36ac9-68dc-462c-9e90-4eb844971548">
Aug 14 16:47:05 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 16:47:05 user nova-compute[73056]:         </nova:port>
Aug 14 16:47:05 user nova-compute[73056]:       </nova:ports>
Aug 14 16:47:05 user nova-compute[73056]:     </nova:instance>
Aug 14 16:47:05 user nova-compute[73056]:   </metadata>
Aug 14 16:47:05 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:47:05 user nova-compute[73056]:     <system>
Aug 14 16:47:05 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:47:05 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:47:05 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:47:05 user nova-compute[73056]:       <entry name="serial">d79c2f2c-0870-4d8e-b468-36e63496b769</entry>
Aug 14 16:47:05 user nova-compute[73056]:       <entry name="uuid">d79c2f2c-0870-4d8e-b468-36e63496b769</entry>
Aug 14 16:47:05 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:47:05 user nova-compute[73056]:     </system>
Aug 14 16:47:05 user nova-compute[73056]:   </sysinfo>
Aug 14 16:47:05 user nova-compute[73056]:   <os>
Aug 14 16:47:05 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:47:05 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:47:05 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:47:05 user nova-compute[73056]:   </os>
Aug 14 16:47:05 user nova-compute[73056]:   <features>
Aug 14 16:47:05 user nova-compute[73056]:     <acpi/>
Aug 14 16:47:05 user nova-compute[73056]:     <apic/>
Aug 14 16:47:05 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:47:05 user nova-compute[73056]:   </features>
Aug 14 16:47:05 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:47:05 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:47:05 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:47:05 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:47:05 user nova-compute[73056]:   </clock>
Aug 14 16:47:05 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:47:05 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:47:05 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:47:05 user nova-compute[73056]:   </cpu>
Aug 14 16:47:05 user nova-compute[73056]:   <devices>
Aug 14 16:47:05 user nova-compute[73056]:     <disk type="block" device="disk">
Aug 14 16:47:05 user nova-compute[73056]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:47:05 user nova-compute[73056]:       <source dev="/dev/sde"/>
Aug 14 16:47:05 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:47:05 user nova-compute[73056]:       <serial>523a4349-d411-42d5-82c8-e6182588a603</serial>
Aug 14 16:47:05 user nova-compute[73056]:     </disk>
Aug 14 16:47:05 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:47:05 user nova-compute[73056]:       <mac address="fa:16:3e:44:b8:c2"/>
Aug 14 16:47:05 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:47:05 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:47:05 user nova-compute[73056]:       <target dev="tapc7a36ac9-68"/>
Aug 14 16:47:05 user nova-compute[73056]:     </interface>
Aug 14 16:47:05 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:47:05 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/d79c2f2c-0870-4d8e-b468-36e63496b769/console.log" append="off"/>
Aug 14 16:47:05 user nova-compute[73056]:     </serial>
Aug 14 16:47:05 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:47:05 user nova-compute[73056]:     <video>
Aug 14 16:47:05 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:47:05 user nova-compute[73056]:     </video>
Aug 14 16:47:05 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:47:05 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:47:05 user nova-compute[73056]:     </rng>
Aug 14 16:47:05 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:47:05 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:47:05 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:47:05 user nova-compute[73056]:     </memballoon>
Aug 14 16:47:05 user nova-compute[73056]:   </devices>
Aug 14 16:47:05 user nova-compute[73056]: </domain>
Aug 14 16:47:05 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:46:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1030984807',display_name='tempest-ServerActionsTestOtherA-server-1030984807',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1030984807',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDU6ne8W7YSxsWIOL2ltT8/3A4Lay+Fa3EBjGBahsu1+va9jX8aVIvfUTXS/QOiNmJPitbbWTrcI3+h3fj8j4zOwrNCeF7Pt0QIdwz/ogo81jcw9PMYL2yia/QSf+KeHhA==',key_name='tempest-keypair-1415046919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2dd5723fb8384aa985cf401d95aa7d08',ramdisk_id='',reservation_id='r-fwp2qpkf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-380813086',owner_user_name='tempest-ServerActionsTestOtherA-380813086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:46:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9404ed7386e14eed8d046e8c45942c75',uuid=d79c2f2c-0870-4d8e-b468-36e63496b769,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7a36ac9-68dc-462c-9e90-4eb844971548", "address": "fa:16:3e:44:b8:c2", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a36ac9-68", "ovs_interfaceid": "c7a36ac9-68dc-462c-9e90-4eb844971548", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Converting VIF {"id": "c7a36ac9-68dc-462c-9e90-4eb844971548", "address": "fa:16:3e:44:b8:c2", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a36ac9-68", "ovs_interfaceid": "c7a36ac9-68dc-462c-9e90-4eb844971548", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:b8:c2,bridge_name='br-int',has_traffic_filtering=True,id=c7a36ac9-68dc-462c-9e90-4eb844971548,network=Network(2c5f0d57-9485-4a0b-a847-49eea5cd17c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7a36ac9-68') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG os_vif [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:b8:c2,bridge_name='br-int',has_traffic_filtering=True,id=c7a36ac9-68dc-462c-9e90-4eb844971548,network=Network(2c5f0d57-9485-4a0b-a847-49eea5cd17c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7a36ac9-68') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8afbb5-e021-4dcb-a716-0fdefbfc3436]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0] added
Aug 14 16:47:05 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7a36ac9-68, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc7a36ac9-68, col_values=(('external_ids', {'iface-id': 'c7a36ac9-68dc-462c-9e90-4eb844971548', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:b8:c2', 'vm-uuid': 'd79c2f2c-0870-4d8e-b468-36e63496b769'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:05 user nova-compute[73056]: INFO os_vif [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:b8:c2,bridge_name='br-int',has_traffic_filtering=True,id=c7a36ac9-68dc-462c-9e90-4eb844971548,network=Network(2c5f0d57-9485-4a0b-a847-49eea5cd17c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7a36ac9-68')
Aug 14 16:47:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b24bf6-b124-408e-88a7-b83b8472caf3]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c32d8b-a873-49e4-812a-f11f340afe67]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:47:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iThIoFVw {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iThIoFVw" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:06 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abd7637-19aa-4121-8fb8-96293b72c5ef]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:47:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iThIoFVw'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:47:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:06 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:47:06 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] No VIF found with MAC fa:16:3e:44:b8:c2, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:47:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:06 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[8293b886-9b1b-4e71-96ec-997b157c9ab8]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:47:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:47:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:06 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[22398a0d-1901-4267-82e3-3d78162457b4]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:47:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:47:06 user nova-compute[73056]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b (non-flash)
Aug 14 16:47:06 user nova-compute[73056]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:47:06 user nova-compute[73056]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:47:06 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:47:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:47:06 user nova-compute[73056]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b (non-flash)
Aug 14 16:47:06 user nova-compute[73056]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:47:06 user nova-compute[73056]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:47:06 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:47:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:06 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e43fd1-c1a7-4345-b24e-5dc3d627ab99]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:47:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0, portal: 172.16.0.220,3260]
Aug 14 16:47:06 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0, portal: 172.16.0.220,3260] successful.
Aug 14 16:47:06 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:47:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:06 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffab5b2c-5180-40e3-9245-86ae9235056f]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:47:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:47:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:06 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd30695c-09c8-4284-8d2e-a12a65911c49]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:47:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:47:06 user nova-compute[73056]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b (non-flash)
Aug 14 16:47:06 user nova-compute[73056]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:47:06 user nova-compute[73056]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:47:06 user nova-compute[73056]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)
Aug 14 16:47:06 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:47:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:47:06 user nova-compute[73056]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b (non-flash)
Aug 14 16:47:06 user nova-compute[73056]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:47:06 user nova-compute[73056]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:47:06 user nova-compute[73056]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)
Aug 14 16:47:06 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:47:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.363s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:47:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:47:06 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] HCTL ('37', '-', '-', 0) found on session 32 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:47:06 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:47:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:06 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b4e1b1-9ec3-45a5-822a-07ec3da20571]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:47:06 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:47:06 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iThIoFVw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:47:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-29e97298-ca72-4f82-83e9-44b70179e4e0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Acquiring lock "4731f355-9307-4176-910b-cf35beb85e75" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:47:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-29e97298-ca72-4f82-83e9-44b70179e4e0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lock "4731f355-9307-4176-910b-cf35beb85e75" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:47:06 user nova-compute[73056]: INFO nova.compute.manager [None req-29e97298-ca72-4f82-83e9-44b70179e4e0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Detaching volume 1ce20211-b727-4881-a8ee-7b3093d157fd
Aug 14 16:47:06 user nova-compute[73056]: INFO nova.virt.block_device [None req-29e97298-ca72-4f82-83e9-44b70179e4e0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Attempting to driver detach volume 1ce20211-b727-4881-a8ee-7b3093d157fd from mountpoint /dev/vdb
Aug 14 16:47:06 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-29e97298-ca72-4f82-83e9-44b70179e4e0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Attempting to detach device vdb from instance 4731f355-9307-4176-910b-cf35beb85e75 from the persistent domain config. {{(pid=73056) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 16:47:06 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-29e97298-ca72-4f82-83e9-44b70179e4e0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 16:47:06 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:47:06 user nova-compute[73056]:   <source dev="/dev/sdc"/>
Aug 14 16:47:06 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:47:06 user nova-compute[73056]:   <serial>1ce20211-b727-4881-a8ee-7b3093d157fd</serial>
Aug 14 16:47:06 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 16:47:06 user nova-compute[73056]: </disk>
Aug 14 16:47:06 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 16:47:06 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-29e97298-ca72-4f82-83e9-44b70179e4e0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Successfully detached device vdb from instance 4731f355-9307-4176-910b-cf35beb85e75 from the persistent domain config.
Aug 14 16:47:06 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-29e97298-ca72-4f82-83e9-44b70179e4e0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4731f355-9307-4176-910b-cf35beb85e75 from the live domain config. {{(pid=73056) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 16:47:06 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-29e97298-ca72-4f82-83e9-44b70179e4e0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 16:47:06 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:47:06 user nova-compute[73056]:   <source dev="/dev/sdc"/>
Aug 14 16:47:06 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:47:06 user nova-compute[73056]:   <serial>1ce20211-b727-4881-a8ee-7b3093d157fd</serial>
Aug 14 16:47:06 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 16:47:06 user nova-compute[73056]: </disk>
Aug 14 16:47:06 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] <== connect_volume: return (2824ms) {'type': 'block', 'scsi_wwn': '26362383832353464', 'path': '/dev/sdf'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362383832353464', 'path': '/dev/sdf'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:40:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1141868820',display_name='tempest-ServerActionsTestOtherB-server-1141868820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1141868820',id=16,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsc3Uaz7vmbmV86lMnvYNdRaSVfJcdYXdG4vY0wVNgR/VZPzr09+A51tF4EmKhmmLDKglhmcpoAJJc05z8zlcL3Fqhx5uVkS7BbyNbqt0mNNKT7ar0AXFL2PnABSrfDLg==',key_name='tempest-keypair-1532112814',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:45:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4af3a3df4b8641c1ac0d02df893b524d',ramdisk_id='',reservation_id='r-z7s601zt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1168667086',owner_user_name='tempest-ServerActionsTestOtherB-1168667086-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:46:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c39b09d624bb4977b6d1b396f425f737',uuid=9c11423c-88d3-4fae-8917-c0d57021d194,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "address": "fa:16:3e:e6:4c:64", "network": {"id": "db548415-fd97-4612-8699-d431cfe3c1ec", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-66082327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af3a3df4b8641c1ac0d02df893b524d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8491a73c-f3", "ovs_interfaceid": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Converting VIF {"id": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "address": "fa:16:3e:e6:4c:64", "network": {"id": "db548415-fd97-4612-8699-d431cfe3c1ec", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-66082327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af3a3df4b8641c1ac0d02df893b524d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8491a73c-f3", "ovs_interfaceid": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:4c:64,bridge_name='br-int',has_traffic_filtering=True,id=8491a73c-f38b-4cb4-ab87-d6e41992319d,network=Network(db548415-fd97-4612-8699-d431cfe3c1ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8491a73c-f3') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:47:07 user nova-compute[73056]:   <uuid>9c11423c-88d3-4fae-8917-c0d57021d194</uuid>
Aug 14 16:47:07 user nova-compute[73056]:   <name>instance-00000010</name>
Aug 14 16:47:07 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:47:07 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:47:07 user nova-compute[73056]:   <metadata>
Aug 14 16:47:07 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:47:07 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:47:07 user nova-compute[73056]:       <nova:name>tempest-ServerActionsTestOtherB-server-1141868820</nova:name>
Aug 14 16:47:07 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:47:04</nova:creationTime>
Aug 14 16:47:07 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:47:07 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:47:07 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:47:07 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:47:07 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:47:07 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:47:07 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:47:07 user nova-compute[73056]:       <nova:owner>
Aug 14 16:47:07 user nova-compute[73056]:         <nova:user uuid="c39b09d624bb4977b6d1b396f425f737">tempest-ServerActionsTestOtherB-1168667086-project-member</nova:user>
Aug 14 16:47:07 user nova-compute[73056]:         <nova:project uuid="4af3a3df4b8641c1ac0d02df893b524d">tempest-ServerActionsTestOtherB-1168667086</nova:project>
Aug 14 16:47:07 user nova-compute[73056]:       </nova:owner>
Aug 14 16:47:07 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:47:07 user nova-compute[73056]:       <nova:ports>
Aug 14 16:47:07 user nova-compute[73056]:         <nova:port uuid="8491a73c-f38b-4cb4-ab87-d6e41992319d">
Aug 14 16:47:07 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 16:47:07 user nova-compute[73056]:         </nova:port>
Aug 14 16:47:07 user nova-compute[73056]:       </nova:ports>
Aug 14 16:47:07 user nova-compute[73056]:     </nova:instance>
Aug 14 16:47:07 user nova-compute[73056]:   </metadata>
Aug 14 16:47:07 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:47:07 user nova-compute[73056]:     <system>
Aug 14 16:47:07 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:47:07 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:47:07 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:47:07 user nova-compute[73056]:       <entry name="serial">9c11423c-88d3-4fae-8917-c0d57021d194</entry>
Aug 14 16:47:07 user nova-compute[73056]:       <entry name="uuid">9c11423c-88d3-4fae-8917-c0d57021d194</entry>
Aug 14 16:47:07 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:47:07 user nova-compute[73056]:     </system>
Aug 14 16:47:07 user nova-compute[73056]:   </sysinfo>
Aug 14 16:47:07 user nova-compute[73056]:   <os>
Aug 14 16:47:07 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:47:07 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:47:07 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:47:07 user nova-compute[73056]:   </os>
Aug 14 16:47:07 user nova-compute[73056]:   <features>
Aug 14 16:47:07 user nova-compute[73056]:     <acpi/>
Aug 14 16:47:07 user nova-compute[73056]:     <apic/>
Aug 14 16:47:07 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:47:07 user nova-compute[73056]:   </features>
Aug 14 16:47:07 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:47:07 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:47:07 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:47:07 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:47:07 user nova-compute[73056]:   </clock>
Aug 14 16:47:07 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:47:07 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:47:07 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:47:07 user nova-compute[73056]:   </cpu>
Aug 14 16:47:07 user nova-compute[73056]:   <devices>
Aug 14 16:47:07 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:47:07 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:47:07 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk"/>
Aug 14 16:47:07 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:47:07 user nova-compute[73056]:     </disk>
Aug 14 16:47:07 user nova-compute[73056]:     <disk type="block" device="disk">
Aug 14 16:47:07 user nova-compute[73056]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:47:07 user nova-compute[73056]:       <source dev="/dev/sdf"/>
Aug 14 16:47:07 user nova-compute[73056]:       <target dev="vdb" bus="virtio"/>
Aug 14 16:47:07 user nova-compute[73056]:       <serial>37a09be2-92fa-4429-a416-13d78c74eda0</serial>
Aug 14 16:47:07 user nova-compute[73056]:     </disk>
Aug 14 16:47:07 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:47:07 user nova-compute[73056]:       <mac address="fa:16:3e:e6:4c:64"/>
Aug 14 16:47:07 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:47:07 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:47:07 user nova-compute[73056]:       <target dev="tap8491a73c-f3"/>
Aug 14 16:47:07 user nova-compute[73056]:     </interface>
Aug 14 16:47:07 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:47:07 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/console.log" append="off"/>
Aug 14 16:47:07 user nova-compute[73056]:     </serial>
Aug 14 16:47:07 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:47:07 user nova-compute[73056]:     <video>
Aug 14 16:47:07 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:47:07 user nova-compute[73056]:     </video>
Aug 14 16:47:07 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:47:07 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:47:07 user nova-compute[73056]:     </rng>
Aug 14 16:47:07 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:47:07 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:47:07 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:47:07 user nova-compute[73056]:     </memballoon>
Aug 14 16:47:07 user nova-compute[73056]:   </devices>
Aug 14 16:47:07 user nova-compute[73056]: </domain>
Aug 14 16:47:07 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:40:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1141868820',display_name='tempest-ServerActionsTestOtherB-server-1141868820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1141868820',id=16,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsc3Uaz7vmbmV86lMnvYNdRaSVfJcdYXdG4vY0wVNgR/VZPzr09+A51tF4EmKhmmLDKglhmcpoAJJc05z8zlcL3Fqhx5uVkS7BbyNbqt0mNNKT7ar0AXFL2PnABSrfDLg==',key_name='tempest-keypair-1532112814',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:45:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4af3a3df4b8641c1ac0d02df893b524d',ramdisk_id='',reservation_id='r-z7s601zt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1168667086',owner_user_name='tempest-ServerActionsTestOtherB-1168667086-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:46:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c39b09d624bb4977b6d1b396f425f737',uuid=9c11423c-88d3-4fae-8917-c0d57021d194,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "address": "fa:16:3e:e6:4c:64", "network": {"id": "db548415-fd97-4612-8699-d431cfe3c1ec", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-66082327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af3a3df4b8641c1ac0d02df893b524d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8491a73c-f3", "ovs_interfaceid": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Converting VIF {"id": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "address": "fa:16:3e:e6:4c:64", "network": {"id": "db548415-fd97-4612-8699-d431cfe3c1ec", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-66082327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af3a3df4b8641c1ac0d02df893b524d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8491a73c-f3", "ovs_interfaceid": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:4c:64,bridge_name='br-int',has_traffic_filtering=True,id=8491a73c-f38b-4cb4-ab87-d6e41992319d,network=Network(db548415-fd97-4612-8699-d431cfe3c1ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8491a73c-f3') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG os_vif [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:4c:64,bridge_name='br-int',has_traffic_filtering=True,id=8491a73c-f38b-4cb4-ab87-d6e41992319d,network=Network(db548415-fd97-4612-8699-d431cfe3c1ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8491a73c-f3') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8491a73c-f3, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8491a73c-f3, col_values=(('external_ids', {'iface-id': '8491a73c-f38b-4cb4-ab87-d6e41992319d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:4c:64', 'vm-uuid': '9c11423c-88d3-4fae-8917-c0d57021d194'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:07 user nova-compute[73056]: INFO os_vif [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:4c:64,bridge_name='br-int',has_traffic_filtering=True,id=8491a73c-f38b-4cb4-ab87-d6e41992319d,network=Network(db548415-fd97-4612-8699-d431cfe3c1ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8491a73c-f3')
Aug 14 16:47:07 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Received event <DeviceRemovedEvent: 1692031627.4071696, 4731f355-9307-4176-910b-cf35beb85e75 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73056) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-29e97298-ca72-4f82-83e9-44b70179e4e0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4731f355-9307-4176-910b-cf35beb85e75 {{(pid=73056) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 16:47:07 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-29e97298-ca72-4f82-83e9-44b70179e4e0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Successfully detached device vdb from instance 4731f355-9307-4176-910b-cf35beb85e75 from the live domain config.
Aug 14 16:47:07 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29e97298-ca72-4f82-83e9-44b70179e4e0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e97298-ca72-4f82-83e9-44b70179e4e0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NDUMQuKC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:47:07 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-29e97298-ca72-4f82-83e9-44b70179e4e0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:47:07 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-29e97298-ca72-4f82-83e9-44b70179e4e0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-29e97298-ca72-4f82-83e9-44b70179e4e0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e97298-ca72-4f82-83e9-44b70179e4e0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf0fb45-a314-4c9b-a9eb-1f25f454f623]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a481d4-bfbd-4ba3-a6e0-ec6c255a30a8]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e97298-ca72-4f82-83e9-44b70179e4e0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:47:07 user nova-compute[73056]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b (non-flash)
Aug 14 16:47:07 user nova-compute[73056]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:47:07 user nova-compute[73056]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:47:07 user nova-compute[73056]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)
Aug 14 16:47:07 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e97298-ca72-4f82-83e9-44b70179e4e0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd (non-flash)
Aug 14 16:47:07 user nova-compute[73056]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b (non-flash)
Aug 14 16:47:07 user nova-compute[73056]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:47:07 user nova-compute[73056]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:47:07 user nova-compute[73056]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)
Aug 14 16:47:07 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e97298-ca72-4f82-83e9-44b70179e4e0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3003428c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd'): ({'sdc'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-29e97298-ca72-4f82-83e9-44b70179e4e0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Removing single pathed devices sdc {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f5f1cd-d627-49f8-a53e-d1f9a04ea943]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbada98-7c97-431a-9fa6-e382bee801a4]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-29e97298-ca72-4f82-83e9-44b70179e4e0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Flushing IO for device /dev/sdc {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[41cd23a3-c03e-4899-864a-6a5821a9a29e]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-29e97298-ca72-4f82-83e9-44b70179e4e0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d199666d-b3c4-4513-86e2-93f083a0bfe1]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-29e97298-ca72-4f82-83e9-44b70179e4e0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-29e97298-ca72-4f82-83e9-44b70179e4e0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] SCSI volumes sdc have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e97298-ca72-4f82-83e9-44b70179e4e0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[77edbda1-e8a3-4fc3-8124-e43b9dbc94f1]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e97298-ca72-4f82-83e9-44b70179e4e0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d375ea3-ca12-4543-ac2a-da0c59b8aedc]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e97298-ca72-4f82-83e9-44b70179e4e0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd, portal: 172.16.0.220,3260]
Aug 14 16:47:07 user nova-compute[73056]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd, portal: 172.16.0.220,3260] successful.
Aug 14 16:47:07 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce20211-b727-4881-a8ee-7b3093d157fd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df71d8c-de2b-47e3-a32d-70a27b1466bf]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e97298-ca72-4f82-83e9-44b70179e4e0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-29e97298-ca72-4f82-83e9-44b70179e4e0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e97298-ca72-4f82-83e9-44b70179e4e0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] <== disconnect_volume: return (335ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29e97298-ca72-4f82-83e9-44b70179e4e0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:08 user nova-compute[73056]: DEBUG nova.compute.manager [req-c365b283-9083-4bb2-a734-b5816cfbb702 req-6881c1a0-4f2f-4a2c-9be3-15a6cc046964 service nova] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Received event network-vif-plugged-c7a36ac9-68dc-462c-9e90-4eb844971548 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:47:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c365b283-9083-4bb2-a734-b5816cfbb702 req-6881c1a0-4f2f-4a2c-9be3-15a6cc046964 service nova] Acquiring lock "d79c2f2c-0870-4d8e-b468-36e63496b769-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:47:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c365b283-9083-4bb2-a734-b5816cfbb702 req-6881c1a0-4f2f-4a2c-9be3-15a6cc046964 service nova] Lock "d79c2f2c-0870-4d8e-b468-36e63496b769-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:47:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c365b283-9083-4bb2-a734-b5816cfbb702 req-6881c1a0-4f2f-4a2c-9be3-15a6cc046964 service nova] Lock "d79c2f2c-0870-4d8e-b468-36e63496b769-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:47:08 user nova-compute[73056]: DEBUG nova.compute.manager [req-c365b283-9083-4bb2-a734-b5816cfbb702 req-6881c1a0-4f2f-4a2c-9be3-15a6cc046964 service nova] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] No waiting events found dispatching network-vif-plugged-c7a36ac9-68dc-462c-9e90-4eb844971548 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:47:08 user nova-compute[73056]: WARNING nova.compute.manager [req-c365b283-9083-4bb2-a734-b5816cfbb702 req-6881c1a0-4f2f-4a2c-9be3-15a6cc046964 service nova] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Received unexpected event network-vif-plugged-c7a36ac9-68dc-462c-9e90-4eb844971548 for instance with vm_state building and task_state spawning.
Aug 14 16:47:08 user nova-compute[73056]: DEBUG nova.objects.instance [None req-29e97298-ca72-4f82-83e9-44b70179e4e0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lazy-loading 'flavor' on Instance uuid 4731f355-9307-4176-910b-cf35beb85e75 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:47:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-29e97298-ca72-4f82-83e9-44b70179e4e0 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lock "4731f355-9307-4176-910b-cf35beb85e75" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.129s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:47:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:09 user nova-compute[73056]: DEBUG nova.compute.manager [req-72591adf-6dba-4a76-8426-5d02aeaa4817 req-b9d31acd-4ca0-4bcb-9983-bb70b6d959a3 service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Received event network-vif-plugged-8491a73c-f38b-4cb4-ab87-d6e41992319d {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:47:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-72591adf-6dba-4a76-8426-5d02aeaa4817 req-b9d31acd-4ca0-4bcb-9983-bb70b6d959a3 service nova] Acquiring lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:47:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-72591adf-6dba-4a76-8426-5d02aeaa4817 req-b9d31acd-4ca0-4bcb-9983-bb70b6d959a3 service nova] Lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:47:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-72591adf-6dba-4a76-8426-5d02aeaa4817 req-b9d31acd-4ca0-4bcb-9983-bb70b6d959a3 service nova] Lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:47:09 user nova-compute[73056]: DEBUG nova.compute.manager [req-72591adf-6dba-4a76-8426-5d02aeaa4817 req-b9d31acd-4ca0-4bcb-9983-bb70b6d959a3 service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] No waiting events found dispatching network-vif-plugged-8491a73c-f38b-4cb4-ab87-d6e41992319d {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:47:09 user nova-compute[73056]: WARNING nova.compute.manager [req-72591adf-6dba-4a76-8426-5d02aeaa4817 req-b9d31acd-4ca0-4bcb-9983-bb70b6d959a3 service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Received unexpected event network-vif-plugged-8491a73c-f38b-4cb4-ab87-d6e41992319d for instance with vm_state resized and task_state resize_reverting.
Aug 14 16:47:10 user nova-compute[73056]: DEBUG nova.compute.manager [req-bd69b3cb-dba5-479b-87d6-9e085c2133c4 req-08ce253e-5546-40d8-8cec-7f4fc3f8af7b service nova] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Received event network-vif-plugged-c7a36ac9-68dc-462c-9e90-4eb844971548 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:47:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-bd69b3cb-dba5-479b-87d6-9e085c2133c4 req-08ce253e-5546-40d8-8cec-7f4fc3f8af7b service nova] Acquiring lock "d79c2f2c-0870-4d8e-b468-36e63496b769-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:47:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-bd69b3cb-dba5-479b-87d6-9e085c2133c4 req-08ce253e-5546-40d8-8cec-7f4fc3f8af7b service nova] Lock "d79c2f2c-0870-4d8e-b468-36e63496b769-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:47:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-bd69b3cb-dba5-479b-87d6-9e085c2133c4 req-08ce253e-5546-40d8-8cec-7f4fc3f8af7b service nova] Lock "d79c2f2c-0870-4d8e-b468-36e63496b769-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:47:10 user nova-compute[73056]: DEBUG nova.compute.manager [req-bd69b3cb-dba5-479b-87d6-9e085c2133c4 req-08ce253e-5546-40d8-8cec-7f4fc3f8af7b service nova] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] No waiting events found dispatching network-vif-plugged-c7a36ac9-68dc-462c-9e90-4eb844971548 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:47:10 user nova-compute[73056]: WARNING nova.compute.manager [req-bd69b3cb-dba5-479b-87d6-9e085c2133c4 req-08ce253e-5546-40d8-8cec-7f4fc3f8af7b service nova] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Received unexpected event network-vif-plugged-c7a36ac9-68dc-462c-9e90-4eb844971548 for instance with vm_state building and task_state spawning.
Aug 14 16:47:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:11 user nova-compute[73056]: DEBUG nova.compute.manager [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:47:11 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:47:11 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031631.3534102, d79c2f2c-0870-4d8e-b468-36e63496b769 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:47:11 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] VM Resumed (Lifecycle Event)
Aug 14 16:47:11 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Instance spawned successfully.
Aug 14 16:47:11 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:47:11 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:47:11 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:47:11 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:47:11 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:47:11 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:47:11 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:47:11 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:47:11 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:47:11 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:47:11 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031631.3628478, d79c2f2c-0870-4d8e-b468-36e63496b769 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:47:11 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] VM Started (Lifecycle Event)
Aug 14 16:47:11 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:47:11 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:47:11 user nova-compute[73056]: INFO nova.compute.manager [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Took 7.20 seconds to spawn the instance on the hypervisor.
Aug 14 16:47:11 user nova-compute[73056]: DEBUG nova.compute.manager [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:47:11 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:47:11 user nova-compute[73056]: INFO nova.compute.manager [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Took 19.13 seconds to build instance.
Aug 14 16:47:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a7a3a0f3-43f7-4364-83b5-b7528523cf8b tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "d79c2f2c-0870-4d8e-b468-36e63496b769" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.288s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:47:12 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031632.0374646, 9c11423c-88d3-4fae-8917-c0d57021d194 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:47:12 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] VM Resumed (Lifecycle Event)
Aug 14 16:47:12 user nova-compute[73056]: DEBUG nova.compute.manager [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:47:12 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Instance running successfully.
Aug 14 16:47:12 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] finish_revert_migration finished successfully. {{(pid=73056) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 14 16:47:12 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:47:12 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:47:12 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 14 16:47:12 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031632.0417402, 9c11423c-88d3-4fae-8917-c0d57021d194 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:47:12 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] VM Started (Lifecycle Event)
Aug 14 16:47:12 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:47:12 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:47:12 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 14 16:47:12 user nova-compute[73056]: INFO nova.compute.manager [None req-33d39d3a-c03a-49d5-8629-162862cea8dd tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Updating instance to original state: 'active'
Aug 14 16:47:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:12 user nova-compute[73056]: DEBUG nova.compute.manager [req-64f080d7-8f91-4d77-a70d-d1528b5992d0 req-60b12a8b-d654-4430-a54e-5b754c26f34e service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Received event network-vif-plugged-8491a73c-f38b-4cb4-ab87-d6e41992319d {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:47:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-64f080d7-8f91-4d77-a70d-d1528b5992d0 req-60b12a8b-d654-4430-a54e-5b754c26f34e service nova] Acquiring lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:47:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-64f080d7-8f91-4d77-a70d-d1528b5992d0 req-60b12a8b-d654-4430-a54e-5b754c26f34e service nova] Lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:47:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-64f080d7-8f91-4d77-a70d-d1528b5992d0 req-60b12a8b-d654-4430-a54e-5b754c26f34e service nova] Lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:47:12 user nova-compute[73056]: DEBUG nova.compute.manager [req-64f080d7-8f91-4d77-a70d-d1528b5992d0 req-60b12a8b-d654-4430-a54e-5b754c26f34e service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] No waiting events found dispatching network-vif-plugged-8491a73c-f38b-4cb4-ab87-d6e41992319d {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:47:12 user nova-compute[73056]: WARNING nova.compute.manager [req-64f080d7-8f91-4d77-a70d-d1528b5992d0 req-60b12a8b-d654-4430-a54e-5b754c26f34e service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Received unexpected event network-vif-plugged-8491a73c-f38b-4cb4-ab87-d6e41992319d for instance with vm_state active and task_state None.
Aug 14 16:47:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:14 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692031619.4114757, 1feea14e-10f2-4282-8137-2a5a289eda41 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:47:14 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] VM Stopped (Lifecycle Event)
Aug 14 16:47:14 user nova-compute[73056]: DEBUG nova.compute.manager [None req-77e4b22c-f34e-4a9b-a0ba-bfc240f4cefe None None] [instance: 1feea14e-10f2-4282-8137-2a5a289eda41] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:47:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:22 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:22 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-975e5e84-95f3-4033-a532-475413521f9e tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "b3270811-8241-47a6-aa36-0ec3feddf0fc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:47:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-975e5e84-95f3-4033-a532-475413521f9e tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "b3270811-8241-47a6-aa36-0ec3feddf0fc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:47:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-975e5e84-95f3-4033-a532-475413521f9e tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "b3270811-8241-47a6-aa36-0ec3feddf0fc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:47:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-975e5e84-95f3-4033-a532-475413521f9e tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "b3270811-8241-47a6-aa36-0ec3feddf0fc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:47:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-975e5e84-95f3-4033-a532-475413521f9e tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "b3270811-8241-47a6-aa36-0ec3feddf0fc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:47:29 user nova-compute[73056]: INFO nova.compute.manager [None req-975e5e84-95f3-4033-a532-475413521f9e tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Terminating instance
Aug 14 16:47:29 user nova-compute[73056]: DEBUG nova.compute.manager [None req-975e5e84-95f3-4033-a532-475413521f9e tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 16:47:29 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:29 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:29 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:29 user nova-compute[73056]: DEBUG nova.compute.manager [req-fd6833a7-a743-4f33-8be7-dd4e6ad67498 req-16f5e870-ca9c-4c3f-8695-e2b444986509 service nova] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Received event network-vif-unplugged-3bbc228a-d2bb-4b9f-a6d0-66b15010acdb {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:47:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-fd6833a7-a743-4f33-8be7-dd4e6ad67498 req-16f5e870-ca9c-4c3f-8695-e2b444986509 service nova] Acquiring lock "b3270811-8241-47a6-aa36-0ec3feddf0fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:47:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-fd6833a7-a743-4f33-8be7-dd4e6ad67498 req-16f5e870-ca9c-4c3f-8695-e2b444986509 service nova] Lock "b3270811-8241-47a6-aa36-0ec3feddf0fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:47:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-fd6833a7-a743-4f33-8be7-dd4e6ad67498 req-16f5e870-ca9c-4c3f-8695-e2b444986509 service nova] Lock "b3270811-8241-47a6-aa36-0ec3feddf0fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:47:29 user nova-compute[73056]: DEBUG nova.compute.manager [req-fd6833a7-a743-4f33-8be7-dd4e6ad67498 req-16f5e870-ca9c-4c3f-8695-e2b444986509 service nova] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] No waiting events found dispatching network-vif-unplugged-3bbc228a-d2bb-4b9f-a6d0-66b15010acdb {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:47:29 user nova-compute[73056]: DEBUG nova.compute.manager [req-fd6833a7-a743-4f33-8be7-dd4e6ad67498 req-16f5e870-ca9c-4c3f-8695-e2b444986509 service nova] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Received event network-vif-unplugged-3bbc228a-d2bb-4b9f-a6d0-66b15010acdb for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:47:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:30 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Instance destroyed successfully.
Aug 14 16:47:30 user nova-compute[73056]: DEBUG nova.objects.instance [None req-975e5e84-95f3-4033-a532-475413521f9e tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lazy-loading 'resources' on Instance uuid b3270811-8241-47a6-aa36-0ec3feddf0fc {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:47:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-975e5e84-95f3-4033-a532-475413521f9e tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:41:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-658979013',display_name='tempest-AttachVolumeNegativeTest-server-658979013',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-658979013',id=17,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgdKMXht7wKvUNqmuBaOUIIPCU/B/W9DuOqZntyGUMjOOjAEC3lEtom6fFaKfcSgzIbTodlH06RcAQKa+gRy66ZoQbyf11gwxlOR8cvibjUIEHsqGlSc8GrypseqH8nIA==',key_name='tempest-keypair-1175775660',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:41:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d5a8e599b3141339ed0ae6729031b36',ramdisk_id='',reservation_id='r-wz555gou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-860464885',owner_user_name='tempest-AttachVolumeNegativeTest-860464885-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:41:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dad45adee1047bda7350d8a3f8a2f54',uuid=b3270811-8241-47a6-aa36-0ec3feddf0fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3bbc228a-d2bb-4b9f-a6d0-66b15010acdb", "address": "fa:16:3e:59:b3:5d", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bbc228a-d2", "ovs_interfaceid": "3bbc228a-d2bb-4b9f-a6d0-66b15010acdb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:47:30 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-975e5e84-95f3-4033-a532-475413521f9e tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Converting VIF {"id": "3bbc228a-d2bb-4b9f-a6d0-66b15010acdb", "address": "fa:16:3e:59:b3:5d", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bbc228a-d2", "ovs_interfaceid": "3bbc228a-d2bb-4b9f-a6d0-66b15010acdb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:47:30 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-975e5e84-95f3-4033-a532-475413521f9e tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:b3:5d,bridge_name='br-int',has_traffic_filtering=True,id=3bbc228a-d2bb-4b9f-a6d0-66b15010acdb,network=Network(ad323a8d-7318-46f5-8af4-cbc61ae589b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bbc228a-d2') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:47:30 user nova-compute[73056]: DEBUG os_vif [None req-975e5e84-95f3-4033-a532-475413521f9e tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:b3:5d,bridge_name='br-int',has_traffic_filtering=True,id=3bbc228a-d2bb-4b9f-a6d0-66b15010acdb,network=Network(ad323a8d-7318-46f5-8af4-cbc61ae589b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bbc228a-d2') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:47:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3bbc228a-d2, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:47:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:30 user nova-compute[73056]: INFO os_vif [None req-975e5e84-95f3-4033-a532-475413521f9e tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:b3:5d,bridge_name='br-int',has_traffic_filtering=True,id=3bbc228a-d2bb-4b9f-a6d0-66b15010acdb,network=Network(ad323a8d-7318-46f5-8af4-cbc61ae589b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bbc228a-d2')
Aug 14 16:47:30 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-975e5e84-95f3-4033-a532-475413521f9e tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Deleting instance files /opt/stack/data/nova/instances/b3270811-8241-47a6-aa36-0ec3feddf0fc_del
Aug 14 16:47:30 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-975e5e84-95f3-4033-a532-475413521f9e tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Deletion of /opt/stack/data/nova/instances/b3270811-8241-47a6-aa36-0ec3feddf0fc_del complete
Aug 14 16:47:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:30 user nova-compute[73056]: INFO nova.compute.manager [None req-975e5e84-95f3-4033-a532-475413521f9e tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Took 1.25 seconds to destroy the instance on the hypervisor.
Aug 14 16:47:30 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-975e5e84-95f3-4033-a532-475413521f9e tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 16:47:30 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 16:47:30 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 16:47:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:31 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:47:31 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Took 0.98 seconds to deallocate network for instance.
Aug 14 16:47:31 user nova-compute[73056]: DEBUG nova.compute.manager [req-5d53945a-6ff5-4f19-a94f-2c520f8fad38 req-c1c667fa-0552-4031-b000-dc06f684d577 service nova] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Received event network-vif-deleted-3bbc228a-d2bb-4b9f-a6d0-66b15010acdb {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:47:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-975e5e84-95f3-4033-a532-475413521f9e tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:47:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-975e5e84-95f3-4033-a532-475413521f9e tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:47:31 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-975e5e84-95f3-4033-a532-475413521f9e tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Refreshing inventories for resource provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 16:47:31 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-975e5e84-95f3-4033-a532-475413521f9e tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Updating ProviderTree inventory for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 16:47:31 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-975e5e84-95f3-4033-a532-475413521f9e tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Updating inventory in ProviderTree for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 16:47:31 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-975e5e84-95f3-4033-a532-475413521f9e tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Refreshing aggregate associations for resource provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b, aggregates: None {{(pid=73056) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 16:47:31 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-975e5e84-95f3-4033-a532-475413521f9e tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Refreshing trait associations for resource provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=73056) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 16:47:31 user nova-compute[73056]: DEBUG nova.compute.manager [req-9b3936e1-34b6-400b-ac67-031460c65c88 req-a24f6706-306f-4cc3-b068-d32cc4454993 service nova] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Received event network-vif-plugged-3bbc228a-d2bb-4b9f-a6d0-66b15010acdb {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:47:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9b3936e1-34b6-400b-ac67-031460c65c88 req-a24f6706-306f-4cc3-b068-d32cc4454993 service nova] Acquiring lock "b3270811-8241-47a6-aa36-0ec3feddf0fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:47:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9b3936e1-34b6-400b-ac67-031460c65c88 req-a24f6706-306f-4cc3-b068-d32cc4454993 service nova] Lock "b3270811-8241-47a6-aa36-0ec3feddf0fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:47:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9b3936e1-34b6-400b-ac67-031460c65c88 req-a24f6706-306f-4cc3-b068-d32cc4454993 service nova] Lock "b3270811-8241-47a6-aa36-0ec3feddf0fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:47:31 user nova-compute[73056]: DEBUG nova.compute.manager [req-9b3936e1-34b6-400b-ac67-031460c65c88 req-a24f6706-306f-4cc3-b068-d32cc4454993 service nova] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] No waiting events found dispatching network-vif-plugged-3bbc228a-d2bb-4b9f-a6d0-66b15010acdb {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:47:31 user nova-compute[73056]: WARNING nova.compute.manager [req-9b3936e1-34b6-400b-ac67-031460c65c88 req-a24f6706-306f-4cc3-b068-d32cc4454993 service nova] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Received unexpected event network-vif-plugged-3bbc228a-d2bb-4b9f-a6d0-66b15010acdb for instance with vm_state deleted and task_state None.
Aug 14 16:47:31 user nova-compute[73056]: DEBUG nova.compute.manager [req-9b3936e1-34b6-400b-ac67-031460c65c88 req-a24f6706-306f-4cc3-b068-d32cc4454993 service nova] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Received event network-vif-plugged-3bbc228a-d2bb-4b9f-a6d0-66b15010acdb {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:47:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9b3936e1-34b6-400b-ac67-031460c65c88 req-a24f6706-306f-4cc3-b068-d32cc4454993 service nova] Acquiring lock "b3270811-8241-47a6-aa36-0ec3feddf0fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:47:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9b3936e1-34b6-400b-ac67-031460c65c88 req-a24f6706-306f-4cc3-b068-d32cc4454993 service nova] Lock "b3270811-8241-47a6-aa36-0ec3feddf0fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:47:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9b3936e1-34b6-400b-ac67-031460c65c88 req-a24f6706-306f-4cc3-b068-d32cc4454993 service nova] Lock "b3270811-8241-47a6-aa36-0ec3feddf0fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:47:31 user nova-compute[73056]: DEBUG nova.compute.manager [req-9b3936e1-34b6-400b-ac67-031460c65c88 req-a24f6706-306f-4cc3-b068-d32cc4454993 service nova] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] No waiting events found dispatching network-vif-plugged-3bbc228a-d2bb-4b9f-a6d0-66b15010acdb {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:47:31 user nova-compute[73056]: WARNING nova.compute.manager [req-9b3936e1-34b6-400b-ac67-031460c65c88 req-a24f6706-306f-4cc3-b068-d32cc4454993 service nova] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Received unexpected event network-vif-plugged-3bbc228a-d2bb-4b9f-a6d0-66b15010acdb for instance with vm_state deleted and task_state None.
Aug 14 16:47:31 user nova-compute[73056]: DEBUG nova.compute.manager [req-9b3936e1-34b6-400b-ac67-031460c65c88 req-a24f6706-306f-4cc3-b068-d32cc4454993 service nova] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Received event network-vif-plugged-3bbc228a-d2bb-4b9f-a6d0-66b15010acdb {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:47:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9b3936e1-34b6-400b-ac67-031460c65c88 req-a24f6706-306f-4cc3-b068-d32cc4454993 service nova] Acquiring lock "b3270811-8241-47a6-aa36-0ec3feddf0fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:47:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9b3936e1-34b6-400b-ac67-031460c65c88 req-a24f6706-306f-4cc3-b068-d32cc4454993 service nova] Lock "b3270811-8241-47a6-aa36-0ec3feddf0fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:47:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9b3936e1-34b6-400b-ac67-031460c65c88 req-a24f6706-306f-4cc3-b068-d32cc4454993 service nova] Lock "b3270811-8241-47a6-aa36-0ec3feddf0fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:47:31 user nova-compute[73056]: DEBUG nova.compute.manager [req-9b3936e1-34b6-400b-ac67-031460c65c88 req-a24f6706-306f-4cc3-b068-d32cc4454993 service nova] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] No waiting events found dispatching network-vif-plugged-3bbc228a-d2bb-4b9f-a6d0-66b15010acdb {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:47:31 user nova-compute[73056]: WARNING nova.compute.manager [req-9b3936e1-34b6-400b-ac67-031460c65c88 req-a24f6706-306f-4cc3-b068-d32cc4454993 service nova] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Received unexpected event network-vif-plugged-3bbc228a-d2bb-4b9f-a6d0-66b15010acdb for instance with vm_state deleted and task_state None.
Aug 14 16:47:31 user nova-compute[73056]: DEBUG nova.compute.manager [req-9b3936e1-34b6-400b-ac67-031460c65c88 req-a24f6706-306f-4cc3-b068-d32cc4454993 service nova] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Received event network-vif-unplugged-3bbc228a-d2bb-4b9f-a6d0-66b15010acdb {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:47:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9b3936e1-34b6-400b-ac67-031460c65c88 req-a24f6706-306f-4cc3-b068-d32cc4454993 service nova] Acquiring lock "b3270811-8241-47a6-aa36-0ec3feddf0fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:47:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9b3936e1-34b6-400b-ac67-031460c65c88 req-a24f6706-306f-4cc3-b068-d32cc4454993 service nova] Lock "b3270811-8241-47a6-aa36-0ec3feddf0fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:47:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9b3936e1-34b6-400b-ac67-031460c65c88 req-a24f6706-306f-4cc3-b068-d32cc4454993 service nova] Lock "b3270811-8241-47a6-aa36-0ec3feddf0fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:47:31 user nova-compute[73056]: DEBUG nova.compute.manager [req-9b3936e1-34b6-400b-ac67-031460c65c88 req-a24f6706-306f-4cc3-b068-d32cc4454993 service nova] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] No waiting events found dispatching network-vif-unplugged-3bbc228a-d2bb-4b9f-a6d0-66b15010acdb {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:47:31 user nova-compute[73056]: WARNING nova.compute.manager [req-9b3936e1-34b6-400b-ac67-031460c65c88 req-a24f6706-306f-4cc3-b068-d32cc4454993 service nova] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Received unexpected event network-vif-unplugged-3bbc228a-d2bb-4b9f-a6d0-66b15010acdb for instance with vm_state deleted and task_state None.
Aug 14 16:47:31 user nova-compute[73056]: DEBUG nova.compute.manager [req-9b3936e1-34b6-400b-ac67-031460c65c88 req-a24f6706-306f-4cc3-b068-d32cc4454993 service nova] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Received event network-vif-plugged-3bbc228a-d2bb-4b9f-a6d0-66b15010acdb {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:47:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9b3936e1-34b6-400b-ac67-031460c65c88 req-a24f6706-306f-4cc3-b068-d32cc4454993 service nova] Acquiring lock "b3270811-8241-47a6-aa36-0ec3feddf0fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:47:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9b3936e1-34b6-400b-ac67-031460c65c88 req-a24f6706-306f-4cc3-b068-d32cc4454993 service nova] Lock "b3270811-8241-47a6-aa36-0ec3feddf0fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:47:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9b3936e1-34b6-400b-ac67-031460c65c88 req-a24f6706-306f-4cc3-b068-d32cc4454993 service nova] Lock "b3270811-8241-47a6-aa36-0ec3feddf0fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:47:31 user nova-compute[73056]: DEBUG nova.compute.manager [req-9b3936e1-34b6-400b-ac67-031460c65c88 req-a24f6706-306f-4cc3-b068-d32cc4454993 service nova] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] No waiting events found dispatching network-vif-plugged-3bbc228a-d2bb-4b9f-a6d0-66b15010acdb {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:47:31 user nova-compute[73056]: WARNING nova.compute.manager [req-9b3936e1-34b6-400b-ac67-031460c65c88 req-a24f6706-306f-4cc3-b068-d32cc4454993 service nova] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Received unexpected event network-vif-plugged-3bbc228a-d2bb-4b9f-a6d0-66b15010acdb for instance with vm_state deleted and task_state None.
Aug 14 16:47:31 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-975e5e84-95f3-4033-a532-475413521f9e tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:47:31 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-975e5e84-95f3-4033-a532-475413521f9e tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:47:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-975e5e84-95f3-4033-a532-475413521f9e tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.420s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:47:32 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-975e5e84-95f3-4033-a532-475413521f9e tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Deleted allocations for instance b3270811-8241-47a6-aa36-0ec3feddf0fc
Aug 14 16:47:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-975e5e84-95f3-4033-a532-475413521f9e tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "b3270811-8241-47a6-aa36-0ec3feddf0fc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.838s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:47:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:37 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:39 user nova-compute[73056]: DEBUG nova.compute.manager [req-90f6cd1b-8fc1-4909-b0cf-723c4b27d759 req-28d402f7-3e25-4d09-af27-4316a48b8508 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Received event network-changed-4d2af65d-3317-4411-a99d-13f81c27cc4c {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:47:39 user nova-compute[73056]: DEBUG nova.compute.manager [req-90f6cd1b-8fc1-4909-b0cf-723c4b27d759 req-28d402f7-3e25-4d09-af27-4316a48b8508 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Refreshing instance network info cache due to event network-changed-4d2af65d-3317-4411-a99d-13f81c27cc4c. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:47:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-90f6cd1b-8fc1-4909-b0cf-723c4b27d759 req-28d402f7-3e25-4d09-af27-4316a48b8508 service nova] Acquiring lock "refresh_cache-d5dbfa63-5061-4304-b8eb-4565ad9f0a96" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:47:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-90f6cd1b-8fc1-4909-b0cf-723c4b27d759 req-28d402f7-3e25-4d09-af27-4316a48b8508 service nova] Acquired lock "refresh_cache-d5dbfa63-5061-4304-b8eb-4565ad9f0a96" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:47:39 user nova-compute[73056]: DEBUG nova.network.neutron [req-90f6cd1b-8fc1-4909-b0cf-723c4b27d759 req-28d402f7-3e25-4d09-af27-4316a48b8508 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Refreshing network info cache for port 4d2af65d-3317-4411-a99d-13f81c27cc4c {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:47:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:40 user nova-compute[73056]: DEBUG nova.network.neutron [req-90f6cd1b-8fc1-4909-b0cf-723c4b27d759 req-28d402f7-3e25-4d09-af27-4316a48b8508 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Updated VIF entry in instance network info cache for port 4d2af65d-3317-4411-a99d-13f81c27cc4c. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:47:40 user nova-compute[73056]: DEBUG nova.network.neutron [req-90f6cd1b-8fc1-4909-b0cf-723c4b27d759 req-28d402f7-3e25-4d09-af27-4316a48b8508 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Updating instance_info_cache with network_info: [{"id": "4d2af65d-3317-4411-a99d-13f81c27cc4c", "address": "fa:16:3e:fa:9c:91", "network": {"id": "dd844e8d-9264-4868-819d-0b01ad3b1d41", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-568480417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e6131531ab4553b55ea090d5e7f47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2af65d-33", "ovs_interfaceid": "4d2af65d-3317-4411-a99d-13f81c27cc4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:47:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-90f6cd1b-8fc1-4909-b0cf-723c4b27d759 req-28d402f7-3e25-4d09-af27-4316a48b8508 service nova] Releasing lock "refresh_cache-d5dbfa63-5061-4304-b8eb-4565ad9f0a96" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:47:41 user nova-compute[73056]: DEBUG nova.compute.manager [req-e8d5ce2c-0501-4980-a648-05ed34db3a6f req-c5eba6bb-141b-4f8a-8f4d-f96f5c282567 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Received event network-changed-4d2af65d-3317-4411-a99d-13f81c27cc4c {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:47:41 user nova-compute[73056]: DEBUG nova.compute.manager [req-e8d5ce2c-0501-4980-a648-05ed34db3a6f req-c5eba6bb-141b-4f8a-8f4d-f96f5c282567 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Refreshing instance network info cache due to event network-changed-4d2af65d-3317-4411-a99d-13f81c27cc4c. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:47:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e8d5ce2c-0501-4980-a648-05ed34db3a6f req-c5eba6bb-141b-4f8a-8f4d-f96f5c282567 service nova] Acquiring lock "refresh_cache-d5dbfa63-5061-4304-b8eb-4565ad9f0a96" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:47:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e8d5ce2c-0501-4980-a648-05ed34db3a6f req-c5eba6bb-141b-4f8a-8f4d-f96f5c282567 service nova] Acquired lock "refresh_cache-d5dbfa63-5061-4304-b8eb-4565ad9f0a96" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:47:41 user nova-compute[73056]: DEBUG nova.network.neutron [req-e8d5ce2c-0501-4980-a648-05ed34db3a6f req-c5eba6bb-141b-4f8a-8f4d-f96f5c282567 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Refreshing network info cache for port 4d2af65d-3317-4411-a99d-13f81c27cc4c {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:47:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:41 user nova-compute[73056]: DEBUG nova.network.neutron [req-e8d5ce2c-0501-4980-a648-05ed34db3a6f req-c5eba6bb-141b-4f8a-8f4d-f96f5c282567 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Updated VIF entry in instance network info cache for port 4d2af65d-3317-4411-a99d-13f81c27cc4c. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:47:41 user nova-compute[73056]: DEBUG nova.network.neutron [req-e8d5ce2c-0501-4980-a648-05ed34db3a6f req-c5eba6bb-141b-4f8a-8f4d-f96f5c282567 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Updating instance_info_cache with network_info: [{"id": "4d2af65d-3317-4411-a99d-13f81c27cc4c", "address": "fa:16:3e:fa:9c:91", "network": {"id": "dd844e8d-9264-4868-819d-0b01ad3b1d41", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-568480417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e6131531ab4553b55ea090d5e7f47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2af65d-33", "ovs_interfaceid": "4d2af65d-3317-4411-a99d-13f81c27cc4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:47:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e8d5ce2c-0501-4980-a648-05ed34db3a6f req-c5eba6bb-141b-4f8a-8f4d-f96f5c282567 service nova] Releasing lock "refresh_cache-d5dbfa63-5061-4304-b8eb-4565ad9f0a96" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:47:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-95b9b963-6f96-44ed-9025-eaae86352350 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquiring lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:47:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-95b9b963-6f96-44ed-9025-eaae86352350 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:47:41 user nova-compute[73056]: INFO nova.compute.manager [None req-95b9b963-6f96-44ed-9025-eaae86352350 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Detaching volume 16760dbc-9409-492f-92cc-8d38004d5b3b
Aug 14 16:47:41 user nova-compute[73056]: INFO nova.virt.block_device [None req-95b9b963-6f96-44ed-9025-eaae86352350 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Attempting to driver detach volume 16760dbc-9409-492f-92cc-8d38004d5b3b from mountpoint /dev/vdb
Aug 14 16:47:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-95b9b963-6f96-44ed-9025-eaae86352350 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Attempting to detach device vdb from instance d5dbfa63-5061-4304-b8eb-4565ad9f0a96 from the persistent domain config. {{(pid=73056) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 16:47:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-95b9b963-6f96-44ed-9025-eaae86352350 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 16:47:41 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:47:41 user nova-compute[73056]:   <source dev="/dev/sdb"/>
Aug 14 16:47:41 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:47:41 user nova-compute[73056]:   <serial>16760dbc-9409-492f-92cc-8d38004d5b3b</serial>
Aug 14 16:47:41 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 16:47:41 user nova-compute[73056]: </disk>
Aug 14 16:47:41 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 16:47:41 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-95b9b963-6f96-44ed-9025-eaae86352350 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Successfully detached device vdb from instance d5dbfa63-5061-4304-b8eb-4565ad9f0a96 from the persistent domain config.
Aug 14 16:47:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-95b9b963-6f96-44ed-9025-eaae86352350 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d5dbfa63-5061-4304-b8eb-4565ad9f0a96 from the live domain config. {{(pid=73056) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 16:47:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-95b9b963-6f96-44ed-9025-eaae86352350 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 16:47:41 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:47:41 user nova-compute[73056]:   <source dev="/dev/sdb"/>
Aug 14 16:47:41 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:47:41 user nova-compute[73056]:   <serial>16760dbc-9409-492f-92cc-8d38004d5b3b</serial>
Aug 14 16:47:41 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 16:47:41 user nova-compute[73056]: </disk>
Aug 14 16:47:41 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Received event <DeviceRemovedEvent: 1692031662.098185, d5dbfa63-5061-4304-b8eb-4565ad9f0a96 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73056) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-95b9b963-6f96-44ed-9025-eaae86352350 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d5dbfa63-5061-4304-b8eb-4565ad9f0a96 {{(pid=73056) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 16:47:42 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-95b9b963-6f96-44ed-9025-eaae86352350 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Successfully detached device vdb from instance d5dbfa63-5061-4304-b8eb-4565ad9f0a96 from the live domain config.
Aug 14 16:47:42 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95b9b963-6f96-44ed-9025-eaae86352350 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b9b963-6f96-44ed-9025-eaae86352350 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mnlJqCAo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:47:42 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-95b9b963-6f96-44ed-9025-eaae86352350 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:47:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-95b9b963-6f96-44ed-9025-eaae86352350 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-95b9b963-6f96-44ed-9025-eaae86352350 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b9b963-6f96-44ed-9025-eaae86352350 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b473326-ea2a-4157-8723-d3f4ddd1460f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfc30e3-f56a-46d5-9787-eae382b0893e]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b9b963-6f96-44ed-9025-eaae86352350 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b (non-flash)
Aug 14 16:47:42 user nova-compute[73056]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:47:42 user nova-compute[73056]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:47:42 user nova-compute[73056]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)
Aug 14 16:47:42 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b9b963-6f96-44ed-9025-eaae86352350 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b (non-flash)
Aug 14 16:47:42 user nova-compute[73056]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:47:42 user nova-compute[73056]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:47:42 user nova-compute[73056]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)
Aug 14 16:47:42 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b9b963-6f96-44ed-9025-eaae86352350 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff2dce46710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b'): ({'sdb'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-95b9b963-6f96-44ed-9025-eaae86352350 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Removing single pathed devices sdb {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5548a3fe-64e7-4b1b-9269-90fb4cb2fcde]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ada84a-2a52-45e7-abaa-fd8f875ac57b]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-95b9b963-6f96-44ed-9025-eaae86352350 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Flushing IO for device /dev/sdb {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2424006b-537a-4788-93a6-3d8022dc6cbf]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-95b9b963-6f96-44ed-9025-eaae86352350 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.094s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[89eab2bb-e0d3-4b24-ba3b-3ffc107d2222]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-95b9b963-6f96-44ed-9025-eaae86352350 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-95b9b963-6f96-44ed-9025-eaae86352350 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] SCSI volumes sdb have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b9b963-6f96-44ed-9025-eaae86352350 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac69890-7ed1-45ab-8b0f-40eaa6541ae8]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b9b963-6f96-44ed-9025-eaae86352350 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[22effc46-3749-451f-a3ca-5020282eb879]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b9b963-6f96-44ed-9025-eaae86352350 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b, portal: 172.16.0.220,3260]
Aug 14 16:47:42 user nova-compute[73056]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b, portal: 172.16.0.220,3260] successful.
Aug 14 16:47:42 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16760dbc-9409-492f-92cc-8d38004d5b3b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d55d2f7-be5c-4abd-937e-02593bb8d30b]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b9b963-6f96-44ed-9025-eaae86352350 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-95b9b963-6f96-44ed-9025-eaae86352350 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b9b963-6f96-44ed-9025-eaae86352350 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] <== disconnect_volume: return (352ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95b9b963-6f96-44ed-9025-eaae86352350 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:47:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:43 user nova-compute[73056]: DEBUG nova.objects.instance [None req-95b9b963-6f96-44ed-9025-eaae86352350 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lazy-loading 'flavor' on Instance uuid d5dbfa63-5061-4304-b8eb-4565ad9f0a96 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:47:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-95b9b963-6f96-44ed-9025-eaae86352350 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.766s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:47:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:45 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692031650.1236014, b3270811-8241-47a6-aa36-0ec3feddf0fc => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:47:45 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] VM Stopped (Lifecycle Event)
Aug 14 16:47:45 user nova-compute[73056]: DEBUG nova.compute.manager [None req-850192d4-700d-44ea-a515-79f7f0a95f03 None None] [instance: b3270811-8241-47a6-aa36-0ec3feddf0fc] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:47:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Acquiring lock "61357ac0-230f-4711-8954-0bb04bfcb2f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:47:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "61357ac0-230f-4711-8954-0bb04bfcb2f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:47:53 user nova-compute[73056]: DEBUG nova.compute.manager [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:47:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:47:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:47:53 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:47:53 user nova-compute[73056]: INFO nova.compute.claims [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Claim successful on node user
Aug 14 16:47:53 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:47:53 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:47:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.602s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:47:53 user nova-compute[73056]: DEBUG nova.compute.manager [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:47:53 user nova-compute[73056]: DEBUG nova.compute.manager [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:47:53 user nova-compute[73056]: DEBUG nova.network.neutron [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:47:53 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:47:53 user nova-compute[73056]: DEBUG nova.compute.manager [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:47:53 user nova-compute[73056]: DEBUG nova.policy [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '18edcf10dda041c8a2bde2fb231b4fde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d796c14bd3489883e161ea1b311ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:47:53 user nova-compute[73056]: DEBUG nova.compute.manager [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:47:53 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:47:53 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Creating image(s)
Aug 14 16:47:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Acquiring lock "/opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:47:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "/opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:47:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "/opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:47:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.193s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Acquiring lock "c889592ab94cd0b0ce896f27a2af0323771db234" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:47:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:47:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:54 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:47:54 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 16:47:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.190s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk 1073741824" returned: 0 in 0.053s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:47:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.181s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:54 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Checking if we can resize image /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 16:47:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:47:54 user nova-compute[73056]: DEBUG nova.network.neutron [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Successfully created port: 8301812a-2a56-49e5-8747-f50c95c3de26 {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:47:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:47:54 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Cannot resize image /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 16:47:54 user nova-compute[73056]: DEBUG nova.objects.instance [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lazy-loading 'migration_context' on Instance uuid 61357ac0-230f-4711-8954-0bb04bfcb2f6 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:47:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 16:47:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Ensure instance console log exists: /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:47:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:47:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:47:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG nova.network.neutron [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Successfully updated port: 8301812a-2a56-49e5-8747-f50c95c3de26 {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Acquiring lock "refresh_cache-61357ac0-230f-4711-8954-0bb04bfcb2f6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Acquired lock "refresh_cache-61357ac0-230f-4711-8954-0bb04bfcb2f6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG nova.network.neutron [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG nova.compute.manager [req-95f26452-b5df-44f1-95e6-60664f259230 req-6f4b426a-ffd5-40b7-a776-02ceed9e2283 service nova] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Received event network-changed-8301812a-2a56-49e5-8747-f50c95c3de26 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG nova.compute.manager [req-95f26452-b5df-44f1-95e6-60664f259230 req-6f4b426a-ffd5-40b7-a776-02ceed9e2283 service nova] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Refreshing instance network info cache due to event network-changed-8301812a-2a56-49e5-8747-f50c95c3de26. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-95f26452-b5df-44f1-95e6-60664f259230 req-6f4b426a-ffd5-40b7-a776-02ceed9e2283 service nova] Acquiring lock "refresh_cache-61357ac0-230f-4711-8954-0bb04bfcb2f6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG nova.network.neutron [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG nova.network.neutron [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Updating instance_info_cache with network_info: [{"id": "8301812a-2a56-49e5-8747-f50c95c3de26", "address": "fa:16:3e:77:f0:bf", "network": {"id": "c2b49cd1-a248-4bd2-924f-bd8b560aed47", "bridge": "br-int", "label": "tempest-TestStampPattern-1795667966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d796c14bd3489883e161ea1b311ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8301812a-2a", "ovs_interfaceid": "8301812a-2a56-49e5-8747-f50c95c3de26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Releasing lock "refresh_cache-61357ac0-230f-4711-8954-0bb04bfcb2f6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG nova.compute.manager [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Instance network_info: |[{"id": "8301812a-2a56-49e5-8747-f50c95c3de26", "address": "fa:16:3e:77:f0:bf", "network": {"id": "c2b49cd1-a248-4bd2-924f-bd8b560aed47", "bridge": "br-int", "label": "tempest-TestStampPattern-1795667966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d796c14bd3489883e161ea1b311ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8301812a-2a", "ovs_interfaceid": "8301812a-2a56-49e5-8747-f50c95c3de26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-95f26452-b5df-44f1-95e6-60664f259230 req-6f4b426a-ffd5-40b7-a776-02ceed9e2283 service nova] Acquired lock "refresh_cache-61357ac0-230f-4711-8954-0bb04bfcb2f6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG nova.network.neutron [req-95f26452-b5df-44f1-95e6-60664f259230 req-6f4b426a-ffd5-40b7-a776-02ceed9e2283 service nova] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Refreshing network info cache for port 8301812a-2a56-49e5-8747-f50c95c3de26 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Start _get_guest_xml network_info=[{"id": "8301812a-2a56-49e5-8747-f50c95c3de26", "address": "fa:16:3e:77:f0:bf", "network": {"id": "c2b49cd1-a248-4bd2-924f-bd8b560aed47", "bridge": "br-int", "label": "tempest-TestStampPattern-1795667966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d796c14bd3489883e161ea1b311ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8301812a-2a", "ovs_interfaceid": "8301812a-2a56-49e5-8747-f50c95c3de26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:47:55 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:47:55 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:47:55 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:47:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-467601654',display_name='tempest-TestStampPattern-server-467601654',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-467601654',id=28,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1L8q/UE/lP/2VxMJW4uvrcAleicidYPp3XEOqORx+N0k8ZiuhpRRdaAVC38mPfWQU7Ahb0+HsQ9477x/V7V9afEg8xu6rOrZVCKgLaCY5Gqr1Mn3uZleqqMyDV507BJw==',key_name='tempest-TestStampPattern-2127629561',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2d796c14bd3489883e161ea1b311ca5',ramdisk_id='',reservation_id='r-fx0covhi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1217754811',owner_user_name='tempest-TestStampPattern-1217754811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:47:54Z,user_data=None,user_id='18edcf10dda041c8a2bde2fb231b4fde',uuid=61357ac0-230f-4711-8954-0bb04bfcb2f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8301812a-2a56-49e5-8747-f50c95c3de26", "address": "fa:16:3e:77:f0:bf", "network": {"id": "c2b49cd1-a248-4bd2-924f-bd8b560aed47", "bridge": "br-int", "label": "tempest-TestStampPattern-1795667966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d796c14bd3489883e161ea1b311ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8301812a-2a", "ovs_interfaceid": "8301812a-2a56-49e5-8747-f50c95c3de26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Converting VIF {"id": "8301812a-2a56-49e5-8747-f50c95c3de26", "address": "fa:16:3e:77:f0:bf", "network": {"id": "c2b49cd1-a248-4bd2-924f-bd8b560aed47", "bridge": "br-int", "label": "tempest-TestStampPattern-1795667966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d796c14bd3489883e161ea1b311ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8301812a-2a", "ovs_interfaceid": "8301812a-2a56-49e5-8747-f50c95c3de26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:f0:bf,bridge_name='br-int',has_traffic_filtering=True,id=8301812a-2a56-49e5-8747-f50c95c3de26,network=Network(c2b49cd1-a248-4bd2-924f-bd8b560aed47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8301812a-2a') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG nova.objects.instance [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lazy-loading 'pci_devices' on Instance uuid 61357ac0-230f-4711-8954-0bb04bfcb2f6 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:47:55 user nova-compute[73056]:   <uuid>61357ac0-230f-4711-8954-0bb04bfcb2f6</uuid>
Aug 14 16:47:55 user nova-compute[73056]:   <name>instance-0000001c</name>
Aug 14 16:47:55 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:47:55 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:47:55 user nova-compute[73056]:   <metadata>
Aug 14 16:47:55 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:47:55 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:47:55 user nova-compute[73056]:       <nova:name>tempest-TestStampPattern-server-467601654</nova:name>
Aug 14 16:47:55 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:47:55</nova:creationTime>
Aug 14 16:47:55 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:47:55 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:47:55 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:47:55 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:47:55 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:47:55 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:47:55 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:47:55 user nova-compute[73056]:       <nova:owner>
Aug 14 16:47:55 user nova-compute[73056]:         <nova:user uuid="18edcf10dda041c8a2bde2fb231b4fde">tempest-TestStampPattern-1217754811-project-member</nova:user>
Aug 14 16:47:55 user nova-compute[73056]:         <nova:project uuid="d2d796c14bd3489883e161ea1b311ca5">tempest-TestStampPattern-1217754811</nova:project>
Aug 14 16:47:55 user nova-compute[73056]:       </nova:owner>
Aug 14 16:47:55 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:47:55 user nova-compute[73056]:       <nova:ports>
Aug 14 16:47:55 user nova-compute[73056]:         <nova:port uuid="8301812a-2a56-49e5-8747-f50c95c3de26">
Aug 14 16:47:55 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 16:47:55 user nova-compute[73056]:         </nova:port>
Aug 14 16:47:55 user nova-compute[73056]:       </nova:ports>
Aug 14 16:47:55 user nova-compute[73056]:     </nova:instance>
Aug 14 16:47:55 user nova-compute[73056]:   </metadata>
Aug 14 16:47:55 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:47:55 user nova-compute[73056]:     <system>
Aug 14 16:47:55 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:47:55 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:47:55 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:47:55 user nova-compute[73056]:       <entry name="serial">61357ac0-230f-4711-8954-0bb04bfcb2f6</entry>
Aug 14 16:47:55 user nova-compute[73056]:       <entry name="uuid">61357ac0-230f-4711-8954-0bb04bfcb2f6</entry>
Aug 14 16:47:55 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:47:55 user nova-compute[73056]:     </system>
Aug 14 16:47:55 user nova-compute[73056]:   </sysinfo>
Aug 14 16:47:55 user nova-compute[73056]:   <os>
Aug 14 16:47:55 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:47:55 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:47:55 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:47:55 user nova-compute[73056]:   </os>
Aug 14 16:47:55 user nova-compute[73056]:   <features>
Aug 14 16:47:55 user nova-compute[73056]:     <acpi/>
Aug 14 16:47:55 user nova-compute[73056]:     <apic/>
Aug 14 16:47:55 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:47:55 user nova-compute[73056]:   </features>
Aug 14 16:47:55 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:47:55 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:47:55 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:47:55 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:47:55 user nova-compute[73056]:   </clock>
Aug 14 16:47:55 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:47:55 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:47:55 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:47:55 user nova-compute[73056]:   </cpu>
Aug 14 16:47:55 user nova-compute[73056]:   <devices>
Aug 14 16:47:55 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:47:55 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:47:55 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk"/>
Aug 14 16:47:55 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:47:55 user nova-compute[73056]:     </disk>
Aug 14 16:47:55 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:47:55 user nova-compute[73056]:       <mac address="fa:16:3e:77:f0:bf"/>
Aug 14 16:47:55 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:47:55 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:47:55 user nova-compute[73056]:       <target dev="tap8301812a-2a"/>
Aug 14 16:47:55 user nova-compute[73056]:     </interface>
Aug 14 16:47:55 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:47:55 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/console.log" append="off"/>
Aug 14 16:47:55 user nova-compute[73056]:     </serial>
Aug 14 16:47:55 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:47:55 user nova-compute[73056]:     <video>
Aug 14 16:47:55 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:47:55 user nova-compute[73056]:     </video>
Aug 14 16:47:55 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:47:55 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:47:55 user nova-compute[73056]:     </rng>
Aug 14 16:47:55 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:47:55 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:47:55 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:47:55 user nova-compute[73056]:     </memballoon>
Aug 14 16:47:55 user nova-compute[73056]:   </devices>
Aug 14 16:47:55 user nova-compute[73056]: </domain>
Aug 14 16:47:55 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:47:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-467601654',display_name='tempest-TestStampPattern-server-467601654',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-467601654',id=28,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1L8q/UE/lP/2VxMJW4uvrcAleicidYPp3XEOqORx+N0k8ZiuhpRRdaAVC38mPfWQU7Ahb0+HsQ9477x/V7V9afEg8xu6rOrZVCKgLaCY5Gqr1Mn3uZleqqMyDV507BJw==',key_name='tempest-TestStampPattern-2127629561',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2d796c14bd3489883e161ea1b311ca5',ramdisk_id='',reservation_id='r-fx0covhi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1217754811',owner_user_name='tempest-TestStampPattern-1217754811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:47:54Z,user_data=None,user_id='18edcf10dda041c8a2bde2fb231b4fde',uuid=61357ac0-230f-4711-8954-0bb04bfcb2f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8301812a-2a56-49e5-8747-f50c95c3de26", "address": "fa:16:3e:77:f0:bf", "network": {"id": "c2b49cd1-a248-4bd2-924f-bd8b560aed47", "bridge": "br-int", "label": "tempest-TestStampPattern-1795667966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d796c14bd3489883e161ea1b311ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8301812a-2a", "ovs_interfaceid": "8301812a-2a56-49e5-8747-f50c95c3de26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Converting VIF {"id": "8301812a-2a56-49e5-8747-f50c95c3de26", "address": "fa:16:3e:77:f0:bf", "network": {"id": "c2b49cd1-a248-4bd2-924f-bd8b560aed47", "bridge": "br-int", "label": "tempest-TestStampPattern-1795667966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d796c14bd3489883e161ea1b311ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8301812a-2a", "ovs_interfaceid": "8301812a-2a56-49e5-8747-f50c95c3de26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:f0:bf,bridge_name='br-int',has_traffic_filtering=True,id=8301812a-2a56-49e5-8747-f50c95c3de26,network=Network(c2b49cd1-a248-4bd2-924f-bd8b560aed47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8301812a-2a') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG os_vif [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:f0:bf,bridge_name='br-int',has_traffic_filtering=True,id=8301812a-2a56-49e5-8747-f50c95c3de26,network=Network(c2b49cd1-a248-4bd2-924f-bd8b560aed47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8301812a-2a') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8301812a-2a, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8301812a-2a, col_values=(('external_ids', {'iface-id': '8301812a-2a56-49e5-8747-f50c95c3de26', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:f0:bf', 'vm-uuid': '61357ac0-230f-4711-8954-0bb04bfcb2f6'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:55 user nova-compute[73056]: INFO os_vif [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:f0:bf,bridge_name='br-int',has_traffic_filtering=True,id=8301812a-2a56-49e5-8747-f50c95c3de26,network=Network(c2b49cd1-a248-4bd2-924f-bd8b560aed47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8301812a-2a')
Aug 14 16:47:55 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:47:55 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] No VIF found with MAC fa:16:3e:77:f0:bf, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:47:56 user nova-compute[73056]: DEBUG nova.network.neutron [req-95f26452-b5df-44f1-95e6-60664f259230 req-6f4b426a-ffd5-40b7-a776-02ceed9e2283 service nova] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Updated VIF entry in instance network info cache for port 8301812a-2a56-49e5-8747-f50c95c3de26. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:47:56 user nova-compute[73056]: DEBUG nova.network.neutron [req-95f26452-b5df-44f1-95e6-60664f259230 req-6f4b426a-ffd5-40b7-a776-02ceed9e2283 service nova] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Updating instance_info_cache with network_info: [{"id": "8301812a-2a56-49e5-8747-f50c95c3de26", "address": "fa:16:3e:77:f0:bf", "network": {"id": "c2b49cd1-a248-4bd2-924f-bd8b560aed47", "bridge": "br-int", "label": "tempest-TestStampPattern-1795667966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d796c14bd3489883e161ea1b311ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8301812a-2a", "ovs_interfaceid": "8301812a-2a56-49e5-8747-f50c95c3de26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:47:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-95f26452-b5df-44f1-95e6-60664f259230 req-6f4b426a-ffd5-40b7-a776-02ceed9e2283 service nova] Releasing lock "refresh_cache-61357ac0-230f-4711-8954-0bb04bfcb2f6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:47:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:57 user nova-compute[73056]: DEBUG nova.compute.manager [req-079e491e-1100-43ac-8760-ec57df1da5a4 req-748f8fca-3bd0-45b4-a231-16ce435db7dd service nova] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Received event network-vif-plugged-8301812a-2a56-49e5-8747-f50c95c3de26 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:47:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-079e491e-1100-43ac-8760-ec57df1da5a4 req-748f8fca-3bd0-45b4-a231-16ce435db7dd service nova] Acquiring lock "61357ac0-230f-4711-8954-0bb04bfcb2f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:47:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-079e491e-1100-43ac-8760-ec57df1da5a4 req-748f8fca-3bd0-45b4-a231-16ce435db7dd service nova] Lock "61357ac0-230f-4711-8954-0bb04bfcb2f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:47:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-079e491e-1100-43ac-8760-ec57df1da5a4 req-748f8fca-3bd0-45b4-a231-16ce435db7dd service nova] Lock "61357ac0-230f-4711-8954-0bb04bfcb2f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:47:57 user nova-compute[73056]: DEBUG nova.compute.manager [req-079e491e-1100-43ac-8760-ec57df1da5a4 req-748f8fca-3bd0-45b4-a231-16ce435db7dd service nova] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] No waiting events found dispatching network-vif-plugged-8301812a-2a56-49e5-8747-f50c95c3de26 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:47:57 user nova-compute[73056]: WARNING nova.compute.manager [req-079e491e-1100-43ac-8760-ec57df1da5a4 req-748f8fca-3bd0-45b4-a231-16ce435db7dd service nova] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Received unexpected event network-vif-plugged-8301812a-2a56-49e5-8747-f50c95c3de26 for instance with vm_state building and task_state spawning.
Aug 14 16:47:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3cb60560-10fd-4b38-8b5e-e1594ad6afc8 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Acquiring lock "4731f355-9307-4176-910b-cf35beb85e75" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:47:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3cb60560-10fd-4b38-8b5e-e1594ad6afc8 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lock "4731f355-9307-4176-910b-cf35beb85e75" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:47:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3cb60560-10fd-4b38-8b5e-e1594ad6afc8 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Acquiring lock "4731f355-9307-4176-910b-cf35beb85e75-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:47:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3cb60560-10fd-4b38-8b5e-e1594ad6afc8 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lock "4731f355-9307-4176-910b-cf35beb85e75-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:47:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3cb60560-10fd-4b38-8b5e-e1594ad6afc8 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lock "4731f355-9307-4176-910b-cf35beb85e75-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:47:57 user nova-compute[73056]: INFO nova.compute.manager [None req-3cb60560-10fd-4b38-8b5e-e1594ad6afc8 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Terminating instance
Aug 14 16:47:57 user nova-compute[73056]: DEBUG nova.compute.manager [None req-3cb60560-10fd-4b38-8b5e-e1594ad6afc8 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 16:47:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:57 user nova-compute[73056]: DEBUG nova.compute.manager [req-54d580f9-8d1a-4df2-b2b1-90306d73673e req-9318d2d5-0f54-4b83-a13e-0b97209a6a6b service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Received event network-vif-unplugged-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:47:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-54d580f9-8d1a-4df2-b2b1-90306d73673e req-9318d2d5-0f54-4b83-a13e-0b97209a6a6b service nova] Acquiring lock "4731f355-9307-4176-910b-cf35beb85e75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:47:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-54d580f9-8d1a-4df2-b2b1-90306d73673e req-9318d2d5-0f54-4b83-a13e-0b97209a6a6b service nova] Lock "4731f355-9307-4176-910b-cf35beb85e75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:47:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-54d580f9-8d1a-4df2-b2b1-90306d73673e req-9318d2d5-0f54-4b83-a13e-0b97209a6a6b service nova] Lock "4731f355-9307-4176-910b-cf35beb85e75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:47:57 user nova-compute[73056]: DEBUG nova.compute.manager [req-54d580f9-8d1a-4df2-b2b1-90306d73673e req-9318d2d5-0f54-4b83-a13e-0b97209a6a6b service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] No waiting events found dispatching network-vif-unplugged-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:47:57 user nova-compute[73056]: DEBUG nova.compute.manager [req-54d580f9-8d1a-4df2-b2b1-90306d73673e req-9318d2d5-0f54-4b83-a13e-0b97209a6a6b service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Received event network-vif-unplugged-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:47:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:58 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:47:58 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Instance destroyed successfully.
Aug 14 16:47:58 user nova-compute[73056]: DEBUG nova.objects.instance [None req-3cb60560-10fd-4b38-8b5e-e1594ad6afc8 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lazy-loading 'resources' on Instance uuid 4731f355-9307-4176-910b-cf35beb85e75 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:47:58 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-3cb60560-10fd-4b38-8b5e-e1594ad6afc8 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1469159950',display_name='tempest-ServerStableDeviceRescueTest-server-1469159950',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1469159950',id=15,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBQNxWg7OUFhWDQI9/wLnHn2nbEn9G6E26h3WdcqE+rXscJRVMjpTW2ni6zhMvgbqQhJ+9ECYhu3ChirXTVDZRVv933jeqBHwG9oVjz7+R20pljc2XSQT8462fqM4Z3mA==',key_name='tempest-keypair-610798452',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:44:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd5d50a2601044b5aef50a0d0c6e311a',ramdisk_id='',reservation_id='r-hqhusr42',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-759559269',owner_user_name='tempest-ServerStableDeviceRescueTest-759559269-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:46:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3fcea40a59c402ca0fa47cadc0c0e98',uuid=4731f355-9307-4176-910b-cf35beb85e75,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83386dcc-c4f0-49aa-8bd0-43fd3b202c46", "address": "fa:16:3e:2d:f9:8e", "network": {"id": "cf5d30f2-97c6-4785-83d2-549eeb6eca88", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1151628801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd5d50a2601044b5aef50a0d0c6e311a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83386dcc-c4", "ovs_interfaceid": "83386dcc-c4f0-49aa-8bd0-43fd3b202c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:47:58 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-3cb60560-10fd-4b38-8b5e-e1594ad6afc8 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Converting VIF {"id": "83386dcc-c4f0-49aa-8bd0-43fd3b202c46", "address": "fa:16:3e:2d:f9:8e", "network": {"id": "cf5d30f2-97c6-4785-83d2-549eeb6eca88", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1151628801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd5d50a2601044b5aef50a0d0c6e311a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83386dcc-c4", "ovs_interfaceid": "83386dcc-c4f0-49aa-8bd0-43fd3b202c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:47:58 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-3cb60560-10fd-4b38-8b5e-e1594ad6afc8 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:f9:8e,bridge_name='br-int',has_traffic_filtering=True,id=83386dcc-c4f0-49aa-8bd0-43fd3b202c46,network=Network(cf5d30f2-97c6-4785-83d2-549eeb6eca88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83386dcc-c4') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:47:58 user nova-compute[73056]: DEBUG os_vif [None req-3cb60560-10fd-4b38-8b5e-e1594ad6afc8 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:f9:8e,bridge_name='br-int',has_traffic_filtering=True,id=83386dcc-c4f0-49aa-8bd0-43fd3b202c46,network=Network(cf5d30f2-97c6-4785-83d2-549eeb6eca88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83386dcc-c4') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:47:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap83386dcc-c4, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:47:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:47:58 user nova-compute[73056]: INFO os_vif [None req-3cb60560-10fd-4b38-8b5e-e1594ad6afc8 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:f9:8e,bridge_name='br-int',has_traffic_filtering=True,id=83386dcc-c4f0-49aa-8bd0-43fd3b202c46,network=Network(cf5d30f2-97c6-4785-83d2-549eeb6eca88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83386dcc-c4')
Aug 14 16:47:58 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-3cb60560-10fd-4b38-8b5e-e1594ad6afc8 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Deleting instance files /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75_del
Aug 14 16:47:58 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-3cb60560-10fd-4b38-8b5e-e1594ad6afc8 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Deletion of /opt/stack/data/nova/instances/4731f355-9307-4176-910b-cf35beb85e75_del complete
Aug 14 16:47:58 user nova-compute[73056]: INFO nova.compute.manager [None req-3cb60560-10fd-4b38-8b5e-e1594ad6afc8 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 14 16:47:58 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-3cb60560-10fd-4b38-8b5e-e1594ad6afc8 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 16:47:58 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 16:47:58 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 4731f355-9307-4176-910b-cf35beb85e75] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 16:47:59 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:47:59 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:47:59 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 16:47:59 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031679.4373767, 61357ac0-230f-4711-8954-0bb04bfcb2f6 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:47:59 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] VM Resumed (Lifecycle Event)
Aug 14 16:47:59 user nova-compute[73056]: DEBUG nova.compute.manager [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:47:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:47:59 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:47:59 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Instance spawned successfully.
Aug 14 16:47:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:47:59 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Took 0.94 seconds to deallocate network for instance.
Aug 14 16:47:59 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:47:59 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:47:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:47:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:47:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:47:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:47:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:47:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:47:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-d5dbfa63-5061-4304-b8eb-4565ad9f0a96" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:47:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-d5dbfa63-5061-4304-b8eb-4565ad9f0a96" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:47:59 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 16:47:59 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:47:59 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031679.437602, 61357ac0-230f-4711-8954-0bb04bfcb2f6 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:47:59 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] VM Started (Lifecycle Event)
Aug 14 16:47:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3cb60560-10fd-4b38-8b5e-e1594ad6afc8 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:47:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3cb60560-10fd-4b38-8b5e-e1594ad6afc8 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:47:59 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:47:59 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:47:59 user nova-compute[73056]: INFO nova.compute.manager [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Took 5.60 seconds to spawn the instance on the hypervisor.
Aug 14 16:47:59 user nova-compute[73056]: DEBUG nova.compute.manager [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:47:59 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:47:59 user nova-compute[73056]: DEBUG nova.compute.manager [req-7165d0cc-f4bc-4c51-8c14-1ae826d36b3c req-3da9c3dd-6be0-4a71-82b4-f2719a4f8ff4 service nova] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Received event network-vif-plugged-8301812a-2a56-49e5-8747-f50c95c3de26 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:47:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-7165d0cc-f4bc-4c51-8c14-1ae826d36b3c req-3da9c3dd-6be0-4a71-82b4-f2719a4f8ff4 service nova] Acquiring lock "61357ac0-230f-4711-8954-0bb04bfcb2f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:47:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-7165d0cc-f4bc-4c51-8c14-1ae826d36b3c req-3da9c3dd-6be0-4a71-82b4-f2719a4f8ff4 service nova] Lock "61357ac0-230f-4711-8954-0bb04bfcb2f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:47:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-7165d0cc-f4bc-4c51-8c14-1ae826d36b3c req-3da9c3dd-6be0-4a71-82b4-f2719a4f8ff4 service nova] Lock "61357ac0-230f-4711-8954-0bb04bfcb2f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:47:59 user nova-compute[73056]: DEBUG nova.compute.manager [req-7165d0cc-f4bc-4c51-8c14-1ae826d36b3c req-3da9c3dd-6be0-4a71-82b4-f2719a4f8ff4 service nova] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] No waiting events found dispatching network-vif-plugged-8301812a-2a56-49e5-8747-f50c95c3de26 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:47:59 user nova-compute[73056]: WARNING nova.compute.manager [req-7165d0cc-f4bc-4c51-8c14-1ae826d36b3c req-3da9c3dd-6be0-4a71-82b4-f2719a4f8ff4 service nova] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Received unexpected event network-vif-plugged-8301812a-2a56-49e5-8747-f50c95c3de26 for instance with vm_state building and task_state spawning.
Aug 14 16:47:59 user nova-compute[73056]: INFO nova.compute.manager [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Took 6.53 seconds to build instance.
Aug 14 16:47:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-75c5d8c4-4714-4983-91ba-20e3d32ba3ba tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "61357ac0-230f-4711-8954-0bb04bfcb2f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.630s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:47:59 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-3cb60560-10fd-4b38-8b5e-e1594ad6afc8 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:47:59 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-3cb60560-10fd-4b38-8b5e-e1594ad6afc8 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:47:59 user nova-compute[73056]: DEBUG nova.compute.manager [req-f1be19bb-a041-4cfe-867b-179af8621be5 req-251d02de-3ff4-4088-b126-b0b635ba7ba6 service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Received event network-vif-plugged-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:47:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f1be19bb-a041-4cfe-867b-179af8621be5 req-251d02de-3ff4-4088-b126-b0b635ba7ba6 service nova] Acquiring lock "4731f355-9307-4176-910b-cf35beb85e75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:47:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f1be19bb-a041-4cfe-867b-179af8621be5 req-251d02de-3ff4-4088-b126-b0b635ba7ba6 service nova] Lock "4731f355-9307-4176-910b-cf35beb85e75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:47:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f1be19bb-a041-4cfe-867b-179af8621be5 req-251d02de-3ff4-4088-b126-b0b635ba7ba6 service nova] Lock "4731f355-9307-4176-910b-cf35beb85e75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:47:59 user nova-compute[73056]: DEBUG nova.compute.manager [req-f1be19bb-a041-4cfe-867b-179af8621be5 req-251d02de-3ff4-4088-b126-b0b635ba7ba6 service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] No waiting events found dispatching network-vif-plugged-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:47:59 user nova-compute[73056]: WARNING nova.compute.manager [req-f1be19bb-a041-4cfe-867b-179af8621be5 req-251d02de-3ff4-4088-b126-b0b635ba7ba6 service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Received unexpected event network-vif-plugged-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 for instance with vm_state deleted and task_state None.
Aug 14 16:47:59 user nova-compute[73056]: DEBUG nova.compute.manager [req-f1be19bb-a041-4cfe-867b-179af8621be5 req-251d02de-3ff4-4088-b126-b0b635ba7ba6 service nova] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Received event network-vif-deleted-83386dcc-c4f0-49aa-8bd0-43fd3b202c46 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:47:59 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Updating instance_info_cache with network_info: [{"id": "4d2af65d-3317-4411-a99d-13f81c27cc4c", "address": "fa:16:3e:fa:9c:91", "network": {"id": "dd844e8d-9264-4868-819d-0b01ad3b1d41", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-568480417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e6131531ab4553b55ea090d5e7f47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2af65d-33", "ovs_interfaceid": "4d2af65d-3317-4411-a99d-13f81c27cc4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:47:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3cb60560-10fd-4b38-8b5e-e1594ad6afc8 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.425s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:47:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-d5dbfa63-5061-4304-b8eb-4565ad9f0a96" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:47:59 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 16:47:59 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:47:59 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-3cb60560-10fd-4b38-8b5e-e1594ad6afc8 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Deleted allocations for instance 4731f355-9307-4176-910b-cf35beb85e75
Aug 14 16:48:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:48:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:48:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:48:00 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 16:48:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3cb60560-10fd-4b38-8b5e-e1594ad6afc8 tempest-ServerStableDeviceRescueTest-759559269 tempest-ServerStableDeviceRescueTest-759559269-project-member] Lock "4731f355-9307-4176-910b-cf35beb85e75" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.541s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:48:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dbfa63-5061-4304-b8eb-4565ad9f0a96/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dbfa63-5061-4304-b8eb-4565ad9f0a96/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dbfa63-5061-4304-b8eb-4565ad9f0a96/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dbfa63-5061-4304-b8eb-4565ad9f0a96/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:48:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:01 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:48:01 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:48:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:03 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:48:03 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:48:03 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=7389MB free_disk=25.454017639160156GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 16:48:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:48:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:48:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:03 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 9f3a7f8a-e3b9-4918-9663-968677fe5c90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:48:03 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance d5dbfa63-5061-4304-b8eb-4565ad9f0a96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:48:03 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance b580e3d0-88b5-42a3-a953-84b94c088f41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:48:03 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 92c34cf0-fd39-49fc-9244-4da8ccae6eec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:48:03 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 9c11423c-88d3-4fae-8917-c0d57021d194 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:48:03 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 7526c6c3-6d3c-435e-8fc7-742c08be44d0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:48:03 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance d79c2f2c-0870-4d8e-b468-36e63496b769 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:48:03 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 61357ac0-230f-4711-8954-0bb04bfcb2f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:48:03 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 16:48:03 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 16:48:03 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:48:03 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:48:03 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 16:48:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.517s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:48:04 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:48:04 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:48:04 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:48:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:48:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:13 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692031678.3721259, 4731f355-9307-4176-910b-cf35beb85e75 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:48:13 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 4731f355-9307-4176-910b-cf35beb85e75] VM Stopped (Lifecycle Event)
Aug 14 16:48:13 user nova-compute[73056]: DEBUG nova.compute.manager [None req-44711096-e965-4d95-bc0b-7adac2811ad5 None None] [instance: 4731f355-9307-4176-910b-cf35beb85e75] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:48:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "74ab3878-9362-4be0-a5bf-3759469473c9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:48:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "74ab3878-9362-4be0-a5bf-3759469473c9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:48:23 user nova-compute[73056]: DEBUG nova.compute.manager [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:48:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:48:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:48:23 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:48:23 user nova-compute[73056]: INFO nova.compute.claims [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Claim successful on node user
Aug 14 16:48:23 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:48:23 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:48:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.362s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:48:23 user nova-compute[73056]: DEBUG nova.compute.manager [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:48:23 user nova-compute[73056]: DEBUG nova.compute.manager [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:48:23 user nova-compute[73056]: DEBUG nova.network.neutron [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:48:23 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:48:23 user nova-compute[73056]: DEBUG nova.compute.manager [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:48:24 user nova-compute[73056]: DEBUG nova.policy [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3dad45adee1047bda7350d8a3f8a2f54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d5a8e599b3141339ed0ae6729031b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:48:24 user nova-compute[73056]: DEBUG nova.compute.manager [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:48:24 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:48:24 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Creating image(s)
Aug 14 16:48:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "/opt/stack/data/nova/instances/74ab3878-9362-4be0-a5bf-3759469473c9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:48:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "/opt/stack/data/nova/instances/74ab3878-9362-4be0-a5bf-3759469473c9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:48:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "/opt/stack/data/nova/instances/74ab3878-9362-4be0-a5bf-3759469473c9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:48:24 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:24 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.262s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "c889592ab94cd0b0ce896f27a2af0323771db234" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:48:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:48:24 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:24 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.299s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:24 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/74ab3878-9362-4be0-a5bf-3759469473c9/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:24 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/74ab3878-9362-4be0-a5bf-3759469473c9/disk 1073741824" returned: 0 in 0.123s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.429s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:48:24 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.193s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:25 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Checking if we can resize image /opt/stack/data/nova/instances/74ab3878-9362-4be0-a5bf-3759469473c9/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 16:48:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ab3878-9362-4be0-a5bf-3759469473c9/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:25 user nova-compute[73056]: DEBUG nova.network.neutron [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Successfully created port: 01cf063c-b53e-44c8-9bf5-a858b9d8c316 {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:48:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ab3878-9362-4be0-a5bf-3759469473c9/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:25 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Cannot resize image /opt/stack/data/nova/instances/74ab3878-9362-4be0-a5bf-3759469473c9/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 16:48:25 user nova-compute[73056]: DEBUG nova.objects.instance [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lazy-loading 'migration_context' on Instance uuid 74ab3878-9362-4be0-a5bf-3759469473c9 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:48:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 16:48:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Ensure instance console log exists: /opt/stack/data/nova/instances/74ab3878-9362-4be0-a5bf-3759469473c9/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:48:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:48:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:48:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:48:25 user nova-compute[73056]: DEBUG nova.network.neutron [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Successfully updated port: 01cf063c-b53e-44c8-9bf5-a858b9d8c316 {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:48:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "refresh_cache-74ab3878-9362-4be0-a5bf-3759469473c9" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:48:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquired lock "refresh_cache-74ab3878-9362-4be0-a5bf-3759469473c9" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:48:25 user nova-compute[73056]: DEBUG nova.network.neutron [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:48:25 user nova-compute[73056]: DEBUG nova.compute.manager [req-db2b48f9-a483-43a3-82d2-fb0e9c881a8b req-a0523430-3a3b-497a-a485-0a38ee18c0e3 service nova] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Received event network-changed-01cf063c-b53e-44c8-9bf5-a858b9d8c316 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:48:25 user nova-compute[73056]: DEBUG nova.compute.manager [req-db2b48f9-a483-43a3-82d2-fb0e9c881a8b req-a0523430-3a3b-497a-a485-0a38ee18c0e3 service nova] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Refreshing instance network info cache due to event network-changed-01cf063c-b53e-44c8-9bf5-a858b9d8c316. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:48:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-db2b48f9-a483-43a3-82d2-fb0e9c881a8b req-a0523430-3a3b-497a-a485-0a38ee18c0e3 service nova] Acquiring lock "refresh_cache-74ab3878-9362-4be0-a5bf-3759469473c9" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:48:25 user nova-compute[73056]: DEBUG nova.network.neutron [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG nova.network.neutron [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Updating instance_info_cache with network_info: [{"id": "01cf063c-b53e-44c8-9bf5-a858b9d8c316", "address": "fa:16:3e:21:24:7a", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cf063c-b5", "ovs_interfaceid": "01cf063c-b53e-44c8-9bf5-a858b9d8c316", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Releasing lock "refresh_cache-74ab3878-9362-4be0-a5bf-3759469473c9" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG nova.compute.manager [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Instance network_info: |[{"id": "01cf063c-b53e-44c8-9bf5-a858b9d8c316", "address": "fa:16:3e:21:24:7a", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cf063c-b5", "ovs_interfaceid": "01cf063c-b53e-44c8-9bf5-a858b9d8c316", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-db2b48f9-a483-43a3-82d2-fb0e9c881a8b req-a0523430-3a3b-497a-a485-0a38ee18c0e3 service nova] Acquired lock "refresh_cache-74ab3878-9362-4be0-a5bf-3759469473c9" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG nova.network.neutron [req-db2b48f9-a483-43a3-82d2-fb0e9c881a8b req-a0523430-3a3b-497a-a485-0a38ee18c0e3 service nova] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Refreshing network info cache for port 01cf063c-b53e-44c8-9bf5-a858b9d8c316 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Start _get_guest_xml network_info=[{"id": "01cf063c-b53e-44c8-9bf5-a858b9d8c316", "address": "fa:16:3e:21:24:7a", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cf063c-b5", "ovs_interfaceid": "01cf063c-b53e-44c8-9bf5-a858b9d8c316", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:48:26 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:48:26 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:48:26 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:48:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-437728536',display_name='tempest-AttachVolumeNegativeTest-server-437728536',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-437728536',id=29,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaOo9JxiSTPsJdcVjikuTvszYhyLIuD6PyVUOJHSD6xibhw9x7TDje6BG+FcLiyuFbUfNi1CmNeiV0cpRwcTeJd3b8wV7xS11JQSv72YOTSERq+cxCJOVVgA/VU6DgACg==',key_name='tempest-keypair-389707962',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d5a8e599b3141339ed0ae6729031b36',ramdisk_id='',reservation_id='r-x7kmal2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-860464885',owner_user_name='tempest-AttachVolumeNegativeTest-860464885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:48:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dad45adee1047bda7350d8a3f8a2f54',uuid=74ab3878-9362-4be0-a5bf-3759469473c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01cf063c-b53e-44c8-9bf5-a858b9d8c316", "address": "fa:16:3e:21:24:7a", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cf063c-b5", "ovs_interfaceid": "01cf063c-b53e-44c8-9bf5-a858b9d8c316", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Converting VIF {"id": "01cf063c-b53e-44c8-9bf5-a858b9d8c316", "address": "fa:16:3e:21:24:7a", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cf063c-b5", "ovs_interfaceid": "01cf063c-b53e-44c8-9bf5-a858b9d8c316", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:24:7a,bridge_name='br-int',has_traffic_filtering=True,id=01cf063c-b53e-44c8-9bf5-a858b9d8c316,network=Network(ad323a8d-7318-46f5-8af4-cbc61ae589b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01cf063c-b5') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG nova.objects.instance [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lazy-loading 'pci_devices' on Instance uuid 74ab3878-9362-4be0-a5bf-3759469473c9 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:48:26 user nova-compute[73056]:   <uuid>74ab3878-9362-4be0-a5bf-3759469473c9</uuid>
Aug 14 16:48:26 user nova-compute[73056]:   <name>instance-0000001d</name>
Aug 14 16:48:26 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:48:26 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:48:26 user nova-compute[73056]:   <metadata>
Aug 14 16:48:26 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:48:26 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:48:26 user nova-compute[73056]:       <nova:name>tempest-AttachVolumeNegativeTest-server-437728536</nova:name>
Aug 14 16:48:26 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:48:26</nova:creationTime>
Aug 14 16:48:26 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:48:26 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:48:26 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:48:26 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:48:26 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:48:26 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:48:26 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:48:26 user nova-compute[73056]:       <nova:owner>
Aug 14 16:48:26 user nova-compute[73056]:         <nova:user uuid="3dad45adee1047bda7350d8a3f8a2f54">tempest-AttachVolumeNegativeTest-860464885-project-member</nova:user>
Aug 14 16:48:26 user nova-compute[73056]:         <nova:project uuid="9d5a8e599b3141339ed0ae6729031b36">tempest-AttachVolumeNegativeTest-860464885</nova:project>
Aug 14 16:48:26 user nova-compute[73056]:       </nova:owner>
Aug 14 16:48:26 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:48:26 user nova-compute[73056]:       <nova:ports>
Aug 14 16:48:26 user nova-compute[73056]:         <nova:port uuid="01cf063c-b53e-44c8-9bf5-a858b9d8c316">
Aug 14 16:48:26 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 16:48:26 user nova-compute[73056]:         </nova:port>
Aug 14 16:48:26 user nova-compute[73056]:       </nova:ports>
Aug 14 16:48:26 user nova-compute[73056]:     </nova:instance>
Aug 14 16:48:26 user nova-compute[73056]:   </metadata>
Aug 14 16:48:26 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:48:26 user nova-compute[73056]:     <system>
Aug 14 16:48:26 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:48:26 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:48:26 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:48:26 user nova-compute[73056]:       <entry name="serial">74ab3878-9362-4be0-a5bf-3759469473c9</entry>
Aug 14 16:48:26 user nova-compute[73056]:       <entry name="uuid">74ab3878-9362-4be0-a5bf-3759469473c9</entry>
Aug 14 16:48:26 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:48:26 user nova-compute[73056]:     </system>
Aug 14 16:48:26 user nova-compute[73056]:   </sysinfo>
Aug 14 16:48:26 user nova-compute[73056]:   <os>
Aug 14 16:48:26 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:48:26 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:48:26 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:48:26 user nova-compute[73056]:   </os>
Aug 14 16:48:26 user nova-compute[73056]:   <features>
Aug 14 16:48:26 user nova-compute[73056]:     <acpi/>
Aug 14 16:48:26 user nova-compute[73056]:     <apic/>
Aug 14 16:48:26 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:48:26 user nova-compute[73056]:   </features>
Aug 14 16:48:26 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:48:26 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:48:26 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:48:26 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:48:26 user nova-compute[73056]:   </clock>
Aug 14 16:48:26 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:48:26 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:48:26 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:48:26 user nova-compute[73056]:   </cpu>
Aug 14 16:48:26 user nova-compute[73056]:   <devices>
Aug 14 16:48:26 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:48:26 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:48:26 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/74ab3878-9362-4be0-a5bf-3759469473c9/disk"/>
Aug 14 16:48:26 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:48:26 user nova-compute[73056]:     </disk>
Aug 14 16:48:26 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:48:26 user nova-compute[73056]:       <mac address="fa:16:3e:21:24:7a"/>
Aug 14 16:48:26 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:48:26 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:48:26 user nova-compute[73056]:       <target dev="tap01cf063c-b5"/>
Aug 14 16:48:26 user nova-compute[73056]:     </interface>
Aug 14 16:48:26 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:48:26 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/74ab3878-9362-4be0-a5bf-3759469473c9/console.log" append="off"/>
Aug 14 16:48:26 user nova-compute[73056]:     </serial>
Aug 14 16:48:26 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:48:26 user nova-compute[73056]:     <video>
Aug 14 16:48:26 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:48:26 user nova-compute[73056]:     </video>
Aug 14 16:48:26 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:48:26 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:48:26 user nova-compute[73056]:     </rng>
Aug 14 16:48:26 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:48:26 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:48:26 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:48:26 user nova-compute[73056]:     </memballoon>
Aug 14 16:48:26 user nova-compute[73056]:   </devices>
Aug 14 16:48:26 user nova-compute[73056]: </domain>
Aug 14 16:48:26 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:48:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-437728536',display_name='tempest-AttachVolumeNegativeTest-server-437728536',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-437728536',id=29,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaOo9JxiSTPsJdcVjikuTvszYhyLIuD6PyVUOJHSD6xibhw9x7TDje6BG+FcLiyuFbUfNi1CmNeiV0cpRwcTeJd3b8wV7xS11JQSv72YOTSERq+cxCJOVVgA/VU6DgACg==',key_name='tempest-keypair-389707962',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d5a8e599b3141339ed0ae6729031b36',ramdisk_id='',reservation_id='r-x7kmal2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-860464885',owner_user_name='tempest-AttachVolumeNegativeTest-860464885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:48:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dad45adee1047bda7350d8a3f8a2f54',uuid=74ab3878-9362-4be0-a5bf-3759469473c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01cf063c-b53e-44c8-9bf5-a858b9d8c316", "address": "fa:16:3e:21:24:7a", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cf063c-b5", "ovs_interfaceid": "01cf063c-b53e-44c8-9bf5-a858b9d8c316", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Converting VIF {"id": "01cf063c-b53e-44c8-9bf5-a858b9d8c316", "address": "fa:16:3e:21:24:7a", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cf063c-b5", "ovs_interfaceid": "01cf063c-b53e-44c8-9bf5-a858b9d8c316", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:24:7a,bridge_name='br-int',has_traffic_filtering=True,id=01cf063c-b53e-44c8-9bf5-a858b9d8c316,network=Network(ad323a8d-7318-46f5-8af4-cbc61ae589b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01cf063c-b5') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG os_vif [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:24:7a,bridge_name='br-int',has_traffic_filtering=True,id=01cf063c-b53e-44c8-9bf5-a858b9d8c316,network=Network(ad323a8d-7318-46f5-8af4-cbc61ae589b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01cf063c-b5') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01cf063c-b5, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap01cf063c-b5, col_values=(('external_ids', {'iface-id': '01cf063c-b53e-44c8-9bf5-a858b9d8c316', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:24:7a', 'vm-uuid': '74ab3878-9362-4be0-a5bf-3759469473c9'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:26 user nova-compute[73056]: INFO os_vif [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:24:7a,bridge_name='br-int',has_traffic_filtering=True,id=01cf063c-b53e-44c8-9bf5-a858b9d8c316,network=Network(ad323a8d-7318-46f5-8af4-cbc61ae589b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01cf063c-b5')
Aug 14 16:48:26 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] No VIF found with MAC fa:16:3e:21:24:7a, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG nova.network.neutron [req-db2b48f9-a483-43a3-82d2-fb0e9c881a8b req-a0523430-3a3b-497a-a485-0a38ee18c0e3 service nova] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Updated VIF entry in instance network info cache for port 01cf063c-b53e-44c8-9bf5-a858b9d8c316. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG nova.network.neutron [req-db2b48f9-a483-43a3-82d2-fb0e9c881a8b req-a0523430-3a3b-497a-a485-0a38ee18c0e3 service nova] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Updating instance_info_cache with network_info: [{"id": "01cf063c-b53e-44c8-9bf5-a858b9d8c316", "address": "fa:16:3e:21:24:7a", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cf063c-b5", "ovs_interfaceid": "01cf063c-b53e-44c8-9bf5-a858b9d8c316", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:48:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-db2b48f9-a483-43a3-82d2-fb0e9c881a8b req-a0523430-3a3b-497a-a485-0a38ee18c0e3 service nova] Releasing lock "refresh_cache-74ab3878-9362-4be0-a5bf-3759469473c9" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:48:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:28 user nova-compute[73056]: DEBUG nova.compute.manager [req-7ba3c16e-958a-4037-b505-b884f9566317 req-7bb3eb72-b054-4ac8-b206-35bc3e64b876 service nova] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Received event network-vif-plugged-01cf063c-b53e-44c8-9bf5-a858b9d8c316 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:48:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-7ba3c16e-958a-4037-b505-b884f9566317 req-7bb3eb72-b054-4ac8-b206-35bc3e64b876 service nova] Acquiring lock "74ab3878-9362-4be0-a5bf-3759469473c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:48:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-7ba3c16e-958a-4037-b505-b884f9566317 req-7bb3eb72-b054-4ac8-b206-35bc3e64b876 service nova] Lock "74ab3878-9362-4be0-a5bf-3759469473c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:48:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-7ba3c16e-958a-4037-b505-b884f9566317 req-7bb3eb72-b054-4ac8-b206-35bc3e64b876 service nova] Lock "74ab3878-9362-4be0-a5bf-3759469473c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:48:28 user nova-compute[73056]: DEBUG nova.compute.manager [req-7ba3c16e-958a-4037-b505-b884f9566317 req-7bb3eb72-b054-4ac8-b206-35bc3e64b876 service nova] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] No waiting events found dispatching network-vif-plugged-01cf063c-b53e-44c8-9bf5-a858b9d8c316 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:48:28 user nova-compute[73056]: WARNING nova.compute.manager [req-7ba3c16e-958a-4037-b505-b884f9566317 req-7bb3eb72-b054-4ac8-b206-35bc3e64b876 service nova] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Received unexpected event network-vif-plugged-01cf063c-b53e-44c8-9bf5-a858b9d8c316 for instance with vm_state building and task_state spawning.
Aug 14 16:48:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:29 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031709.8902209, 74ab3878-9362-4be0-a5bf-3759469473c9 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:48:29 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] VM Resumed (Lifecycle Event)
Aug 14 16:48:29 user nova-compute[73056]: DEBUG nova.compute.manager [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:48:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:48:29 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Instance spawned successfully.
Aug 14 16:48:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:48:29 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:48:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:48:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:48:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:48:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:48:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:48:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:48:29 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:48:29 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:48:29 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031709.8964353, 74ab3878-9362-4be0-a5bf-3759469473c9 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:48:29 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] VM Started (Lifecycle Event)
Aug 14 16:48:29 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:48:29 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:48:30 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:48:30 user nova-compute[73056]: INFO nova.compute.manager [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Took 5.95 seconds to spawn the instance on the hypervisor.
Aug 14 16:48:30 user nova-compute[73056]: DEBUG nova.compute.manager [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:48:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:30 user nova-compute[73056]: INFO nova.compute.manager [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Took 6.66 seconds to build instance.
Aug 14 16:48:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-dc8d3a6f-9a41-4e24-912e-278ed7c4e460 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "74ab3878-9362-4be0-a5bf-3759469473c9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.770s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:48:30 user nova-compute[73056]: DEBUG nova.compute.manager [req-76972957-ede4-4cdd-b3c1-8ea808f907bb req-35a5917e-5cee-4b05-a5a1-ff8134f5be81 service nova] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Received event network-vif-plugged-01cf063c-b53e-44c8-9bf5-a858b9d8c316 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:48:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-76972957-ede4-4cdd-b3c1-8ea808f907bb req-35a5917e-5cee-4b05-a5a1-ff8134f5be81 service nova] Acquiring lock "74ab3878-9362-4be0-a5bf-3759469473c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:48:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-76972957-ede4-4cdd-b3c1-8ea808f907bb req-35a5917e-5cee-4b05-a5a1-ff8134f5be81 service nova] Lock "74ab3878-9362-4be0-a5bf-3759469473c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:48:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-76972957-ede4-4cdd-b3c1-8ea808f907bb req-35a5917e-5cee-4b05-a5a1-ff8134f5be81 service nova] Lock "74ab3878-9362-4be0-a5bf-3759469473c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:48:30 user nova-compute[73056]: DEBUG nova.compute.manager [req-76972957-ede4-4cdd-b3c1-8ea808f907bb req-35a5917e-5cee-4b05-a5a1-ff8134f5be81 service nova] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] No waiting events found dispatching network-vif-plugged-01cf063c-b53e-44c8-9bf5-a858b9d8c316 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:48:30 user nova-compute[73056]: WARNING nova.compute.manager [req-76972957-ede4-4cdd-b3c1-8ea808f907bb req-35a5917e-5cee-4b05-a5a1-ff8134f5be81 service nova] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Received unexpected event network-vif-plugged-01cf063c-b53e-44c8-9bf5-a858b9d8c316 for instance with vm_state active and task_state None.
Aug 14 16:48:31 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Acquiring lock "c1546794-fd57-4215-a997-39059f213a15" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:48:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Lock "c1546794-fd57-4215-a997-39059f213a15" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:48:37 user nova-compute[73056]: DEBUG nova.compute.manager [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] [instance: c1546794-fd57-4215-a997-39059f213a15] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:48:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:48:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:48:37 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:48:37 user nova-compute[73056]: INFO nova.compute.claims [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] [instance: c1546794-fd57-4215-a997-39059f213a15] Claim successful on node user
Aug 14 16:48:37 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:48:37 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:48:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:48:38 user nova-compute[73056]: DEBUG nova.compute.manager [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] [instance: c1546794-fd57-4215-a997-39059f213a15] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:48:38 user nova-compute[73056]: DEBUG nova.compute.manager [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] [instance: c1546794-fd57-4215-a997-39059f213a15] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:48:38 user nova-compute[73056]: DEBUG nova.network.neutron [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] [instance: c1546794-fd57-4215-a997-39059f213a15] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:48:38 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] [instance: c1546794-fd57-4215-a997-39059f213a15] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:48:38 user nova-compute[73056]: DEBUG nova.compute.manager [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] [instance: c1546794-fd57-4215-a997-39059f213a15] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:48:38 user nova-compute[73056]: DEBUG nova.policy [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e0c43770efa24f4b81d2455d04610f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f914f34411834a5ebd7a4133decf5804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:48:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5caed711-0b21-4645-95ee-616430a366d4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquiring lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:48:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5caed711-0b21-4645-95ee-616430a366d4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:48:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5caed711-0b21-4645-95ee-616430a366d4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquiring lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:48:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5caed711-0b21-4645-95ee-616430a366d4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:48:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5caed711-0b21-4645-95ee-616430a366d4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:48:38 user nova-compute[73056]: INFO nova.compute.manager [None req-5caed711-0b21-4645-95ee-616430a366d4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Terminating instance
Aug 14 16:48:38 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5caed711-0b21-4645-95ee-616430a366d4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 16:48:38 user nova-compute[73056]: DEBUG nova.compute.manager [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] [instance: c1546794-fd57-4215-a997-39059f213a15] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:48:38 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] [instance: c1546794-fd57-4215-a997-39059f213a15] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:48:38 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] [instance: c1546794-fd57-4215-a997-39059f213a15] Creating image(s)
Aug 14 16:48:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Acquiring lock "/opt/stack/data/nova/instances/c1546794-fd57-4215-a997-39059f213a15/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:48:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Lock "/opt/stack/data/nova/instances/c1546794-fd57-4215-a997-39059f213a15/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:48:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Lock "/opt/stack/data/nova/instances/c1546794-fd57-4215-a997-39059f213a15/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:48:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.226s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Acquiring lock "c889592ab94cd0b0ce896f27a2af0323771db234" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:48:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:48:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.214s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/c1546794-fd57-4215-a997-39059f213a15/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:39 user nova-compute[73056]: DEBUG nova.compute.manager [req-98000bb9-f027-4deb-8130-852ff277e349 req-66dced55-6c69-4fc9-bdf6-51ce1bd8823e service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Received event network-vif-unplugged-4d2af65d-3317-4411-a99d-13f81c27cc4c {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:48:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-98000bb9-f027-4deb-8130-852ff277e349 req-66dced55-6c69-4fc9-bdf6-51ce1bd8823e service nova] Acquiring lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:48:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-98000bb9-f027-4deb-8130-852ff277e349 req-66dced55-6c69-4fc9-bdf6-51ce1bd8823e service nova] Lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:48:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-98000bb9-f027-4deb-8130-852ff277e349 req-66dced55-6c69-4fc9-bdf6-51ce1bd8823e service nova] Lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:48:39 user nova-compute[73056]: DEBUG nova.compute.manager [req-98000bb9-f027-4deb-8130-852ff277e349 req-66dced55-6c69-4fc9-bdf6-51ce1bd8823e service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] No waiting events found dispatching network-vif-unplugged-4d2af65d-3317-4411-a99d-13f81c27cc4c {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:48:39 user nova-compute[73056]: DEBUG nova.compute.manager [req-98000bb9-f027-4deb-8130-852ff277e349 req-66dced55-6c69-4fc9-bdf6-51ce1bd8823e service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Received event network-vif-unplugged-4d2af65d-3317-4411-a99d-13f81c27cc4c for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:48:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/c1546794-fd57-4215-a997-39059f213a15/disk 1073741824" returned: 0 in 0.068s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:48:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:39 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.219s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:39 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c1546794-fd57-4215-a997-39059f213a15/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 16:48:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1546794-fd57-4215-a997-39059f213a15/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:39 user nova-compute[73056]: INFO nova.compute.manager [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Rescuing
Aug 14 16:48:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "refresh_cache-b580e3d0-88b5-42a3-a953-84b94c088f41" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:48:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquired lock "refresh_cache-b580e3d0-88b5-42a3-a953-84b94c088f41" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:48:39 user nova-compute[73056]: DEBUG nova.network.neutron [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:48:39 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Instance destroyed successfully.
Aug 14 16:48:39 user nova-compute[73056]: DEBUG nova.objects.instance [None req-5caed711-0b21-4645-95ee-616430a366d4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lazy-loading 'resources' on Instance uuid d5dbfa63-5061-4304-b8eb-4565ad9f0a96 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:48:39 user nova-compute[73056]: DEBUG nova.compute.manager [req-e842ea5e-74b7-41eb-a8be-99a19eb65948 req-90625c43-74e8-4611-a77f-b1232492cd9f service nova] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Received event network-changed-a97a3360-819f-4ea9-98e9-2f475b260008 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:48:39 user nova-compute[73056]: DEBUG nova.compute.manager [req-e842ea5e-74b7-41eb-a8be-99a19eb65948 req-90625c43-74e8-4611-a77f-b1232492cd9f service nova] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Refreshing instance network info cache due to event network-changed-a97a3360-819f-4ea9-98e9-2f475b260008. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:48:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e842ea5e-74b7-41eb-a8be-99a19eb65948 req-90625c43-74e8-4611-a77f-b1232492cd9f service nova] Acquiring lock "refresh_cache-7526c6c3-6d3c-435e-8fc7-742c08be44d0" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:48:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e842ea5e-74b7-41eb-a8be-99a19eb65948 req-90625c43-74e8-4611-a77f-b1232492cd9f service nova] Acquired lock "refresh_cache-7526c6c3-6d3c-435e-8fc7-742c08be44d0" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:48:39 user nova-compute[73056]: DEBUG nova.network.neutron [req-e842ea5e-74b7-41eb-a8be-99a19eb65948 req-90625c43-74e8-4611-a77f-b1232492cd9f service nova] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Refreshing network info cache for port a97a3360-819f-4ea9-98e9-2f475b260008 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:48:39 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-5caed711-0b21-4645-95ee-616430a366d4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:43:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1430322653',display_name='tempest-TestMinimumBasicScenario-server-1430322653',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1430322653',id=21,image_ref='b4b1c783-2e7d-4b82-ad1f-dd57d51115a1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPr36qhIGV026oMXZ/deTnGUJrZ4P/BPR1eRuV6pEMGbEhN8j/TRy7CsVq6xtn88VGXXM14VL4xKD2cZQoImUolaSBHKjXBiIx7Zbxmdq4HS9risqkOjPU6plwsML5Xevg==',key_name='tempest-TestMinimumBasicScenario-101642207',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:43:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95e6131531ab4553b55ea090d5e7f47d',ramdisk_id='',reservation_id='r-tqh2kwhh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b4b1c783-2e7d-4b82-ad1f-dd57d51115a1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2039952053',owner_user_name='tempest-TestMinimumBasicScenario-2039952053-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:45:56Z,user_data=None,user_id='78a1ab88047b4199bb611c0d7c8d6dee',uuid=d5dbfa63-5061-4304-b8eb-4565ad9f0a96,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d2af65d-3317-4411-a99d-13f81c27cc4c", "address": "fa:16:3e:fa:9c:91", "network": {"id": "dd844e8d-9264-4868-819d-0b01ad3b1d41", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-568480417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e6131531ab4553b55ea090d5e7f47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2af65d-33", "ovs_interfaceid": "4d2af65d-3317-4411-a99d-13f81c27cc4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:48:39 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-5caed711-0b21-4645-95ee-616430a366d4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Converting VIF {"id": "4d2af65d-3317-4411-a99d-13f81c27cc4c", "address": "fa:16:3e:fa:9c:91", "network": {"id": "dd844e8d-9264-4868-819d-0b01ad3b1d41", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-568480417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e6131531ab4553b55ea090d5e7f47d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2af65d-33", "ovs_interfaceid": "4d2af65d-3317-4411-a99d-13f81c27cc4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:48:39 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-5caed711-0b21-4645-95ee-616430a366d4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:9c:91,bridge_name='br-int',has_traffic_filtering=True,id=4d2af65d-3317-4411-a99d-13f81c27cc4c,network=Network(dd844e8d-9264-4868-819d-0b01ad3b1d41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d2af65d-33') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:48:39 user nova-compute[73056]: DEBUG os_vif [None req-5caed711-0b21-4645-95ee-616430a366d4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:9c:91,bridge_name='br-int',has_traffic_filtering=True,id=4d2af65d-3317-4411-a99d-13f81c27cc4c,network=Network(dd844e8d-9264-4868-819d-0b01ad3b1d41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d2af65d-33') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:48:39 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:39 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d2af65d-33, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:48:39 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:39 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:48:39 user nova-compute[73056]: INFO os_vif [None req-5caed711-0b21-4645-95ee-616430a366d4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:9c:91,bridge_name='br-int',has_traffic_filtering=True,id=4d2af65d-3317-4411-a99d-13f81c27cc4c,network=Network(dd844e8d-9264-4868-819d-0b01ad3b1d41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d2af65d-33')
Aug 14 16:48:39 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-5caed711-0b21-4645-95ee-616430a366d4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Deleting instance files /opt/stack/data/nova/instances/d5dbfa63-5061-4304-b8eb-4565ad9f0a96_del
Aug 14 16:48:39 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-5caed711-0b21-4645-95ee-616430a366d4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Deletion of /opt/stack/data/nova/instances/d5dbfa63-5061-4304-b8eb-4565ad9f0a96_del complete
Aug 14 16:48:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1546794-fd57-4215-a997-39059f213a15/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:39 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Cannot resize image /opt/stack/data/nova/instances/c1546794-fd57-4215-a997-39059f213a15/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 16:48:39 user nova-compute[73056]: DEBUG nova.objects.instance [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Lazy-loading 'migration_context' on Instance uuid c1546794-fd57-4215-a997-39059f213a15 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:48:39 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] [instance: c1546794-fd57-4215-a997-39059f213a15] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 16:48:39 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] [instance: c1546794-fd57-4215-a997-39059f213a15] Ensure instance console log exists: /opt/stack/data/nova/instances/c1546794-fd57-4215-a997-39059f213a15/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:48:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:48:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:48:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:48:39 user nova-compute[73056]: INFO nova.compute.manager [None req-5caed711-0b21-4645-95ee-616430a366d4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Took 1.02 seconds to destroy the instance on the hypervisor.
Aug 14 16:48:39 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-5caed711-0b21-4645-95ee-616430a366d4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 16:48:39 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 16:48:39 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 16:48:40 user nova-compute[73056]: DEBUG nova.network.neutron [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Updating instance_info_cache with network_info: [{"id": "b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0", "address": "fa:16:3e:f9:ca:00", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb006576a-8b", "ovs_interfaceid": "b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:48:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Releasing lock "refresh_cache-b580e3d0-88b5-42a3-a953-84b94c088f41" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:48:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:40 user nova-compute[73056]: DEBUG nova.network.neutron [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] [instance: c1546794-fd57-4215-a997-39059f213a15] Successfully created port: e5721964-4792-4d0a-bae4-107701dbfabd {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:48:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:40 user nova-compute[73056]: DEBUG nova.network.neutron [req-e842ea5e-74b7-41eb-a8be-99a19eb65948 req-90625c43-74e8-4611-a77f-b1232492cd9f service nova] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Updated VIF entry in instance network info cache for port a97a3360-819f-4ea9-98e9-2f475b260008. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:48:40 user nova-compute[73056]: DEBUG nova.network.neutron [req-e842ea5e-74b7-41eb-a8be-99a19eb65948 req-90625c43-74e8-4611-a77f-b1232492cd9f service nova] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Updating instance_info_cache with network_info: [{"id": "a97a3360-819f-4ea9-98e9-2f475b260008", "address": "fa:16:3e:41:58:29", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa97a3360-81", "ovs_interfaceid": "a97a3360-819f-4ea9-98e9-2f475b260008", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:48:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e842ea5e-74b7-41eb-a8be-99a19eb65948 req-90625c43-74e8-4611-a77f-b1232492cd9f service nova] Releasing lock "refresh_cache-7526c6c3-6d3c-435e-8fc7-742c08be44d0" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:48:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:40 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:48:40 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Instance destroyed successfully.
Aug 14 16:48:40 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Attempting rescue
Aug 14 16:48:40 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73056) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 16:48:40 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Took 1.31 seconds to deallocate network for instance.
Aug 14 16:48:40 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Instance directory exists: not creating {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 16:48:40 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Creating image(s)
Aug 14 16:48:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "/opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:48:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "/opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:48:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "/opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:48:40 user nova-compute[73056]: DEBUG nova.objects.instance [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lazy-loading 'trusted_certs' on Instance uuid b580e3d0-88b5-42a3-a953-84b94c088f41 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:48:40 user nova-compute[73056]: DEBUG nova.compute.manager [req-76cf04e5-cfb6-415f-9945-711eaf5dc2bc req-85d6598c-7007-4c3e-9ab4-5e2a42fd1e6f service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Received event network-vif-deleted-4d2af65d-3317-4411-a99d-13f81c27cc4c {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "c889592ab94cd0b0ce896f27a2af0323771db234" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5caed711-0b21-4645-95ee-616430a366d4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5caed711-0b21-4645-95ee-616430a366d4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG nova.compute.manager [req-aa5dfe44-4ecc-4ffa-8d77-e6fb04260c22 req-ea15bbc0-7a49-4c55-b579-f92540b11197 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Received event network-vif-plugged-4d2af65d-3317-4411-a99d-13f81c27cc4c {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-aa5dfe44-4ecc-4ffa-8d77-e6fb04260c22 req-ea15bbc0-7a49-4c55-b579-f92540b11197 service nova] Acquiring lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-aa5dfe44-4ecc-4ffa-8d77-e6fb04260c22 req-ea15bbc0-7a49-4c55-b579-f92540b11197 service nova] Lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-aa5dfe44-4ecc-4ffa-8d77-e6fb04260c22 req-ea15bbc0-7a49-4c55-b579-f92540b11197 service nova] Lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG nova.compute.manager [req-aa5dfe44-4ecc-4ffa-8d77-e6fb04260c22 req-ea15bbc0-7a49-4c55-b579-f92540b11197 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] No waiting events found dispatching network-vif-plugged-4d2af65d-3317-4411-a99d-13f81c27cc4c {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:48:41 user nova-compute[73056]: WARNING nova.compute.manager [req-aa5dfe44-4ecc-4ffa-8d77-e6fb04260c22 req-ea15bbc0-7a49-4c55-b579-f92540b11197 service nova] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Received unexpected event network-vif-plugged-4d2af65d-3317-4411-a99d-13f81c27cc4c for instance with vm_state deleted and task_state None.
Aug 14 16:48:41 user nova-compute[73056]: DEBUG nova.compute.manager [req-aa5dfe44-4ecc-4ffa-8d77-e6fb04260c22 req-ea15bbc0-7a49-4c55-b579-f92540b11197 service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Received event network-vif-unplugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-aa5dfe44-4ecc-4ffa-8d77-e6fb04260c22 req-ea15bbc0-7a49-4c55-b579-f92540b11197 service nova] Acquiring lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-aa5dfe44-4ecc-4ffa-8d77-e6fb04260c22 req-ea15bbc0-7a49-4c55-b579-f92540b11197 service nova] Lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-aa5dfe44-4ecc-4ffa-8d77-e6fb04260c22 req-ea15bbc0-7a49-4c55-b579-f92540b11197 service nova] Lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG nova.compute.manager [req-aa5dfe44-4ecc-4ffa-8d77-e6fb04260c22 req-ea15bbc0-7a49-4c55-b579-f92540b11197 service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] No waiting events found dispatching network-vif-unplugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:48:41 user nova-compute[73056]: WARNING nova.compute.manager [req-aa5dfe44-4ecc-4ffa-8d77-e6fb04260c22 req-ea15bbc0-7a49-4c55-b579-f92540b11197 service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Received unexpected event network-vif-unplugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 for instance with vm_state active and task_state rescuing.
Aug 14 16:48:41 user nova-compute[73056]: DEBUG nova.compute.manager [req-aa5dfe44-4ecc-4ffa-8d77-e6fb04260c22 req-ea15bbc0-7a49-4c55-b579-f92540b11197 service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Received event network-vif-plugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-aa5dfe44-4ecc-4ffa-8d77-e6fb04260c22 req-ea15bbc0-7a49-4c55-b579-f92540b11197 service nova] Acquiring lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-aa5dfe44-4ecc-4ffa-8d77-e6fb04260c22 req-ea15bbc0-7a49-4c55-b579-f92540b11197 service nova] Lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-aa5dfe44-4ecc-4ffa-8d77-e6fb04260c22 req-ea15bbc0-7a49-4c55-b579-f92540b11197 service nova] Lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG nova.compute.manager [req-aa5dfe44-4ecc-4ffa-8d77-e6fb04260c22 req-ea15bbc0-7a49-4c55-b579-f92540b11197 service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] No waiting events found dispatching network-vif-plugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:48:41 user nova-compute[73056]: WARNING nova.compute.manager [req-aa5dfe44-4ecc-4ffa-8d77-e6fb04260c22 req-ea15bbc0-7a49-4c55-b579-f92540b11197 service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Received unexpected event network-vif-plugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 for instance with vm_state active and task_state rescuing.
Aug 14 16:48:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.215s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk.rescue {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk.rescue" returned: 0 in 0.051s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG nova.objects.instance [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lazy-loading 'migration_context' on Instance uuid b580e3d0-88b5-42a3-a953-84b94c088f41 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Start _get_guest_xml network_info=[{"id": "b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0", "address": "fa:16:3e:f9:ca:00", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "vif_mac": "fa:16:3e:f9:ca:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb006576a-8b", "ovs_interfaceid": "b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG nova.objects.instance [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lazy-loading 'resources' on Instance uuid b580e3d0-88b5-42a3-a953-84b94c088f41 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG nova.objects.instance [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lazy-loading 'numa_topology' on Instance uuid b580e3d0-88b5-42a3-a953-84b94c088f41 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:48:41 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:48:41 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:48:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG nova.objects.instance [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lazy-loading 'vcpu_model' on Instance uuid b580e3d0-88b5-42a3-a953-84b94c088f41 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:43:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1690624150',display_name='tempest-ServerRescueNegativeTestJSON-server-1690624150',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1690624150',id=22,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:44:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09b7b0f153a945ac9ce96fe462b17fd5',ramdisk_id='',reservation_id='r-s8wct4sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-201205905',owner_user_name='tempest-ServerRescueNegativeTestJSON-201205905-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:44:03Z,user_data=None,user_id='e9f89462f2734ec48d78921ab3d654b2',uuid=b580e3d0-88b5-42a3-a953-84b94c088f41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0", "address": "fa:16:3e:f9:ca:00", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "vif_mac": "fa:16:3e:f9:ca:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb006576a-8b", "ovs_interfaceid": "b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Converting VIF {"id": "b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0", "address": "fa:16:3e:f9:ca:00", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "vif_mac": "fa:16:3e:f9:ca:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb006576a-8b", "ovs_interfaceid": "b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:ca:00,bridge_name='br-int',has_traffic_filtering=True,id=b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0,network=Network(9f4305e9-4b75-4f5d-b1b2-f1184c408739),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb006576a-8b') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG nova.objects.instance [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lazy-loading 'pci_devices' on Instance uuid b580e3d0-88b5-42a3-a953-84b94c088f41 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:48:41 user nova-compute[73056]:   <uuid>b580e3d0-88b5-42a3-a953-84b94c088f41</uuid>
Aug 14 16:48:41 user nova-compute[73056]:   <name>instance-00000016</name>
Aug 14 16:48:41 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:48:41 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:48:41 user nova-compute[73056]:   <metadata>
Aug 14 16:48:41 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:48:41 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:48:41 user nova-compute[73056]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1690624150</nova:name>
Aug 14 16:48:41 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:48:41</nova:creationTime>
Aug 14 16:48:41 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:48:41 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:48:41 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:48:41 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:48:41 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:48:41 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:48:41 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:48:41 user nova-compute[73056]:       <nova:owner>
Aug 14 16:48:41 user nova-compute[73056]:         <nova:user uuid="e9f89462f2734ec48d78921ab3d654b2">tempest-ServerRescueNegativeTestJSON-201205905-project-member</nova:user>
Aug 14 16:48:41 user nova-compute[73056]:         <nova:project uuid="09b7b0f153a945ac9ce96fe462b17fd5">tempest-ServerRescueNegativeTestJSON-201205905</nova:project>
Aug 14 16:48:41 user nova-compute[73056]:       </nova:owner>
Aug 14 16:48:41 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:48:41 user nova-compute[73056]:       <nova:ports>
Aug 14 16:48:41 user nova-compute[73056]:         <nova:port uuid="b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0">
Aug 14 16:48:41 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 14 16:48:41 user nova-compute[73056]:         </nova:port>
Aug 14 16:48:41 user nova-compute[73056]:       </nova:ports>
Aug 14 16:48:41 user nova-compute[73056]:     </nova:instance>
Aug 14 16:48:41 user nova-compute[73056]:   </metadata>
Aug 14 16:48:41 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:48:41 user nova-compute[73056]:     <system>
Aug 14 16:48:41 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:48:41 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:48:41 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:48:41 user nova-compute[73056]:       <entry name="serial">b580e3d0-88b5-42a3-a953-84b94c088f41</entry>
Aug 14 16:48:41 user nova-compute[73056]:       <entry name="uuid">b580e3d0-88b5-42a3-a953-84b94c088f41</entry>
Aug 14 16:48:41 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:48:41 user nova-compute[73056]:     </system>
Aug 14 16:48:41 user nova-compute[73056]:   </sysinfo>
Aug 14 16:48:41 user nova-compute[73056]:   <os>
Aug 14 16:48:41 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:48:41 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:48:41 user nova-compute[73056]:   </os>
Aug 14 16:48:41 user nova-compute[73056]:   <features>
Aug 14 16:48:41 user nova-compute[73056]:     <acpi/>
Aug 14 16:48:41 user nova-compute[73056]:     <apic/>
Aug 14 16:48:41 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:48:41 user nova-compute[73056]:   </features>
Aug 14 16:48:41 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:48:41 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:48:41 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:48:41 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:48:41 user nova-compute[73056]:   </clock>
Aug 14 16:48:41 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:48:41 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:48:41 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:48:41 user nova-compute[73056]:   </cpu>
Aug 14 16:48:41 user nova-compute[73056]:   <devices>
Aug 14 16:48:41 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:48:41 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:48:41 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk.rescue"/>
Aug 14 16:48:41 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:48:41 user nova-compute[73056]:     </disk>
Aug 14 16:48:41 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:48:41 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:48:41 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk"/>
Aug 14 16:48:41 user nova-compute[73056]:       <target dev="vdb" bus="virtio"/>
Aug 14 16:48:41 user nova-compute[73056]:     </disk>
Aug 14 16:48:41 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:48:41 user nova-compute[73056]:       <mac address="fa:16:3e:f9:ca:00"/>
Aug 14 16:48:41 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:48:41 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:48:41 user nova-compute[73056]:       <target dev="tapb006576a-8b"/>
Aug 14 16:48:41 user nova-compute[73056]:     </interface>
Aug 14 16:48:41 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:48:41 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/console.log" append="off"/>
Aug 14 16:48:41 user nova-compute[73056]:     </serial>
Aug 14 16:48:41 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:48:41 user nova-compute[73056]:     <video>
Aug 14 16:48:41 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:48:41 user nova-compute[73056]:     </video>
Aug 14 16:48:41 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:48:41 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:48:41 user nova-compute[73056]:     </rng>
Aug 14 16:48:41 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:48:41 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:48:41 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:48:41 user nova-compute[73056]:     </memballoon>
Aug 14 16:48:41 user nova-compute[73056]:   </devices>
Aug 14 16:48:41 user nova-compute[73056]: </domain>
Aug 14 16:48:41 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:48:41 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Instance destroyed successfully.
Aug 14 16:48:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-5caed711-0b21-4645-95ee-616430a366d4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-5caed711-0b21-4645-95ee-616430a366d4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] No VIF found with MAC fa:16:3e:f9:ca:00, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:48:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5caed711-0b21-4645-95ee-616430a366d4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.535s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:48:41 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-5caed711-0b21-4645-95ee-616430a366d4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Deleted allocations for instance d5dbfa63-5061-4304-b8eb-4565ad9f0a96
Aug 14 16:48:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5caed711-0b21-4645-95ee-616430a366d4 tempest-TestMinimumBasicScenario-2039952053 tempest-TestMinimumBasicScenario-2039952053-project-member] Lock "d5dbfa63-5061-4304-b8eb-4565ad9f0a96" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.111s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG nova.network.neutron [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] [instance: c1546794-fd57-4215-a997-39059f213a15] Successfully updated port: e5721964-4792-4d0a-bae4-107701dbfabd {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Acquiring lock "refresh_cache-c1546794-fd57-4215-a997-39059f213a15" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Acquired lock "refresh_cache-c1546794-fd57-4215-a997-39059f213a15" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG nova.network.neutron [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] [instance: c1546794-fd57-4215-a997-39059f213a15] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG nova.compute.manager [req-f00508e9-b633-462f-b059-8929660787c4 req-2cf08840-78ce-4a43-b177-8b3adb4c6672 service nova] [instance: c1546794-fd57-4215-a997-39059f213a15] Received event network-changed-e5721964-4792-4d0a-bae4-107701dbfabd {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG nova.compute.manager [req-f00508e9-b633-462f-b059-8929660787c4 req-2cf08840-78ce-4a43-b177-8b3adb4c6672 service nova] [instance: c1546794-fd57-4215-a997-39059f213a15] Refreshing instance network info cache due to event network-changed-e5721964-4792-4d0a-bae4-107701dbfabd. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f00508e9-b633-462f-b059-8929660787c4 req-2cf08840-78ce-4a43-b177-8b3adb4c6672 service nova] Acquiring lock "refresh_cache-c1546794-fd57-4215-a997-39059f213a15" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG nova.network.neutron [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] [instance: c1546794-fd57-4215-a997-39059f213a15] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG nova.network.neutron [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] [instance: c1546794-fd57-4215-a997-39059f213a15] Updating instance_info_cache with network_info: [{"id": "e5721964-4792-4d0a-bae4-107701dbfabd", "address": "fa:16:3e:d9:0a:4b", "network": {"id": "72a6c745-f95a-4734-83b4-d013a21fdc9e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e74ab11f44a44d9a834e80f2683d87d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5721964-47", "ovs_interfaceid": "e5721964-4792-4d0a-bae4-107701dbfabd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Releasing lock "refresh_cache-c1546794-fd57-4215-a997-39059f213a15" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG nova.compute.manager [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] [instance: c1546794-fd57-4215-a997-39059f213a15] Instance network_info: |[{"id": "e5721964-4792-4d0a-bae4-107701dbfabd", "address": "fa:16:3e:d9:0a:4b", "network": {"id": "72a6c745-f95a-4734-83b4-d013a21fdc9e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e74ab11f44a44d9a834e80f2683d87d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5721964-47", "ovs_interfaceid": "e5721964-4792-4d0a-bae4-107701dbfabd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f00508e9-b633-462f-b059-8929660787c4 req-2cf08840-78ce-4a43-b177-8b3adb4c6672 service nova] Acquired lock "refresh_cache-c1546794-fd57-4215-a997-39059f213a15" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG nova.network.neutron [req-f00508e9-b633-462f-b059-8929660787c4 req-2cf08840-78ce-4a43-b177-8b3adb4c6672 service nova] [instance: c1546794-fd57-4215-a997-39059f213a15] Refreshing network info cache for port e5721964-4792-4d0a-bae4-107701dbfabd {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] [instance: c1546794-fd57-4215-a997-39059f213a15] Start _get_guest_xml network_info=[{"id": "e5721964-4792-4d0a-bae4-107701dbfabd", "address": "fa:16:3e:d9:0a:4b", "network": {"id": "72a6c745-f95a-4734-83b4-d013a21fdc9e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e74ab11f44a44d9a834e80f2683d87d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5721964-47", "ovs_interfaceid": "e5721964-4792-4d0a-bae4-107701dbfabd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:48:42 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:48:42 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:48:42 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:48:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1267792774',display_name='tempest-VolumesNegativeTest-instance-1267792774',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1267792774',id=30,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f914f34411834a5ebd7a4133decf5804',ramdisk_id='',reservation_id='r-e82e3wds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-736999191',owner_user_name='tempest-VolumesNegativeTest-736999191-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:48:39Z,user_data=None,user_id='e0c43770efa24f4b81d2455d04610f4b',uuid=c1546794-fd57-4215-a997-39059f213a15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5721964-4792-4d0a-bae4-107701dbfabd", "address": "fa:16:3e:d9:0a:4b", "network": {"id": "72a6c745-f95a-4734-83b4-d013a21fdc9e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e74ab11f44a44d9a834e80f2683d87d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5721964-47", "ovs_interfaceid": "e5721964-4792-4d0a-bae4-107701dbfabd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Converting VIF {"id": "e5721964-4792-4d0a-bae4-107701dbfabd", "address": "fa:16:3e:d9:0a:4b", "network": {"id": "72a6c745-f95a-4734-83b4-d013a21fdc9e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e74ab11f44a44d9a834e80f2683d87d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5721964-47", "ovs_interfaceid": "e5721964-4792-4d0a-bae4-107701dbfabd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:0a:4b,bridge_name='br-int',has_traffic_filtering=True,id=e5721964-4792-4d0a-bae4-107701dbfabd,network=Network(72a6c745-f95a-4734-83b4-d013a21fdc9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5721964-47') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG nova.objects.instance [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Lazy-loading 'pci_devices' on Instance uuid c1546794-fd57-4215-a997-39059f213a15 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] [instance: c1546794-fd57-4215-a997-39059f213a15] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:48:42 user nova-compute[73056]:   <uuid>c1546794-fd57-4215-a997-39059f213a15</uuid>
Aug 14 16:48:42 user nova-compute[73056]:   <name>instance-0000001e</name>
Aug 14 16:48:42 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:48:42 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:48:42 user nova-compute[73056]:   <metadata>
Aug 14 16:48:42 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:48:42 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:48:42 user nova-compute[73056]:       <nova:name>tempest-VolumesNegativeTest-instance-1267792774</nova:name>
Aug 14 16:48:42 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:48:42</nova:creationTime>
Aug 14 16:48:42 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:48:42 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:48:42 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:48:42 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:48:42 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:48:42 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:48:42 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:48:42 user nova-compute[73056]:       <nova:owner>
Aug 14 16:48:42 user nova-compute[73056]:         <nova:user uuid="e0c43770efa24f4b81d2455d04610f4b">tempest-VolumesNegativeTest-736999191-project-member</nova:user>
Aug 14 16:48:42 user nova-compute[73056]:         <nova:project uuid="f914f34411834a5ebd7a4133decf5804">tempest-VolumesNegativeTest-736999191</nova:project>
Aug 14 16:48:42 user nova-compute[73056]:       </nova:owner>
Aug 14 16:48:42 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:48:42 user nova-compute[73056]:       <nova:ports>
Aug 14 16:48:42 user nova-compute[73056]:         <nova:port uuid="e5721964-4792-4d0a-bae4-107701dbfabd">
Aug 14 16:48:42 user nova-compute[73056]:           <nova:ip type="fixed" address="192.168.233.91" ipVersion="4"/>
Aug 14 16:48:42 user nova-compute[73056]:         </nova:port>
Aug 14 16:48:42 user nova-compute[73056]:       </nova:ports>
Aug 14 16:48:42 user nova-compute[73056]:     </nova:instance>
Aug 14 16:48:42 user nova-compute[73056]:   </metadata>
Aug 14 16:48:42 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:48:42 user nova-compute[73056]:     <system>
Aug 14 16:48:42 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:48:42 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:48:42 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:48:42 user nova-compute[73056]:       <entry name="serial">c1546794-fd57-4215-a997-39059f213a15</entry>
Aug 14 16:48:42 user nova-compute[73056]:       <entry name="uuid">c1546794-fd57-4215-a997-39059f213a15</entry>
Aug 14 16:48:42 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:48:42 user nova-compute[73056]:     </system>
Aug 14 16:48:42 user nova-compute[73056]:   </sysinfo>
Aug 14 16:48:42 user nova-compute[73056]:   <os>
Aug 14 16:48:42 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:48:42 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:48:42 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:48:42 user nova-compute[73056]:   </os>
Aug 14 16:48:42 user nova-compute[73056]:   <features>
Aug 14 16:48:42 user nova-compute[73056]:     <acpi/>
Aug 14 16:48:42 user nova-compute[73056]:     <apic/>
Aug 14 16:48:42 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:48:42 user nova-compute[73056]:   </features>
Aug 14 16:48:42 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:48:42 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:48:42 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:48:42 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:48:42 user nova-compute[73056]:   </clock>
Aug 14 16:48:42 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:48:42 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:48:42 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:48:42 user nova-compute[73056]:   </cpu>
Aug 14 16:48:42 user nova-compute[73056]:   <devices>
Aug 14 16:48:42 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:48:42 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:48:42 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/c1546794-fd57-4215-a997-39059f213a15/disk"/>
Aug 14 16:48:42 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:48:42 user nova-compute[73056]:     </disk>
Aug 14 16:48:42 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:48:42 user nova-compute[73056]:       <mac address="fa:16:3e:d9:0a:4b"/>
Aug 14 16:48:42 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:48:42 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:48:42 user nova-compute[73056]:       <target dev="tape5721964-47"/>
Aug 14 16:48:42 user nova-compute[73056]:     </interface>
Aug 14 16:48:42 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:48:42 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/c1546794-fd57-4215-a997-39059f213a15/console.log" append="off"/>
Aug 14 16:48:42 user nova-compute[73056]:     </serial>
Aug 14 16:48:42 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:48:42 user nova-compute[73056]:     <video>
Aug 14 16:48:42 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:48:42 user nova-compute[73056]:     </video>
Aug 14 16:48:42 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:48:42 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:48:42 user nova-compute[73056]:     </rng>
Aug 14 16:48:42 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:48:42 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:48:42 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:48:42 user nova-compute[73056]:     </memballoon>
Aug 14 16:48:42 user nova-compute[73056]:   </devices>
Aug 14 16:48:42 user nova-compute[73056]: </domain>
Aug 14 16:48:42 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:48:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1267792774',display_name='tempest-VolumesNegativeTest-instance-1267792774',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1267792774',id=30,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f914f34411834a5ebd7a4133decf5804',ramdisk_id='',reservation_id='r-e82e3wds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-736999191',owner_user_name='tempest-VolumesNegativeTest-736999191-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:48:39Z,user_data=None,user_id='e0c43770efa24f4b81d2455d04610f4b',uuid=c1546794-fd57-4215-a997-39059f213a15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5721964-4792-4d0a-bae4-107701dbfabd", "address": "fa:16:3e:d9:0a:4b", "network": {"id": "72a6c745-f95a-4734-83b4-d013a21fdc9e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e74ab11f44a44d9a834e80f2683d87d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5721964-47", "ovs_interfaceid": "e5721964-4792-4d0a-bae4-107701dbfabd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Converting VIF {"id": "e5721964-4792-4d0a-bae4-107701dbfabd", "address": "fa:16:3e:d9:0a:4b", "network": {"id": "72a6c745-f95a-4734-83b4-d013a21fdc9e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e74ab11f44a44d9a834e80f2683d87d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5721964-47", "ovs_interfaceid": "e5721964-4792-4d0a-bae4-107701dbfabd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:0a:4b,bridge_name='br-int',has_traffic_filtering=True,id=e5721964-4792-4d0a-bae4-107701dbfabd,network=Network(72a6c745-f95a-4734-83b4-d013a21fdc9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5721964-47') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG os_vif [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:0a:4b,bridge_name='br-int',has_traffic_filtering=True,id=e5721964-4792-4d0a-bae4-107701dbfabd,network=Network(72a6c745-f95a-4734-83b4-d013a21fdc9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5721964-47') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape5721964-47, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape5721964-47, col_values=(('external_ids', {'iface-id': 'e5721964-4792-4d0a-bae4-107701dbfabd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:0a:4b', 'vm-uuid': 'c1546794-fd57-4215-a997-39059f213a15'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:42 user nova-compute[73056]: INFO os_vif [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:0a:4b,bridge_name='br-int',has_traffic_filtering=True,id=e5721964-4792-4d0a-bae4-107701dbfabd,network=Network(72a6c745-f95a-4734-83b4-d013a21fdc9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5721964-47')
Aug 14 16:48:42 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:48:42 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] No VIF found with MAC fa:16:3e:d9:0a:4b, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:48:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:43 user nova-compute[73056]: DEBUG nova.network.neutron [req-f00508e9-b633-462f-b059-8929660787c4 req-2cf08840-78ce-4a43-b177-8b3adb4c6672 service nova] [instance: c1546794-fd57-4215-a997-39059f213a15] Updated VIF entry in instance network info cache for port e5721964-4792-4d0a-bae4-107701dbfabd. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:48:43 user nova-compute[73056]: DEBUG nova.network.neutron [req-f00508e9-b633-462f-b059-8929660787c4 req-2cf08840-78ce-4a43-b177-8b3adb4c6672 service nova] [instance: c1546794-fd57-4215-a997-39059f213a15] Updating instance_info_cache with network_info: [{"id": "e5721964-4792-4d0a-bae4-107701dbfabd", "address": "fa:16:3e:d9:0a:4b", "network": {"id": "72a6c745-f95a-4734-83b4-d013a21fdc9e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e74ab11f44a44d9a834e80f2683d87d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5721964-47", "ovs_interfaceid": "e5721964-4792-4d0a-bae4-107701dbfabd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:48:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f00508e9-b633-462f-b059-8929660787c4 req-2cf08840-78ce-4a43-b177-8b3adb4c6672 service nova] Releasing lock "refresh_cache-c1546794-fd57-4215-a997-39059f213a15" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:48:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:43 user nova-compute[73056]: DEBUG nova.compute.manager [req-fce0db09-3432-4ccd-a0ac-ed6d2534e384 req-def1eceb-bf89-482c-8a2f-eb90b7ab81c5 service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Received event network-vif-plugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:48:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-fce0db09-3432-4ccd-a0ac-ed6d2534e384 req-def1eceb-bf89-482c-8a2f-eb90b7ab81c5 service nova] Acquiring lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:48:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-fce0db09-3432-4ccd-a0ac-ed6d2534e384 req-def1eceb-bf89-482c-8a2f-eb90b7ab81c5 service nova] Lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:48:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-fce0db09-3432-4ccd-a0ac-ed6d2534e384 req-def1eceb-bf89-482c-8a2f-eb90b7ab81c5 service nova] Lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:48:43 user nova-compute[73056]: DEBUG nova.compute.manager [req-fce0db09-3432-4ccd-a0ac-ed6d2534e384 req-def1eceb-bf89-482c-8a2f-eb90b7ab81c5 service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] No waiting events found dispatching network-vif-plugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:48:43 user nova-compute[73056]: WARNING nova.compute.manager [req-fce0db09-3432-4ccd-a0ac-ed6d2534e384 req-def1eceb-bf89-482c-8a2f-eb90b7ab81c5 service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Received unexpected event network-vif-plugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 for instance with vm_state active and task_state rescuing.
Aug 14 16:48:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:43 user nova-compute[73056]: DEBUG nova.compute.manager [req-49eb6ba7-b0ae-4d30-8531-dffd332b2fa6 req-fed659b1-c696-4845-a268-9b20cca1078d service nova] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Received event network-changed-312bec25-d19f-423b-aca3-a4117119fc1f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:48:43 user nova-compute[73056]: DEBUG nova.compute.manager [req-49eb6ba7-b0ae-4d30-8531-dffd332b2fa6 req-fed659b1-c696-4845-a268-9b20cca1078d service nova] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Refreshing instance network info cache due to event network-changed-312bec25-d19f-423b-aca3-a4117119fc1f. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:48:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-49eb6ba7-b0ae-4d30-8531-dffd332b2fa6 req-fed659b1-c696-4845-a268-9b20cca1078d service nova] Acquiring lock "refresh_cache-9f3a7f8a-e3b9-4918-9663-968677fe5c90" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:48:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-49eb6ba7-b0ae-4d30-8531-dffd332b2fa6 req-fed659b1-c696-4845-a268-9b20cca1078d service nova] Acquired lock "refresh_cache-9f3a7f8a-e3b9-4918-9663-968677fe5c90" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:48:43 user nova-compute[73056]: DEBUG nova.network.neutron [req-49eb6ba7-b0ae-4d30-8531-dffd332b2fa6 req-fed659b1-c696-4845-a268-9b20cca1078d service nova] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Refreshing network info cache for port 312bec25-d19f-423b-aca3-a4117119fc1f {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:48:44 user nova-compute[73056]: DEBUG nova.network.neutron [req-49eb6ba7-b0ae-4d30-8531-dffd332b2fa6 req-fed659b1-c696-4845-a268-9b20cca1078d service nova] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Updated VIF entry in instance network info cache for port 312bec25-d19f-423b-aca3-a4117119fc1f. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:48:44 user nova-compute[73056]: DEBUG nova.network.neutron [req-49eb6ba7-b0ae-4d30-8531-dffd332b2fa6 req-fed659b1-c696-4845-a268-9b20cca1078d service nova] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Updating instance_info_cache with network_info: [{"id": "312bec25-d19f-423b-aca3-a4117119fc1f", "address": "fa:16:3e:03:ce:11", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312bec25-d1", "ovs_interfaceid": "312bec25-d19f-423b-aca3-a4117119fc1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:48:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-49eb6ba7-b0ae-4d30-8531-dffd332b2fa6 req-fed659b1-c696-4845-a268-9b20cca1078d service nova] Releasing lock "refresh_cache-9f3a7f8a-e3b9-4918-9663-968677fe5c90" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:48:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:45 user nova-compute[73056]: DEBUG nova.compute.manager [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Stashing vm_state: active {{(pid=73056) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 14 16:48:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:48:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:48:45 user nova-compute[73056]: DEBUG nova.objects.instance [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lazy-loading 'pci_requests' on Instance uuid d79c2f2c-0870-4d8e-b468-36e63496b769 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:48:45 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:48:45 user nova-compute[73056]: INFO nova.compute.claims [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Claim successful on node user
Aug 14 16:48:45 user nova-compute[73056]: DEBUG nova.objects.instance [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lazy-loading 'resources' on Instance uuid d79c2f2c-0870-4d8e-b468-36e63496b769 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:48:45 user nova-compute[73056]: DEBUG nova.objects.instance [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lazy-loading 'pci_devices' on Instance uuid d79c2f2c-0870-4d8e-b468-36e63496b769 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:48:45 user nova-compute[73056]: DEBUG nova.compute.manager [req-2ecc5b9c-069f-4eae-a633-a0e4bacb3c57 req-2dcf21f6-c987-4528-a682-9f85e0e939e1 service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Received event network-vif-plugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:48:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2ecc5b9c-069f-4eae-a633-a0e4bacb3c57 req-2dcf21f6-c987-4528-a682-9f85e0e939e1 service nova] Acquiring lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:48:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2ecc5b9c-069f-4eae-a633-a0e4bacb3c57 req-2dcf21f6-c987-4528-a682-9f85e0e939e1 service nova] Lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:48:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2ecc5b9c-069f-4eae-a633-a0e4bacb3c57 req-2dcf21f6-c987-4528-a682-9f85e0e939e1 service nova] Lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:48:45 user nova-compute[73056]: DEBUG nova.compute.manager [req-2ecc5b9c-069f-4eae-a633-a0e4bacb3c57 req-2dcf21f6-c987-4528-a682-9f85e0e939e1 service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] No waiting events found dispatching network-vif-plugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:48:45 user nova-compute[73056]: WARNING nova.compute.manager [req-2ecc5b9c-069f-4eae-a633-a0e4bacb3c57 req-2dcf21f6-c987-4528-a682-9f85e0e939e1 service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Received unexpected event network-vif-plugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 for instance with vm_state active and task_state rescuing.
Aug 14 16:48:45 user nova-compute[73056]: DEBUG nova.compute.manager [req-2ecc5b9c-069f-4eae-a633-a0e4bacb3c57 req-2dcf21f6-c987-4528-a682-9f85e0e939e1 service nova] [instance: c1546794-fd57-4215-a997-39059f213a15] Received event network-vif-plugged-e5721964-4792-4d0a-bae4-107701dbfabd {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:48:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2ecc5b9c-069f-4eae-a633-a0e4bacb3c57 req-2dcf21f6-c987-4528-a682-9f85e0e939e1 service nova] Acquiring lock "c1546794-fd57-4215-a997-39059f213a15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:48:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2ecc5b9c-069f-4eae-a633-a0e4bacb3c57 req-2dcf21f6-c987-4528-a682-9f85e0e939e1 service nova] Lock "c1546794-fd57-4215-a997-39059f213a15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:48:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2ecc5b9c-069f-4eae-a633-a0e4bacb3c57 req-2dcf21f6-c987-4528-a682-9f85e0e939e1 service nova] Lock "c1546794-fd57-4215-a997-39059f213a15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:48:45 user nova-compute[73056]: DEBUG nova.compute.manager [req-2ecc5b9c-069f-4eae-a633-a0e4bacb3c57 req-2dcf21f6-c987-4528-a682-9f85e0e939e1 service nova] [instance: c1546794-fd57-4215-a997-39059f213a15] No waiting events found dispatching network-vif-plugged-e5721964-4792-4d0a-bae4-107701dbfabd {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:48:45 user nova-compute[73056]: WARNING nova.compute.manager [req-2ecc5b9c-069f-4eae-a633-a0e4bacb3c57 req-2dcf21f6-c987-4528-a682-9f85e0e939e1 service nova] [instance: c1546794-fd57-4215-a997-39059f213a15] Received unexpected event network-vif-plugged-e5721964-4792-4d0a-bae4-107701dbfabd for instance with vm_state building and task_state spawning.
Aug 14 16:48:45 user nova-compute[73056]: DEBUG nova.compute.manager [req-2ecc5b9c-069f-4eae-a633-a0e4bacb3c57 req-2dcf21f6-c987-4528-a682-9f85e0e939e1 service nova] [instance: c1546794-fd57-4215-a997-39059f213a15] Received event network-vif-plugged-e5721964-4792-4d0a-bae4-107701dbfabd {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:48:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2ecc5b9c-069f-4eae-a633-a0e4bacb3c57 req-2dcf21f6-c987-4528-a682-9f85e0e939e1 service nova] Acquiring lock "c1546794-fd57-4215-a997-39059f213a15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:48:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2ecc5b9c-069f-4eae-a633-a0e4bacb3c57 req-2dcf21f6-c987-4528-a682-9f85e0e939e1 service nova] Lock "c1546794-fd57-4215-a997-39059f213a15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:48:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2ecc5b9c-069f-4eae-a633-a0e4bacb3c57 req-2dcf21f6-c987-4528-a682-9f85e0e939e1 service nova] Lock "c1546794-fd57-4215-a997-39059f213a15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:48:45 user nova-compute[73056]: DEBUG nova.compute.manager [req-2ecc5b9c-069f-4eae-a633-a0e4bacb3c57 req-2dcf21f6-c987-4528-a682-9f85e0e939e1 service nova] [instance: c1546794-fd57-4215-a997-39059f213a15] No waiting events found dispatching network-vif-plugged-e5721964-4792-4d0a-bae4-107701dbfabd {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:48:45 user nova-compute[73056]: WARNING nova.compute.manager [req-2ecc5b9c-069f-4eae-a633-a0e4bacb3c57 req-2dcf21f6-c987-4528-a682-9f85e0e939e1 service nova] [instance: c1546794-fd57-4215-a997-39059f213a15] Received unexpected event network-vif-plugged-e5721964-4792-4d0a-bae4-107701dbfabd for instance with vm_state building and task_state spawning.
Aug 14 16:48:45 user nova-compute[73056]: INFO nova.compute.resource_tracker [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Updating resource usage from migration 122b3979-ee5c-4c34-acdc-1d30b77eb2ed
Aug 14 16:48:45 user nova-compute[73056]: DEBUG nova.compute.manager [req-9ea7d591-5e67-49fa-b04a-be9256986d8c req-d5d394f6-5b32-4a21-98e1-45493e9851b7 service nova] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Received event network-changed-c7a36ac9-68dc-462c-9e90-4eb844971548 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:48:45 user nova-compute[73056]: DEBUG nova.compute.manager [req-9ea7d591-5e67-49fa-b04a-be9256986d8c req-d5d394f6-5b32-4a21-98e1-45493e9851b7 service nova] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Refreshing instance network info cache due to event network-changed-c7a36ac9-68dc-462c-9e90-4eb844971548. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:48:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9ea7d591-5e67-49fa-b04a-be9256986d8c req-d5d394f6-5b32-4a21-98e1-45493e9851b7 service nova] Acquiring lock "refresh_cache-d79c2f2c-0870-4d8e-b468-36e63496b769" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:48:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9ea7d591-5e67-49fa-b04a-be9256986d8c req-d5d394f6-5b32-4a21-98e1-45493e9851b7 service nova] Acquired lock "refresh_cache-d79c2f2c-0870-4d8e-b468-36e63496b769" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:48:45 user nova-compute[73056]: DEBUG nova.network.neutron [req-9ea7d591-5e67-49fa-b04a-be9256986d8c req-d5d394f6-5b32-4a21-98e1-45493e9851b7 service nova] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Refreshing network info cache for port c7a36ac9-68dc-462c-9e90-4eb844971548 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:48:46 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:48:46 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:48:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.580s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:48:46 user nova-compute[73056]: INFO nova.compute.manager [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Migrating
Aug 14 16:48:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "refresh_cache-d79c2f2c-0870-4d8e-b468-36e63496b769" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:48:46 user nova-compute[73056]: DEBUG nova.network.neutron [req-9ea7d591-5e67-49fa-b04a-be9256986d8c req-d5d394f6-5b32-4a21-98e1-45493e9851b7 service nova] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Updated VIF entry in instance network info cache for port c7a36ac9-68dc-462c-9e90-4eb844971548. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:48:46 user nova-compute[73056]: DEBUG nova.network.neutron [req-9ea7d591-5e67-49fa-b04a-be9256986d8c req-d5d394f6-5b32-4a21-98e1-45493e9851b7 service nova] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Updating instance_info_cache with network_info: [{"id": "c7a36ac9-68dc-462c-9e90-4eb844971548", "address": "fa:16:3e:44:b8:c2", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a36ac9-68", "ovs_interfaceid": "c7a36ac9-68dc-462c-9e90-4eb844971548", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:48:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9ea7d591-5e67-49fa-b04a-be9256986d8c req-d5d394f6-5b32-4a21-98e1-45493e9851b7 service nova] Releasing lock "refresh_cache-d79c2f2c-0870-4d8e-b468-36e63496b769" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:48:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquired lock "refresh_cache-d79c2f2c-0870-4d8e-b468-36e63496b769" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:48:46 user nova-compute[73056]: DEBUG nova.network.neutron [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:48:46 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Removed pending event for b580e3d0-88b5-42a3-a953-84b94c088f41 due to event {{(pid=73056) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 16:48:46 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031726.7307584, b580e3d0-88b5-42a3-a953-84b94c088f41 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:48:46 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] VM Resumed (Lifecycle Event)
Aug 14 16:48:46 user nova-compute[73056]: DEBUG nova.compute.manager [None req-0d101733-e3da-460f-b8ce-c6f189d0536c tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:48:46 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:48:46 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:48:46 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 16:48:46 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031726.7337153, b580e3d0-88b5-42a3-a953-84b94c088f41 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:48:46 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] VM Started (Lifecycle Event)
Aug 14 16:48:46 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:48:46 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:48:46 user nova-compute[73056]: DEBUG nova.network.neutron [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Updating instance_info_cache with network_info: [{"id": "c7a36ac9-68dc-462c-9e90-4eb844971548", "address": "fa:16:3e:44:b8:c2", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a36ac9-68", "ovs_interfaceid": "c7a36ac9-68dc-462c-9e90-4eb844971548", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:48:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Releasing lock "refresh_cache-d79c2f2c-0870-4d8e-b468-36e63496b769" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:48:46 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Starting migrate_disk_and_power_off {{(pid=73056) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031727.2186985, c1546794-fd57-4215-a997-39059f213a15 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:48:47 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: c1546794-fd57-4215-a997-39059f213a15] VM Resumed (Lifecycle Event)
Aug 14 16:48:47 user nova-compute[73056]: DEBUG nova.compute.manager [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] [instance: c1546794-fd57-4215-a997-39059f213a15] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] [instance: c1546794-fd57-4215-a997-39059f213a15] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: c1546794-fd57-4215-a997-39059f213a15] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:48:47 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: c1546794-fd57-4215-a997-39059f213a15] Instance spawned successfully.
Aug 14 16:48:47 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] [instance: c1546794-fd57-4215-a997-39059f213a15] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: c1546794-fd57-4215-a997-39059f213a15] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] [instance: c1546794-fd57-4215-a997-39059f213a15] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] [instance: c1546794-fd57-4215-a997-39059f213a15] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] [instance: c1546794-fd57-4215-a997-39059f213a15] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] [instance: c1546794-fd57-4215-a997-39059f213a15] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] [instance: c1546794-fd57-4215-a997-39059f213a15] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] [instance: c1546794-fd57-4215-a997-39059f213a15] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:47 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: c1546794-fd57-4215-a997-39059f213a15] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:48:47 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031727.2271345, c1546794-fd57-4215-a997-39059f213a15 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:48:47 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: c1546794-fd57-4215-a997-39059f213a15] VM Started (Lifecycle Event)
Aug 14 16:48:47 user nova-compute[73056]: DEBUG nova.compute.manager [req-2d1842e7-ad21-4dd6-ac67-0f2855d945c9 req-b29d6d43-ea1e-4d89-a7b4-3de95a985fef service nova] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Received event network-vif-unplugged-c7a36ac9-68dc-462c-9e90-4eb844971548 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2d1842e7-ad21-4dd6-ac67-0f2855d945c9 req-b29d6d43-ea1e-4d89-a7b4-3de95a985fef service nova] Acquiring lock "d79c2f2c-0870-4d8e-b468-36e63496b769-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2d1842e7-ad21-4dd6-ac67-0f2855d945c9 req-b29d6d43-ea1e-4d89-a7b4-3de95a985fef service nova] Lock "d79c2f2c-0870-4d8e-b468-36e63496b769-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2d1842e7-ad21-4dd6-ac67-0f2855d945c9 req-b29d6d43-ea1e-4d89-a7b4-3de95a985fef service nova] Lock "d79c2f2c-0870-4d8e-b468-36e63496b769-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG nova.compute.manager [req-2d1842e7-ad21-4dd6-ac67-0f2855d945c9 req-b29d6d43-ea1e-4d89-a7b4-3de95a985fef service nova] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] No waiting events found dispatching network-vif-unplugged-c7a36ac9-68dc-462c-9e90-4eb844971548 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:48:47 user nova-compute[73056]: WARNING nova.compute.manager [req-2d1842e7-ad21-4dd6-ac67-0f2855d945c9 req-b29d6d43-ea1e-4d89-a7b4-3de95a985fef service nova] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Received unexpected event network-vif-unplugged-c7a36ac9-68dc-462c-9e90-4eb844971548 for instance with vm_state active and task_state resize_migrating.
Aug 14 16:48:47 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: c1546794-fd57-4215-a997-39059f213a15] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: c1546794-fd57-4215-a997-39059f213a15] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:48:47 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: c1546794-fd57-4215-a997-39059f213a15] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:48:47 user nova-compute[73056]: INFO nova.compute.manager [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] [instance: c1546794-fd57-4215-a997-39059f213a15] Took 8.78 seconds to spawn the instance on the hypervisor.
Aug 14 16:48:47 user nova-compute[73056]: DEBUG nova.compute.manager [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] [instance: c1546794-fd57-4215-a997-39059f213a15] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:48:47 user nova-compute[73056]: INFO nova.compute.manager [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] [instance: c1546794-fd57-4215-a997-39059f213a15] Took 9.95 seconds to build instance.
Aug 14 16:48:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ea06920d-beb6-43cf-90d0-75181404d118 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Lock "c1546794-fd57-4215-a997-39059f213a15" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.083s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:47 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Instance destroyed successfully.
Aug 14 16:48:47 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:46:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1030984807',display_name='tempest-ServerActionsTestOtherA-server-1030984807',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1030984807',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDU6ne8W7YSxsWIOL2ltT8/3A4Lay+Fa3EBjGBahsu1+va9jX8aVIvfUTXS/QOiNmJPitbbWTrcI3+h3fj8j4zOwrNCeF7Pt0QIdwz/ogo81jcw9PMYL2yia/QSf+KeHhA==',key_name='tempest-keypair-1415046919',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:47:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2dd5723fb8384aa985cf401d95aa7d08',ramdisk_id='',reservation_id='r-fwp2qpkf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-380813086',owner_user_name='tempest-ServerActionsTestOtherA-380813086-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:48:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9404ed7386e14eed8d046e8c45942c75',uuid=d79c2f2c-0870-4d8e-b468-36e63496b769,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7a36ac9-68dc-462c-9e90-4eb844971548", "address": "fa:16:3e:44:b8:c2", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-51574813-network", "vif_mac": "fa:16:3e:44:b8:c2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a36ac9-68", "ovs_interfaceid": "c7a36ac9-68dc-462c-9e90-4eb844971548", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Converting VIF {"id": "c7a36ac9-68dc-462c-9e90-4eb844971548", "address": "fa:16:3e:44:b8:c2", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-51574813-network", "vif_mac": "fa:16:3e:44:b8:c2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a36ac9-68", "ovs_interfaceid": "c7a36ac9-68dc-462c-9e90-4eb844971548", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:b8:c2,bridge_name='br-int',has_traffic_filtering=True,id=c7a36ac9-68dc-462c-9e90-4eb844971548,network=Network(2c5f0d57-9485-4a0b-a847-49eea5cd17c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7a36ac9-68') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG os_vif [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:b8:c2,bridge_name='br-int',has_traffic_filtering=True,id=c7a36ac9-68dc-462c-9e90-4eb844971548,network=Network(2c5f0d57-9485-4a0b-a847-49eea5cd17c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7a36ac9-68') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7a36ac9-68, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:48:47 user nova-compute[73056]: INFO os_vif [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:b8:c2,bridge_name='br-int',has_traffic_filtering=True,id=c7a36ac9-68dc-462c-9e90-4eb844971548,network=Network(2c5f0d57-9485-4a0b-a847-49eea5cd17c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7a36ac9-68')
Aug 14 16:48:47 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qsfKthHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:48:47 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:48:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b69fa0-0292-4504-b055-027dbcddb332]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[692f7b30-6bea-443d-bfb6-0843044e3db8]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:48:47 user nova-compute[73056]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:48:47 user nova-compute[73056]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)
Aug 14 16:48:47 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:48:47 user nova-compute[73056]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:48:47 user nova-compute[73056]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)
Aug 14 16:48:47 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff300201870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603'): ({'sde'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Removing single pathed devices sde {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a404460e-b402-4d6f-b7d0-5dcc09b7785b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c86bbd-1584-47e9-902e-665c457567a9]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Flushing IO for device /dev/sde {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09ac121-7c04-49f7-be2b-c9153ae393e8]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d31ac8-9b49-4f30-a607-5d2d1be2fb1b]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] SCSI volumes sde have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:48:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:48 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d47f121-35fd-4fd3-9729-28e2860a0688]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:48:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:48:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:48 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab12927-6c57-41f6-aec1-ce37c760ecec]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:48:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603, portal: 172.16.0.220,3260]
Aug 14 16:48:48 user nova-compute[73056]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603, portal: 172.16.0.220,3260] successful.
Aug 14 16:48:48 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:48:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:48 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a720f22c-5338-4df4-bf20-1359152cfea5]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:48:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:48:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:48:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] <== disconnect_volume: return (360ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:48:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:48:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:48:49 user nova-compute[73056]: DEBUG nova.compute.manager [req-cf459e4c-a4f3-4650-81d5-0bd201cf14bd req-e745486a-605b-46d1-b9ca-b6afc95cfa50 service nova] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Received event network-vif-plugged-c7a36ac9-68dc-462c-9e90-4eb844971548 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:48:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cf459e4c-a4f3-4650-81d5-0bd201cf14bd req-e745486a-605b-46d1-b9ca-b6afc95cfa50 service nova] Acquiring lock "d79c2f2c-0870-4d8e-b468-36e63496b769-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:48:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cf459e4c-a4f3-4650-81d5-0bd201cf14bd req-e745486a-605b-46d1-b9ca-b6afc95cfa50 service nova] Lock "d79c2f2c-0870-4d8e-b468-36e63496b769-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:48:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cf459e4c-a4f3-4650-81d5-0bd201cf14bd req-e745486a-605b-46d1-b9ca-b6afc95cfa50 service nova] Lock "d79c2f2c-0870-4d8e-b468-36e63496b769-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:48:49 user nova-compute[73056]: DEBUG nova.compute.manager [req-cf459e4c-a4f3-4650-81d5-0bd201cf14bd req-e745486a-605b-46d1-b9ca-b6afc95cfa50 service nova] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] No waiting events found dispatching network-vif-plugged-c7a36ac9-68dc-462c-9e90-4eb844971548 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:48:49 user nova-compute[73056]: WARNING nova.compute.manager [req-cf459e4c-a4f3-4650-81d5-0bd201cf14bd req-e745486a-605b-46d1-b9ca-b6afc95cfa50 service nova] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Received unexpected event network-vif-plugged-c7a36ac9-68dc-462c-9e90-4eb844971548 for instance with vm_state active and task_state resize_migrating.
Aug 14 16:48:49 user nova-compute[73056]: DEBUG nova.network.neutron [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Port c7a36ac9-68dc-462c-9e90-4eb844971548 binding to destination host user is already ACTIVE {{(pid=73056) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 14 16:48:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "d79c2f2c-0870-4d8e-b468-36e63496b769-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:48:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "d79c2f2c-0870-4d8e-b468-36e63496b769-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:48:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "d79c2f2c-0870-4d8e-b468-36e63496b769-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:48:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "refresh_cache-d79c2f2c-0870-4d8e-b468-36e63496b769" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:48:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquired lock "refresh_cache-d79c2f2c-0870-4d8e-b468-36e63496b769" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:48:49 user nova-compute[73056]: DEBUG nova.network.neutron [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:48:50 user nova-compute[73056]: DEBUG nova.network.neutron [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Updating instance_info_cache with network_info: [{"id": "c7a36ac9-68dc-462c-9e90-4eb844971548", "address": "fa:16:3e:44:b8:c2", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a36ac9-68", "ovs_interfaceid": "c7a36ac9-68dc-462c-9e90-4eb844971548", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:48:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Releasing lock "refresh_cache-d79c2f2c-0870-4d8e-b468-36e63496b769" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:48:50 user nova-compute[73056]: DEBUG os_brick.utils [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:48:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:50 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[477b8e75-8ee5-489d-ab54-09954dbd8040]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:48:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:50 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6a15ef-7ae2-416e-b55c-4edff15d80a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:48:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:50 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b17335-f901-4892-a1cd-1ebf32c6f0eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:48:50 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f043bff9-3ef6-42ef-a6a9-a0f0c8fc3d10]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:48:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:48:50 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:48:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:50 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:48:50 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:48:50 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bce236d-6cf5-4470-886b-e828a8c638bc]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:48:50 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:48:50 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:48:50 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:48:50 user nova-compute[73056]: DEBUG os_brick.utils [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:48:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "9910444a-33ee-4937-9073-3b1f4d2f2fe9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:48:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "9910444a-33ee-4937-9073-3b1f4d2f2fe9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:48:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:52 user nova-compute[73056]: DEBUG nova.compute.manager [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:48:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:48:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:48:52 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:48:52 user nova-compute[73056]: INFO nova.compute.claims [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Claim successful on node user
Aug 14 16:48:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:53 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:48:53 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:48:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.526s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:48:53 user nova-compute[73056]: DEBUG nova.compute.manager [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:48:53 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:48:53 user nova-compute[73056]: DEBUG nova.compute.manager [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:48:53 user nova-compute[73056]: DEBUG nova.network.neutron [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:48:53 user nova-compute[73056]: DEBUG nova.compute.manager [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:48:53 user nova-compute[73056]: INFO nova.virt.block_device [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Booting with volume snapshot 2154bc49-db22-471f-8b25-2be260ada5da at /dev/vda
Aug 14 16:48:53 user nova-compute[73056]: DEBUG nova.policy [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2be1b098ca9f4232bd198b515630f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffb5203b9284500b8add8a6586cad49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:48:54 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:48:54 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 16:48:54 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692031719.502447, d5dbfa63-5061-4304-b8eb-4565ad9f0a96 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:48:54 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] VM Stopped (Lifecycle Event)
Aug 14 16:48:54 user nova-compute[73056]: DEBUG nova.compute.manager [None req-34e2538c-5727-4e8b-a5bc-2de5584d1051 None None] [instance: d5dbfa63-5061-4304-b8eb-4565ad9f0a96] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:48:54 user nova-compute[73056]: DEBUG nova.network.neutron [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Successfully created port: 57b63084-60a4-44c3-bfc8-6bc91aaedc95 {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:48:55 user nova-compute[73056]: DEBUG nova.network.neutron [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Successfully updated port: 57b63084-60a4-44c3-bfc8-6bc91aaedc95 {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:48:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "refresh_cache-9910444a-33ee-4937-9073-3b1f4d2f2fe9" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:48:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquired lock "refresh_cache-9910444a-33ee-4937-9073-3b1f4d2f2fe9" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:48:55 user nova-compute[73056]: DEBUG nova.network.neutron [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:48:55 user nova-compute[73056]: DEBUG nova.compute.manager [req-b18f8b9a-7bb5-421d-9dd5-46150770772f req-aa14d66d-d9f8-42cb-84b8-c0eebe57645f service nova] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Received event network-changed-57b63084-60a4-44c3-bfc8-6bc91aaedc95 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:48:55 user nova-compute[73056]: DEBUG nova.compute.manager [req-b18f8b9a-7bb5-421d-9dd5-46150770772f req-aa14d66d-d9f8-42cb-84b8-c0eebe57645f service nova] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Refreshing instance network info cache due to event network-changed-57b63084-60a4-44c3-bfc8-6bc91aaedc95. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:48:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-b18f8b9a-7bb5-421d-9dd5-46150770772f req-aa14d66d-d9f8-42cb-84b8-c0eebe57645f service nova] Acquiring lock "refresh_cache-9910444a-33ee-4937-9073-3b1f4d2f2fe9" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:48:55 user nova-compute[73056]: DEBUG nova.network.neutron [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:48:55 user nova-compute[73056]: DEBUG nova.network.neutron [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Updating instance_info_cache with network_info: [{"id": "57b63084-60a4-44c3-bfc8-6bc91aaedc95", "address": "fa:16:3e:21:99:e6", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57b63084-60", "ovs_interfaceid": "57b63084-60a4-44c3-bfc8-6bc91aaedc95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:48:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Releasing lock "refresh_cache-9910444a-33ee-4937-9073-3b1f4d2f2fe9" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:48:55 user nova-compute[73056]: DEBUG nova.compute.manager [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Instance network_info: |[{"id": "57b63084-60a4-44c3-bfc8-6bc91aaedc95", "address": "fa:16:3e:21:99:e6", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57b63084-60", "ovs_interfaceid": "57b63084-60a4-44c3-bfc8-6bc91aaedc95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:48:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-b18f8b9a-7bb5-421d-9dd5-46150770772f req-aa14d66d-d9f8-42cb-84b8-c0eebe57645f service nova] Acquired lock "refresh_cache-9910444a-33ee-4937-9073-3b1f4d2f2fe9" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:48:55 user nova-compute[73056]: DEBUG nova.network.neutron [req-b18f8b9a-7bb5-421d-9dd5-46150770772f req-aa14d66d-d9f8-42cb-84b8-c0eebe57645f service nova] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Refreshing network info cache for port 57b63084-60a4-44c3-bfc8-6bc91aaedc95 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:48:56 user nova-compute[73056]: DEBUG nova.network.neutron [req-b18f8b9a-7bb5-421d-9dd5-46150770772f req-aa14d66d-d9f8-42cb-84b8-c0eebe57645f service nova] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Updated VIF entry in instance network info cache for port 57b63084-60a4-44c3-bfc8-6bc91aaedc95. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:48:56 user nova-compute[73056]: DEBUG nova.network.neutron [req-b18f8b9a-7bb5-421d-9dd5-46150770772f req-aa14d66d-d9f8-42cb-84b8-c0eebe57645f service nova] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Updating instance_info_cache with network_info: [{"id": "57b63084-60a4-44c3-bfc8-6bc91aaedc95", "address": "fa:16:3e:21:99:e6", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57b63084-60", "ovs_interfaceid": "57b63084-60a4-44c3-bfc8-6bc91aaedc95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:48:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-b18f8b9a-7bb5-421d-9dd5-46150770772f req-aa14d66d-d9f8-42cb-84b8-c0eebe57645f service nova] Releasing lock "refresh_cache-9910444a-33ee-4937-9073-3b1f4d2f2fe9" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:48:56 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:48:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:48:59 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:48:59 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 16:48:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-b580e3d0-88b5-42a3-a953-84b94c088f41" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:48:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-b580e3d0-88b5-42a3-a953-84b94c088f41" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:48:59 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 16:48:59 user nova-compute[73056]: DEBUG os_brick.utils [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:48:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:59 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[11416b83-ef83-4363-9464-dfaa4319fc69]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:48:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.027s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:59 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad4da93-da28-491d-8889-4f3364a8829e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:48:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:48:59 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30355f1-0992-42a6-b55f-9bb397446c42]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:48:59 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b0584b-ea90-4c1b-b41f-9f4332d84233]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:48:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:48:59 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:48:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:48:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:48:59 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:48:59 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a8cd00-fb39-4104-9b11-c51750b04776]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:48:59 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:48:59 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:48:59 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:48:59 user nova-compute[73056]: DEBUG os_brick.utils [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:48:59 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Updating existing volume attachment record: 8243688d-7ba0-48a9-8715-df80bd4922e1 {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Updating instance_info_cache with network_info: [{"id": "b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0", "address": "fa:16:3e:f9:ca:00", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb006576a-8b", "ovs_interfaceid": "b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-b580e3d0-88b5-42a3-a953-84b94c088f41" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Starting finish_migration {{(pid=73056) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Instance directory exists: not creating {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 16:49:00 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Creating image(s)
Aug 14 16:49:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Did not create local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Ensure instance console log exists: /opt/stack/data/nova/instances/d79c2f2c-0870-4d8e-b468-36e63496b769/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Start _get_guest_xml network_info=[{"id": "c7a36ac9-68dc-462c-9e90-4eb844971548", "address": "fa:16:3e:44:b8:c2", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-51574813-network", "vif_mac": "fa:16:3e:44:b8:c2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a36ac9-68", "ovs_interfaceid": "c7a36ac9-68dc-462c-9e90-4eb844971548", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qsfKthHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'd79c2f2c-0870-4d8e-b468-36e63496b769', 'attached_at': '2023-08-14T16:49:00.000000', 'detached_at': '', 'volume_id': '523a4349-d411-42d5-82c8-e6182588a603', 'serial': '523a4349-d411-42d5-82c8-e6182588a603'}, 'attachment_id': '2da39d01-6055-45d0-a223-45c257ab3a66', 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:49:00 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:49:00 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:49:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG nova.objects.instance [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lazy-loading 'vcpu_model' on Instance uuid d79c2f2c-0870-4d8e-b468-36e63496b769 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qsfKthHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:49:00 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:49:00 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:49:00 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:49:00 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:49:00 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:49:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bc11d2-a694-4443-a924-d4845f9632c5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:49:00 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[adeef3e0-f30b-449c-87b9-cf27898cad2e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603] added
Aug 14 16:49:00 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[0908d812-5580-43fb-a611-1bf78b98c09d]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[19102d7e-86b1-4b07-b221-0834d608d414]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qsfKthHT {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qsfKthHT" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab96c1c-283a-4f78-a5c7-71138336aff0]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qsfKthHT'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6b5019-8773-416b-894b-f98be1c5af74]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c08de88-1859-42b0-809d-5af2f167e541]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:49:00 user nova-compute[73056]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)
Aug 14 16:49:00 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:49:00 user nova-compute[73056]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)
Aug 14 16:49:00 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb105715-6727-4572-a07c-3dd9d79ac02b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603, portal: 172.16.0.220,3260]
Aug 14 16:49:01 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603, portal: 172.16.0.220,3260] successful.
Aug 14 16:49:01 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:49:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed58737-ce8c-4e4d-971a-fa58438c0f05]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:49:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0820b58-bd23-4296-a275-d87e8922154a]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:49:01 user nova-compute[73056]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)
Aug 14 16:49:01 user nova-compute[73056]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:49:01 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:49:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:49:01 user nova-compute[73056]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)
Aug 14 16:49:01 user nova-compute[73056]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:49:01 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:49:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:49:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:49:01 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:49:01 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:49:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d53537-c3c5-401f-9817-a74209ec5ece]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:01 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:49:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qsfKthHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:49:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json" returned: 0 in 0.341s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:49:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] <== connect_volume: return (1392ms) {'type': 'block', 'scsi_wwn': '23932653739666532', 'path': '/dev/sdb'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:49:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932653739666532', 'path': '/dev/sdb'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:49:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:46:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1030984807',display_name='tempest-ServerActionsTestOtherA-server-1030984807',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1030984807',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDU6ne8W7YSxsWIOL2ltT8/3A4Lay+Fa3EBjGBahsu1+va9jX8aVIvfUTXS/QOiNmJPitbbWTrcI3+h3fj8j4zOwrNCeF7Pt0QIdwz/ogo81jcw9PMYL2yia/QSf+KeHhA==',key_name='tempest-keypair-1415046919',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:47:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2dd5723fb8384aa985cf401d95aa7d08',ramdisk_id='',reservation_id='r-fwp2qpkf',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-380813086',owner_user_name='tempest-ServerActionsTestOtherA-380813086-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:48:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9404ed7386e14eed8d046e8c45942c75',uuid=d79c2f2c-0870-4d8e-b468-36e63496b769,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7a36ac9-68dc-462c-9e90-4eb844971548", "address": "fa:16:3e:44:b8:c2", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-51574813-network", "vif_mac": "fa:16:3e:44:b8:c2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a36ac9-68", "ovs_interfaceid": "c7a36ac9-68dc-462c-9e90-4eb844971548", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:49:02 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Converting VIF {"id": "c7a36ac9-68dc-462c-9e90-4eb844971548", "address": "fa:16:3e:44:b8:c2", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-51574813-network", "vif_mac": "fa:16:3e:44:b8:c2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a36ac9-68", "ovs_interfaceid": "c7a36ac9-68dc-462c-9e90-4eb844971548", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:49:02 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:b8:c2,bridge_name='br-int',has_traffic_filtering=True,id=c7a36ac9-68dc-462c-9e90-4eb844971548,network=Network(2c5f0d57-9485-4a0b-a847-49eea5cd17c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7a36ac9-68') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:49:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:49:02 user nova-compute[73056]:   <uuid>d79c2f2c-0870-4d8e-b468-36e63496b769</uuid>
Aug 14 16:49:02 user nova-compute[73056]:   <name>instance-0000001b</name>
Aug 14 16:49:02 user nova-compute[73056]:   <memory>2097152</memory>
Aug 14 16:49:02 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:49:02 user nova-compute[73056]:   <metadata>
Aug 14 16:49:02 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:49:02 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:49:02 user nova-compute[73056]:       <nova:name>tempest-ServerActionsTestOtherA-server-1030984807</nova:name>
Aug 14 16:49:02 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:49:00</nova:creationTime>
Aug 14 16:49:02 user nova-compute[73056]:       <nova:flavor name="m1.small">
Aug 14 16:49:02 user nova-compute[73056]:         <nova:memory>2048</nova:memory>
Aug 14 16:49:02 user nova-compute[73056]:         <nova:disk>20</nova:disk>
Aug 14 16:49:02 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:49:02 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:49:02 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:49:02 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:49:02 user nova-compute[73056]:       <nova:owner>
Aug 14 16:49:02 user nova-compute[73056]:         <nova:user uuid="9404ed7386e14eed8d046e8c45942c75">tempest-ServerActionsTestOtherA-380813086-project-member</nova:user>
Aug 14 16:49:02 user nova-compute[73056]:         <nova:project uuid="2dd5723fb8384aa985cf401d95aa7d08">tempest-ServerActionsTestOtherA-380813086</nova:project>
Aug 14 16:49:02 user nova-compute[73056]:       </nova:owner>
Aug 14 16:49:02 user nova-compute[73056]:       <nova:ports>
Aug 14 16:49:02 user nova-compute[73056]:         <nova:port uuid="c7a36ac9-68dc-462c-9e90-4eb844971548">
Aug 14 16:49:02 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 16:49:02 user nova-compute[73056]:         </nova:port>
Aug 14 16:49:02 user nova-compute[73056]:       </nova:ports>
Aug 14 16:49:02 user nova-compute[73056]:     </nova:instance>
Aug 14 16:49:02 user nova-compute[73056]:   </metadata>
Aug 14 16:49:02 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:49:02 user nova-compute[73056]:     <system>
Aug 14 16:49:02 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:49:02 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:49:02 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:49:02 user nova-compute[73056]:       <entry name="serial">d79c2f2c-0870-4d8e-b468-36e63496b769</entry>
Aug 14 16:49:02 user nova-compute[73056]:       <entry name="uuid">d79c2f2c-0870-4d8e-b468-36e63496b769</entry>
Aug 14 16:49:02 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:49:02 user nova-compute[73056]:     </system>
Aug 14 16:49:02 user nova-compute[73056]:   </sysinfo>
Aug 14 16:49:02 user nova-compute[73056]:   <os>
Aug 14 16:49:02 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:49:02 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:49:02 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:49:02 user nova-compute[73056]:   </os>
Aug 14 16:49:02 user nova-compute[73056]:   <features>
Aug 14 16:49:02 user nova-compute[73056]:     <acpi/>
Aug 14 16:49:02 user nova-compute[73056]:     <apic/>
Aug 14 16:49:02 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:49:02 user nova-compute[73056]:   </features>
Aug 14 16:49:02 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:49:02 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:49:02 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:49:02 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:49:02 user nova-compute[73056]:   </clock>
Aug 14 16:49:02 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:49:02 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:49:02 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:49:02 user nova-compute[73056]:   </cpu>
Aug 14 16:49:02 user nova-compute[73056]:   <devices>
Aug 14 16:49:02 user nova-compute[73056]:     <disk type="block" device="disk">
Aug 14 16:49:02 user nova-compute[73056]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:49:02 user nova-compute[73056]:       <source dev="/dev/sdb"/>
Aug 14 16:49:02 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:49:02 user nova-compute[73056]:       <serial>523a4349-d411-42d5-82c8-e6182588a603</serial>
Aug 14 16:49:02 user nova-compute[73056]:     </disk>
Aug 14 16:49:02 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:49:02 user nova-compute[73056]:       <mac address="fa:16:3e:44:b8:c2"/>
Aug 14 16:49:02 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:49:02 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:49:02 user nova-compute[73056]:       <target dev="tapc7a36ac9-68"/>
Aug 14 16:49:02 user nova-compute[73056]:     </interface>
Aug 14 16:49:02 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:49:02 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/d79c2f2c-0870-4d8e-b468-36e63496b769/console.log" append="off"/>
Aug 14 16:49:02 user nova-compute[73056]:     </serial>
Aug 14 16:49:02 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:49:02 user nova-compute[73056]:     <video>
Aug 14 16:49:02 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:49:02 user nova-compute[73056]:     </video>
Aug 14 16:49:02 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:49:02 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:49:02 user nova-compute[73056]:     </rng>
Aug 14 16:49:02 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:49:02 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:49:02 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:49:02 user nova-compute[73056]:     </memballoon>
Aug 14 16:49:02 user nova-compute[73056]:   </devices>
Aug 14 16:49:02 user nova-compute[73056]: </domain>
Aug 14 16:49:02 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:49:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:46:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1030984807',display_name='tempest-ServerActionsTestOtherA-server-1030984807',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1030984807',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDU6ne8W7YSxsWIOL2ltT8/3A4Lay+Fa3EBjGBahsu1+va9jX8aVIvfUTXS/QOiNmJPitbbWTrcI3+h3fj8j4zOwrNCeF7Pt0QIdwz/ogo81jcw9PMYL2yia/QSf+KeHhA==',key_name='tempest-keypair-1415046919',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:47:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2dd5723fb8384aa985cf401d95aa7d08',ramdisk_id='',reservation_id='r-fwp2qpkf',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-380813086',owner_user_name='tempest-ServerActionsTestOtherA-380813086-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:48:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9404ed7386e14eed8d046e8c45942c75',uuid=d79c2f2c-0870-4d8e-b468-36e63496b769,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7a36ac9-68dc-462c-9e90-4eb844971548", "address": "fa:16:3e:44:b8:c2", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-51574813-network", "vif_mac": "fa:16:3e:44:b8:c2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a36ac9-68", "ovs_interfaceid": "c7a36ac9-68dc-462c-9e90-4eb844971548", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:49:02 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Converting VIF {"id": "c7a36ac9-68dc-462c-9e90-4eb844971548", "address": "fa:16:3e:44:b8:c2", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-51574813-network", "vif_mac": "fa:16:3e:44:b8:c2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a36ac9-68", "ovs_interfaceid": "c7a36ac9-68dc-462c-9e90-4eb844971548", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:49:02 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:b8:c2,bridge_name='br-int',has_traffic_filtering=True,id=c7a36ac9-68dc-462c-9e90-4eb844971548,network=Network(2c5f0d57-9485-4a0b-a847-49eea5cd17c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7a36ac9-68') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:49:02 user nova-compute[73056]: DEBUG os_vif [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:b8:c2,bridge_name='br-int',has_traffic_filtering=True,id=c7a36ac9-68dc-462c-9e90-4eb844971548,network=Network(2c5f0d57-9485-4a0b-a847-49eea5cd17c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7a36ac9-68') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:49:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:49:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:49:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7a36ac9-68, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:49:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc7a36ac9-68, col_values=(('external_ids', {'iface-id': 'c7a36ac9-68dc-462c-9e90-4eb844971548', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:b8:c2', 'vm-uuid': 'd79c2f2c-0870-4d8e-b468-36e63496b769'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:49:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:49:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:02 user nova-compute[73056]: INFO os_vif [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:b8:c2,bridge_name='br-int',has_traffic_filtering=True,id=c7a36ac9-68dc-462c-9e90-4eb844971548,network=Network(2c5f0d57-9485-4a0b-a847-49eea5cd17c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7a36ac9-68')
Aug 14 16:49:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:49:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] No VIF found with MAC fa:16:3e:44:b8:c2, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:49:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:49:02 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692031727.725165, d79c2f2c-0870-4d8e-b468-36e63496b769 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:49:02 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] VM Stopped (Lifecycle Event)
Aug 14 16:49:02 user nova-compute[73056]: DEBUG nova.compute.manager [None req-a86f37d3-1aee-42b5-8e43-cd4048e1e1d2 None None] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:49:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:03 user nova-compute[73056]: DEBUG nova.compute.manager [req-c2a6a43e-d5db-4d25-81c2-f0c762e8f7e0 req-cd7c0568-1c9b-42f2-871a-689c3342ddde service nova] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Received event network-vif-plugged-c7a36ac9-68dc-462c-9e90-4eb844971548 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:49:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c2a6a43e-d5db-4d25-81c2-f0c762e8f7e0 req-cd7c0568-1c9b-42f2-871a-689c3342ddde service nova] Acquiring lock "d79c2f2c-0870-4d8e-b468-36e63496b769-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:49:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c2a6a43e-d5db-4d25-81c2-f0c762e8f7e0 req-cd7c0568-1c9b-42f2-871a-689c3342ddde service nova] Lock "d79c2f2c-0870-4d8e-b468-36e63496b769-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:49:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c2a6a43e-d5db-4d25-81c2-f0c762e8f7e0 req-cd7c0568-1c9b-42f2-871a-689c3342ddde service nova] Lock "d79c2f2c-0870-4d8e-b468-36e63496b769-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:49:03 user nova-compute[73056]: DEBUG nova.compute.manager [req-c2a6a43e-d5db-4d25-81c2-f0c762e8f7e0 req-cd7c0568-1c9b-42f2-871a-689c3342ddde service nova] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] No waiting events found dispatching network-vif-plugged-c7a36ac9-68dc-462c-9e90-4eb844971548 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:49:03 user nova-compute[73056]: WARNING nova.compute.manager [req-c2a6a43e-d5db-4d25-81c2-f0c762e8f7e0 req-cd7c0568-1c9b-42f2-871a-689c3342ddde service nova] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Received unexpected event network-vif-plugged-c7a36ac9-68dc-462c-9e90-4eb844971548 for instance with vm_state active and task_state resize_finish.
Aug 14 16:49:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:49:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ab3878-9362-4be0-a5bf-3759469473c9/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ab3878-9362-4be0-a5bf-3759469473c9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ab3878-9362-4be0-a5bf-3759469473c9/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ab3878-9362-4be0-a5bf-3759469473c9/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1546794-fd57-4215-a997-39059f213a15/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:05 user nova-compute[73056]: DEBUG nova.compute.manager [req-124451cd-040a-4614-ab95-c3b0d81b0d43 req-b5ac9438-975a-4d8b-8320-f183453a7209 service nova] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Received event network-vif-plugged-c7a36ac9-68dc-462c-9e90-4eb844971548 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:49:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-124451cd-040a-4614-ab95-c3b0d81b0d43 req-b5ac9438-975a-4d8b-8320-f183453a7209 service nova] Acquiring lock "d79c2f2c-0870-4d8e-b468-36e63496b769-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:49:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-124451cd-040a-4614-ab95-c3b0d81b0d43 req-b5ac9438-975a-4d8b-8320-f183453a7209 service nova] Lock "d79c2f2c-0870-4d8e-b468-36e63496b769-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:49:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-124451cd-040a-4614-ab95-c3b0d81b0d43 req-b5ac9438-975a-4d8b-8320-f183453a7209 service nova] Lock "d79c2f2c-0870-4d8e-b468-36e63496b769-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:49:05 user nova-compute[73056]: DEBUG nova.compute.manager [req-124451cd-040a-4614-ab95-c3b0d81b0d43 req-b5ac9438-975a-4d8b-8320-f183453a7209 service nova] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] No waiting events found dispatching network-vif-plugged-c7a36ac9-68dc-462c-9e90-4eb844971548 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:49:05 user nova-compute[73056]: WARNING nova.compute.manager [req-124451cd-040a-4614-ab95-c3b0d81b0d43 req-b5ac9438-975a-4d8b-8320-f183453a7209 service nova] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Received unexpected event network-vif-plugged-c7a36ac9-68dc-462c-9e90-4eb844971548 for instance with vm_state active and task_state resize_finish.
Aug 14 16:49:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1546794-fd57-4215-a997-39059f213a15/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1546794-fd57-4215-a997-39059f213a15/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:06 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031746.103749, d79c2f2c-0870-4d8e-b468-36e63496b769 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:49:06 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] VM Resumed (Lifecycle Event)
Aug 14 16:49:06 user nova-compute[73056]: DEBUG nova.compute.manager [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:49:06 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:49:06 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Instance running successfully.
Aug 14 16:49:06 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:49:06 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Failed to set time: agent not configured {{(pid=73056) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 14 16:49:06 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-b0110f40-23db-4fa0-beb9-30c53ec7d653 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] finish_migration finished successfully. {{(pid=73056) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 14 16:49:06 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 16:49:06 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031746.1044607, d79c2f2c-0870-4d8e-b468-36e63496b769 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:49:06 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] VM Started (Lifecycle Event)
Aug 14 16:49:06 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:49:06 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:49:06 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 16:49:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1546794-fd57-4215-a997-39059f213a15/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:06 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:49:06 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:49:06 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=7297MB free_disk=25.41228485107422GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 16:49:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:49:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:49:06 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Applying migration context for instance d79c2f2c-0870-4d8e-b468-36e63496b769 as it has an incoming, in-progress migration 122b3979-ee5c-4c34-acdc-1d30b77eb2ed. Migration status is finished {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 14 16:49:06 user nova-compute[73056]: INFO nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Updating resource usage from migration 122b3979-ee5c-4c34-acdc-1d30b77eb2ed
Aug 14 16:49:07 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 9f3a7f8a-e3b9-4918-9663-968677fe5c90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:49:07 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance b580e3d0-88b5-42a3-a953-84b94c088f41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:49:07 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 92c34cf0-fd39-49fc-9244-4da8ccae6eec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:49:07 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 9c11423c-88d3-4fae-8917-c0d57021d194 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:49:07 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 7526c6c3-6d3c-435e-8fc7-742c08be44d0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:49:07 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 61357ac0-230f-4711-8954-0bb04bfcb2f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:49:07 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 74ab3878-9362-4be0-a5bf-3759469473c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:49:07 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance c1546794-fd57-4215-a997-39059f213a15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:49:07 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Migration 122b3979-ee5c-4c34-acdc-1d30b77eb2ed is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 14 16:49:07 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance d79c2f2c-0870-4d8e-b468-36e63496b769 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:49:07 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 9910444a-33ee-4937-9073-3b1f4d2f2fe9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:49:07 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 16:49:07 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 16:49:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:07 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:49:07 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:49:07 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 16:49:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.528s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:49:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:08 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:49:08 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:49:08 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:49:08 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:49:09 user nova-compute[73056]: DEBUG nova.compute.manager [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:49:09 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:49:09 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Creating image(s)
Aug 14 16:49:09 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Did not create local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 16:49:09 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Ensure instance console log exists: /opt/stack/data/nova/instances/9910444a-33ee-4937-9073-3b1f4d2f2fe9/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:49:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:49:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:49:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:49:09 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Start _get_guest_xml network_info=[{"id": "57b63084-60a4-44c3-bfc8-6bc91aaedc95", "address": "fa:16:3e:21:99:e6", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57b63084-60", "ovs_interfaceid": "57b63084-60a4-44c3-bfc8-6bc91aaedc95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-14T16:48:42Z,direct_url=<?>,disk_format='qcow2',id=b22efe42-bb05-46d4-822a-39f836f6925f,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1690026470',owner='cffb5203b9284500b8add8a6586cad49',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-14T16:48:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LpthFKrG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9910444a-33ee-4937-9073-3b1f4d2f2fe9', 'attached_at': '', 'detached_at': '', 'volume_id': '06f2c61e-a29e-4738-8ed3-859be9763eaa', 'serial': '06f2c61e-a29e-4738-8ed3-859be9763eaa'}, 'attachment_id': '8243688d-7ba0-48a9-8715-df80bd4922e1', 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:49:09 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:49:09 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:49:09 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:49:09 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:49:09 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:49:09 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:49:09 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:49:09 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-14T16:48:42Z,direct_url=<?>,disk_format='qcow2',id=b22efe42-bb05-46d4-822a-39f836f6925f,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1690026470',owner='cffb5203b9284500b8add8a6586cad49',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-14T16:48:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:49:09 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:49:09 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:49:09 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:49:09 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:49:09 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:49:09 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:49:09 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:49:09 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:49:09 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:49:09 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:49:09 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:49:09 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LpthFKrG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:49:09 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:49:09 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:49:09 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:49:09 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:49:09 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:49:09 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:49:09 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:49:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:09 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddbfabb-5139-4bde-90ae-c99324c26075]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:09 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:49:09 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:49:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:09 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[438bbbf7-a439-4d54-a6ac-4dfc3cf72b5e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:09 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa] added
Aug 14 16:49:09 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:49:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:09 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f7c9a5-57b7-4944-972f-0ca7db4aac98]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:09 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:49:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:10 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b94216f-55a5-4a1c-92db-1a22b443d06a]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:10 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:49:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LpthFKrG {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LpthFKrG" returned: 0 in 0.033s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:10 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc772127-39ff-4b0f-a671-7ce3ac8a1988]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:10 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LpthFKrG'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:49:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:10 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba88b00-51dd-4b97-886e-3ee05bf594e9]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:10 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:49:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:10 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e359c7-51a7-465c-b258-16b36f4aca7d]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:10 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:49:10 user nova-compute[73056]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)
Aug 14 16:49:10 user nova-compute[73056]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:49:10 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:49:10 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:49:10 user nova-compute[73056]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)
Aug 14 16:49:10 user nova-compute[73056]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:49:10 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:49:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "bcbe7449-6199-4e86-a8b6-c075e142aa34" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:49:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "bcbe7449-6199-4e86-a8b6-c075e142aa34" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:49:10 user nova-compute[73056]: DEBUG nova.compute.manager [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:49:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:49:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:49:11 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:49:11 user nova-compute[73056]: INFO nova.compute.claims [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Claim successful on node user
Aug 14 16:49:11 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa -p 172.16.0.220:3260 --login" returned: 0 in 1.064s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:11 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[4051192a-bfe2-49b7-9062-6b63971db6af]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:11 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa, portal: 172.16.0.220,3260]
Aug 14 16:49:11 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa, portal: 172.16.0.220,3260] successful.
Aug 14 16:49:11 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:49:11 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:11 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:11 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a4050c-e48a-4792-b35c-fc2675cd56ed]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:11 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:49:11 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:11 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:11 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[43127646-cc7e-4b25-8b2c-8c91fc12ab51]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:11 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:49:11 user nova-compute[73056]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)
Aug 14 16:49:11 user nova-compute[73056]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:49:11 user nova-compute[73056]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa (non-flash)
Aug 14 16:49:11 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:49:11 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:49:11 user nova-compute[73056]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)
Aug 14 16:49:11 user nova-compute[73056]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:49:11 user nova-compute[73056]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa (non-flash)
Aug 14 16:49:11 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:49:11 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.335s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:49:11 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:49:11 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:49:11 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:49:11 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:11 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:11 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bf943e-93fe-44d6-91bf-3f4eb3b49a84]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:11 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:49:11 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LpthFKrG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:49:11 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:49:11 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:49:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:49:11 user nova-compute[73056]: DEBUG nova.compute.manager [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:49:11 user nova-compute[73056]: DEBUG nova.compute.manager [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:49:11 user nova-compute[73056]: DEBUG nova.network.neutron [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:49:11 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:49:11 user nova-compute[73056]: DEBUG nova.compute.manager [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:49:11 user nova-compute[73056]: DEBUG nova.policy [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a20dd4c88984674996e26fdcfa4f126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67a1c8fcd97416e90f6b5a50a886a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:49:11 user nova-compute[73056]: DEBUG nova.compute.manager [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:49:11 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:49:11 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Creating image(s)
Aug 14 16:49:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "/opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:49:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "/opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:49:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "/opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:49:11 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:11 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.183s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "c889592ab94cd0b0ce896f27a2af0323771db234" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:49:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:49:11 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.176s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34/disk 1073741824" returned: 0 in 0.050s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:49:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:12 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.382s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:49:12 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] <== connect_volume: return (2385ms) {'type': 'block', 'scsi_wwn': '23030313731343036', 'path': '/dev/sdc'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:49:12 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030313731343036', 'path': '/dev/sdc'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:49:12 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:48:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1391880076',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1391880076',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1391880076',id=31,image_ref='b22efe42-bb05-46d4-822a-39f836f6925f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuJqC/uSpYU3He6gO9R+qHwaAdN9yjmnxXSaJX/0vRV38kzGDqYOgrvyFpehKU1xVniTQn/vnW6s082XLnrdR9X6uKsuQtHi5VieND2iWZciYVdFNxsy8uH1bqyH2A1wg==',key_name='tempest-keypair-97762910',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cffb5203b9284500b8add8a6586cad49',ramdisk_id='',reservation_id='r-mosmrn34',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1676214558',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1676214558-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1676214558',owner_user_name='tempest-TestVolumeBootPattern-1676214558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:48:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2be1b098ca9f4232bd198b515630f6ad',uuid=9910444a-33ee-4937-9073-3b1f4d2f2fe9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57b63084-60a4-44c3-bfc8-6bc91aaedc95", "address": "fa:16:3e:21:99:e6", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57b63084-60", "ovs_interfaceid": "57b63084-60a4-44c3-bfc8-6bc91aaedc95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:49:12 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Converting VIF {"id": "57b63084-60a4-44c3-bfc8-6bc91aaedc95", "address": "fa:16:3e:21:99:e6", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57b63084-60", "ovs_interfaceid": "57b63084-60a4-44c3-bfc8-6bc91aaedc95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:49:12 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:99:e6,bridge_name='br-int',has_traffic_filtering=True,id=57b63084-60a4-44c3-bfc8-6bc91aaedc95,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57b63084-60') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:49:12 user nova-compute[73056]: DEBUG nova.objects.instance [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lazy-loading 'pci_devices' on Instance uuid 9910444a-33ee-4937-9073-3b1f4d2f2fe9 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:49:12 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:49:12 user nova-compute[73056]:   <uuid>9910444a-33ee-4937-9073-3b1f4d2f2fe9</uuid>
Aug 14 16:49:12 user nova-compute[73056]:   <name>instance-0000001f</name>
Aug 14 16:49:12 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:49:12 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:49:12 user nova-compute[73056]:   <metadata>
Aug 14 16:49:12 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:49:12 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:49:12 user nova-compute[73056]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1391880076</nova:name>
Aug 14 16:49:12 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:49:09</nova:creationTime>
Aug 14 16:49:12 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:49:12 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:49:12 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:49:12 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:49:12 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:49:12 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:49:12 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:49:12 user nova-compute[73056]:       <nova:owner>
Aug 14 16:49:12 user nova-compute[73056]:         <nova:user uuid="2be1b098ca9f4232bd198b515630f6ad">tempest-TestVolumeBootPattern-1676214558-project-member</nova:user>
Aug 14 16:49:12 user nova-compute[73056]:         <nova:project uuid="cffb5203b9284500b8add8a6586cad49">tempest-TestVolumeBootPattern-1676214558</nova:project>
Aug 14 16:49:12 user nova-compute[73056]:       </nova:owner>
Aug 14 16:49:12 user nova-compute[73056]:       <nova:root type="image" uuid="b22efe42-bb05-46d4-822a-39f836f6925f"/>
Aug 14 16:49:12 user nova-compute[73056]:       <nova:ports>
Aug 14 16:49:12 user nova-compute[73056]:         <nova:port uuid="57b63084-60a4-44c3-bfc8-6bc91aaedc95">
Aug 14 16:49:12 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 14 16:49:12 user nova-compute[73056]:         </nova:port>
Aug 14 16:49:12 user nova-compute[73056]:       </nova:ports>
Aug 14 16:49:12 user nova-compute[73056]:     </nova:instance>
Aug 14 16:49:12 user nova-compute[73056]:   </metadata>
Aug 14 16:49:12 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:49:12 user nova-compute[73056]:     <system>
Aug 14 16:49:12 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:49:12 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:49:12 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:49:12 user nova-compute[73056]:       <entry name="serial">9910444a-33ee-4937-9073-3b1f4d2f2fe9</entry>
Aug 14 16:49:12 user nova-compute[73056]:       <entry name="uuid">9910444a-33ee-4937-9073-3b1f4d2f2fe9</entry>
Aug 14 16:49:12 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:49:12 user nova-compute[73056]:     </system>
Aug 14 16:49:12 user nova-compute[73056]:   </sysinfo>
Aug 14 16:49:12 user nova-compute[73056]:   <os>
Aug 14 16:49:12 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:49:12 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:49:12 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:49:12 user nova-compute[73056]:   </os>
Aug 14 16:49:12 user nova-compute[73056]:   <features>
Aug 14 16:49:12 user nova-compute[73056]:     <acpi/>
Aug 14 16:49:12 user nova-compute[73056]:     <apic/>
Aug 14 16:49:12 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:49:12 user nova-compute[73056]:   </features>
Aug 14 16:49:12 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:49:12 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:49:12 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:49:12 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:49:12 user nova-compute[73056]:   </clock>
Aug 14 16:49:12 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:49:12 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:49:12 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:49:12 user nova-compute[73056]:   </cpu>
Aug 14 16:49:12 user nova-compute[73056]:   <devices>
Aug 14 16:49:12 user nova-compute[73056]:     <disk type="block" device="disk">
Aug 14 16:49:12 user nova-compute[73056]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:49:12 user nova-compute[73056]:       <source dev="/dev/sdc"/>
Aug 14 16:49:12 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:49:12 user nova-compute[73056]:       <serial>06f2c61e-a29e-4738-8ed3-859be9763eaa</serial>
Aug 14 16:49:12 user nova-compute[73056]:     </disk>
Aug 14 16:49:12 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:49:12 user nova-compute[73056]:       <mac address="fa:16:3e:21:99:e6"/>
Aug 14 16:49:12 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:49:12 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:49:12 user nova-compute[73056]:       <target dev="tap57b63084-60"/>
Aug 14 16:49:12 user nova-compute[73056]:     </interface>
Aug 14 16:49:12 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:49:12 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/9910444a-33ee-4937-9073-3b1f4d2f2fe9/console.log" append="off"/>
Aug 14 16:49:12 user nova-compute[73056]:     </serial>
Aug 14 16:49:12 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:49:12 user nova-compute[73056]:     <video>
Aug 14 16:49:12 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:49:12 user nova-compute[73056]:     </video>
Aug 14 16:49:12 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:49:12 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:49:12 user nova-compute[73056]:     </rng>
Aug 14 16:49:12 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:49:12 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:49:12 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:49:12 user nova-compute[73056]:     </memballoon>
Aug 14 16:49:12 user nova-compute[73056]:   </devices>
Aug 14 16:49:12 user nova-compute[73056]: </domain>
Aug 14 16:49:12 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:49:12 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:48:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1391880076',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1391880076',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1391880076',id=31,image_ref='b22efe42-bb05-46d4-822a-39f836f6925f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuJqC/uSpYU3He6gO9R+qHwaAdN9yjmnxXSaJX/0vRV38kzGDqYOgrvyFpehKU1xVniTQn/vnW6s082XLnrdR9X6uKsuQtHi5VieND2iWZciYVdFNxsy8uH1bqyH2A1wg==',key_name='tempest-keypair-97762910',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cffb5203b9284500b8add8a6586cad49',ramdisk_id='',reservation_id='r-mosmrn34',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1676214558',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1676214558-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1676214558',owner_user_name='tempest-TestVolumeBootPattern-1676214558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:48:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2be1b098ca9f4232bd198b515630f6ad',uuid=9910444a-33ee-4937-9073-3b1f4d2f2fe9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57b63084-60a4-44c3-bfc8-6bc91aaedc95", "address": "fa:16:3e:21:99:e6", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57b63084-60", "ovs_interfaceid": "57b63084-60a4-44c3-bfc8-6bc91aaedc95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:49:12 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Converting VIF {"id": "57b63084-60a4-44c3-bfc8-6bc91aaedc95", "address": "fa:16:3e:21:99:e6", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57b63084-60", "ovs_interfaceid": "57b63084-60a4-44c3-bfc8-6bc91aaedc95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:49:12 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:99:e6,bridge_name='br-int',has_traffic_filtering=True,id=57b63084-60a4-44c3-bfc8-6bc91aaedc95,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57b63084-60') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:49:12 user nova-compute[73056]: DEBUG os_vif [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:99:e6,bridge_name='br-int',has_traffic_filtering=True,id=57b63084-60a4-44c3-bfc8-6bc91aaedc95,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57b63084-60') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:49:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:49:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:49:12 user nova-compute[73056]: DEBUG nova.network.neutron [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Successfully created port: cb018af9-f526-4333-9a2f-0cc2d91d22b2 {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:49:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.187s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:12 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 16:49:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57b63084-60, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:49:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap57b63084-60, col_values=(('external_ids', {'iface-id': '57b63084-60a4-44c3-bfc8-6bc91aaedc95', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:99:e6', 'vm-uuid': '9910444a-33ee-4937-9073-3b1f4d2f2fe9'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:49:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:49:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:12 user nova-compute[73056]: INFO os_vif [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:99:e6,bridge_name='br-int',has_traffic_filtering=True,id=57b63084-60a4-44c3-bfc8-6bc91aaedc95,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57b63084-60')
Aug 14 16:49:12 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:49:12 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] No VIF found with MAC fa:16:3e:21:99:e6, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:49:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:12 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Cannot resize image /opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 16:49:12 user nova-compute[73056]: DEBUG nova.objects.instance [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lazy-loading 'migration_context' on Instance uuid bcbe7449-6199-4e86-a8b6-c075e142aa34 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:49:12 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 16:49:12 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Ensure instance console log exists: /opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:49:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:49:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:49:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG nova.network.neutron [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Successfully updated port: cb018af9-f526-4333-9a2f-0cc2d91d22b2 {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "refresh_cache-bcbe7449-6199-4e86-a8b6-c075e142aa34" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquired lock "refresh_cache-bcbe7449-6199-4e86-a8b6-c075e142aa34" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG nova.network.neutron [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG nova.compute.manager [req-b61ec77a-3e88-4566-bef0-bb49aa771c4d req-46aa1b17-8866-4e20-8e86-f53f3ac269e5 service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Received event network-changed-cb018af9-f526-4333-9a2f-0cc2d91d22b2 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG nova.compute.manager [req-b61ec77a-3e88-4566-bef0-bb49aa771c4d req-46aa1b17-8866-4e20-8e86-f53f3ac269e5 service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Refreshing instance network info cache due to event network-changed-cb018af9-f526-4333-9a2f-0cc2d91d22b2. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-b61ec77a-3e88-4566-bef0-bb49aa771c4d req-46aa1b17-8866-4e20-8e86-f53f3ac269e5 service nova] Acquiring lock "refresh_cache-bcbe7449-6199-4e86-a8b6-c075e142aa34" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG nova.network.neutron [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG nova.network.neutron [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Updating instance_info_cache with network_info: [{"id": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "address": "fa:16:3e:04:a3:9a", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb018af9-f5", "ovs_interfaceid": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Releasing lock "refresh_cache-bcbe7449-6199-4e86-a8b6-c075e142aa34" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG nova.compute.manager [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Instance network_info: |[{"id": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "address": "fa:16:3e:04:a3:9a", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb018af9-f5", "ovs_interfaceid": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-b61ec77a-3e88-4566-bef0-bb49aa771c4d req-46aa1b17-8866-4e20-8e86-f53f3ac269e5 service nova] Acquired lock "refresh_cache-bcbe7449-6199-4e86-a8b6-c075e142aa34" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG nova.network.neutron [req-b61ec77a-3e88-4566-bef0-bb49aa771c4d req-46aa1b17-8866-4e20-8e86-f53f3ac269e5 service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Refreshing network info cache for port cb018af9-f526-4333-9a2f-0cc2d91d22b2 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Start _get_guest_xml network_info=[{"id": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "address": "fa:16:3e:04:a3:9a", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb018af9-f5", "ovs_interfaceid": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:49:13 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:49:13 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:49:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:49:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1786420487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1786420487',id=32,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIdip50bFOgddyMp6IylDQR0N/sRWs26ps8mtW957zlQ+lUd9LWGr01UNUfLRmUqKtnkrF4wbWmLfe2tOUrlScj2d5EzqiHJaA+1Q0ekto05woc7a99HlXR6VMKQ86FEw==',key_name='tempest-keypair-1929561178',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c67a1c8fcd97416e90f6b5a50a886a75',ramdisk_id='',reservation_id='r-c4car4yy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1935390723',owner_user_name='tempest-AttachVolumeShelveTestJSON-1935390723-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:49:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a20dd4c88984674996e26fdcfa4f126',uuid=bcbe7449-6199-4e86-a8b6-c075e142aa34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "address": "fa:16:3e:04:a3:9a", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb018af9-f5", "ovs_interfaceid": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Converting VIF {"id": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "address": "fa:16:3e:04:a3:9a", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb018af9-f5", "ovs_interfaceid": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:a3:9a,bridge_name='br-int',has_traffic_filtering=True,id=cb018af9-f526-4333-9a2f-0cc2d91d22b2,network=Network(20384d1d-92c0-4ac7-a993-956fa784cd87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb018af9-f5') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG nova.objects.instance [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lazy-loading 'pci_devices' on Instance uuid bcbe7449-6199-4e86-a8b6-c075e142aa34 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:49:13 user nova-compute[73056]:   <uuid>bcbe7449-6199-4e86-a8b6-c075e142aa34</uuid>
Aug 14 16:49:13 user nova-compute[73056]:   <name>instance-00000020</name>
Aug 14 16:49:13 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:49:13 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:49:13 user nova-compute[73056]:   <metadata>
Aug 14 16:49:13 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:49:13 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:49:13 user nova-compute[73056]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1786420487</nova:name>
Aug 14 16:49:13 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:49:13</nova:creationTime>
Aug 14 16:49:13 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:49:13 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:49:13 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:49:13 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:49:13 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:49:13 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:49:13 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:49:13 user nova-compute[73056]:       <nova:owner>
Aug 14 16:49:13 user nova-compute[73056]:         <nova:user uuid="9a20dd4c88984674996e26fdcfa4f126">tempest-AttachVolumeShelveTestJSON-1935390723-project-member</nova:user>
Aug 14 16:49:13 user nova-compute[73056]:         <nova:project uuid="c67a1c8fcd97416e90f6b5a50a886a75">tempest-AttachVolumeShelveTestJSON-1935390723</nova:project>
Aug 14 16:49:13 user nova-compute[73056]:       </nova:owner>
Aug 14 16:49:13 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:49:13 user nova-compute[73056]:       <nova:ports>
Aug 14 16:49:13 user nova-compute[73056]:         <nova:port uuid="cb018af9-f526-4333-9a2f-0cc2d91d22b2">
Aug 14 16:49:13 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 16:49:13 user nova-compute[73056]:         </nova:port>
Aug 14 16:49:13 user nova-compute[73056]:       </nova:ports>
Aug 14 16:49:13 user nova-compute[73056]:     </nova:instance>
Aug 14 16:49:13 user nova-compute[73056]:   </metadata>
Aug 14 16:49:13 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:49:13 user nova-compute[73056]:     <system>
Aug 14 16:49:13 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:49:13 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:49:13 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:49:13 user nova-compute[73056]:       <entry name="serial">bcbe7449-6199-4e86-a8b6-c075e142aa34</entry>
Aug 14 16:49:13 user nova-compute[73056]:       <entry name="uuid">bcbe7449-6199-4e86-a8b6-c075e142aa34</entry>
Aug 14 16:49:13 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:49:13 user nova-compute[73056]:     </system>
Aug 14 16:49:13 user nova-compute[73056]:   </sysinfo>
Aug 14 16:49:13 user nova-compute[73056]:   <os>
Aug 14 16:49:13 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:49:13 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:49:13 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:49:13 user nova-compute[73056]:   </os>
Aug 14 16:49:13 user nova-compute[73056]:   <features>
Aug 14 16:49:13 user nova-compute[73056]:     <acpi/>
Aug 14 16:49:13 user nova-compute[73056]:     <apic/>
Aug 14 16:49:13 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:49:13 user nova-compute[73056]:   </features>
Aug 14 16:49:13 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:49:13 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:49:13 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:49:13 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:49:13 user nova-compute[73056]:   </clock>
Aug 14 16:49:13 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:49:13 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:49:13 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:49:13 user nova-compute[73056]:   </cpu>
Aug 14 16:49:13 user nova-compute[73056]:   <devices>
Aug 14 16:49:13 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:49:13 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:49:13 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34/disk"/>
Aug 14 16:49:13 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:49:13 user nova-compute[73056]:     </disk>
Aug 14 16:49:13 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:49:13 user nova-compute[73056]:       <mac address="fa:16:3e:04:a3:9a"/>
Aug 14 16:49:13 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:49:13 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:49:13 user nova-compute[73056]:       <target dev="tapcb018af9-f5"/>
Aug 14 16:49:13 user nova-compute[73056]:     </interface>
Aug 14 16:49:13 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:49:13 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34/console.log" append="off"/>
Aug 14 16:49:13 user nova-compute[73056]:     </serial>
Aug 14 16:49:13 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:49:13 user nova-compute[73056]:     <video>
Aug 14 16:49:13 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:49:13 user nova-compute[73056]:     </video>
Aug 14 16:49:13 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:49:13 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:49:13 user nova-compute[73056]:     </rng>
Aug 14 16:49:13 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:49:13 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:49:13 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:49:13 user nova-compute[73056]:     </memballoon>
Aug 14 16:49:13 user nova-compute[73056]:   </devices>
Aug 14 16:49:13 user nova-compute[73056]: </domain>
Aug 14 16:49:13 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:49:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1786420487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1786420487',id=32,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIdip50bFOgddyMp6IylDQR0N/sRWs26ps8mtW957zlQ+lUd9LWGr01UNUfLRmUqKtnkrF4wbWmLfe2tOUrlScj2d5EzqiHJaA+1Q0ekto05woc7a99HlXR6VMKQ86FEw==',key_name='tempest-keypair-1929561178',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c67a1c8fcd97416e90f6b5a50a886a75',ramdisk_id='',reservation_id='r-c4car4yy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1935390723',owner_user_name='tempest-AttachVolumeShelveTestJSON-1935390723-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:49:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a20dd4c88984674996e26fdcfa4f126',uuid=bcbe7449-6199-4e86-a8b6-c075e142aa34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "address": "fa:16:3e:04:a3:9a", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb018af9-f5", "ovs_interfaceid": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Converting VIF {"id": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "address": "fa:16:3e:04:a3:9a", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb018af9-f5", "ovs_interfaceid": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:a3:9a,bridge_name='br-int',has_traffic_filtering=True,id=cb018af9-f526-4333-9a2f-0cc2d91d22b2,network=Network(20384d1d-92c0-4ac7-a993-956fa784cd87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb018af9-f5') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG os_vif [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:a3:9a,bridge_name='br-int',has_traffic_filtering=True,id=cb018af9-f526-4333-9a2f-0cc2d91d22b2,network=Network(20384d1d-92c0-4ac7-a993-956fa784cd87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb018af9-f5') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb018af9-f5, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcb018af9-f5, col_values=(('external_ids', {'iface-id': 'cb018af9-f526-4333-9a2f-0cc2d91d22b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:a3:9a', 'vm-uuid': 'bcbe7449-6199-4e86-a8b6-c075e142aa34'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:13 user nova-compute[73056]: INFO os_vif [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:a3:9a,bridge_name='br-int',has_traffic_filtering=True,id=cb018af9-f526-4333-9a2f-0cc2d91d22b2,network=Network(20384d1d-92c0-4ac7-a993-956fa784cd87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb018af9-f5')
Aug 14 16:49:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] No VIF found with MAC fa:16:3e:04:a3:9a, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:14 user nova-compute[73056]: DEBUG nova.compute.manager [req-a7319404-d810-4b25-b205-c030dd8cf0e1 req-da6ad443-e540-480b-ab99-f80521ab12fd service nova] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Received event network-vif-plugged-57b63084-60a4-44c3-bfc8-6bc91aaedc95 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:49:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a7319404-d810-4b25-b205-c030dd8cf0e1 req-da6ad443-e540-480b-ab99-f80521ab12fd service nova] Acquiring lock "9910444a-33ee-4937-9073-3b1f4d2f2fe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:49:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a7319404-d810-4b25-b205-c030dd8cf0e1 req-da6ad443-e540-480b-ab99-f80521ab12fd service nova] Lock "9910444a-33ee-4937-9073-3b1f4d2f2fe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:49:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a7319404-d810-4b25-b205-c030dd8cf0e1 req-da6ad443-e540-480b-ab99-f80521ab12fd service nova] Lock "9910444a-33ee-4937-9073-3b1f4d2f2fe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:49:14 user nova-compute[73056]: DEBUG nova.compute.manager [req-a7319404-d810-4b25-b205-c030dd8cf0e1 req-da6ad443-e540-480b-ab99-f80521ab12fd service nova] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] No waiting events found dispatching network-vif-plugged-57b63084-60a4-44c3-bfc8-6bc91aaedc95 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:49:14 user nova-compute[73056]: WARNING nova.compute.manager [req-a7319404-d810-4b25-b205-c030dd8cf0e1 req-da6ad443-e540-480b-ab99-f80521ab12fd service nova] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Received unexpected event network-vif-plugged-57b63084-60a4-44c3-bfc8-6bc91aaedc95 for instance with vm_state building and task_state spawning.
Aug 14 16:49:14 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:14 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:14 user nova-compute[73056]: DEBUG nova.network.neutron [req-b61ec77a-3e88-4566-bef0-bb49aa771c4d req-46aa1b17-8866-4e20-8e86-f53f3ac269e5 service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Updated VIF entry in instance network info cache for port cb018af9-f526-4333-9a2f-0cc2d91d22b2. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:49:14 user nova-compute[73056]: DEBUG nova.network.neutron [req-b61ec77a-3e88-4566-bef0-bb49aa771c4d req-46aa1b17-8866-4e20-8e86-f53f3ac269e5 service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Updating instance_info_cache with network_info: [{"id": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "address": "fa:16:3e:04:a3:9a", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb018af9-f5", "ovs_interfaceid": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:49:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-b61ec77a-3e88-4566-bef0-bb49aa771c4d req-46aa1b17-8866-4e20-8e86-f53f3ac269e5 service nova] Releasing lock "refresh_cache-bcbe7449-6199-4e86-a8b6-c075e142aa34" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:49:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:15 user nova-compute[73056]: DEBUG nova.compute.manager [req-9bbe4ce8-0e9c-4998-be0d-9a27f9b5ab37 req-70feb0ce-2a80-40c9-acd2-825889eec203 service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Received event network-vif-plugged-cb018af9-f526-4333-9a2f-0cc2d91d22b2 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:49:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9bbe4ce8-0e9c-4998-be0d-9a27f9b5ab37 req-70feb0ce-2a80-40c9-acd2-825889eec203 service nova] Acquiring lock "bcbe7449-6199-4e86-a8b6-c075e142aa34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:49:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9bbe4ce8-0e9c-4998-be0d-9a27f9b5ab37 req-70feb0ce-2a80-40c9-acd2-825889eec203 service nova] Lock "bcbe7449-6199-4e86-a8b6-c075e142aa34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:49:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9bbe4ce8-0e9c-4998-be0d-9a27f9b5ab37 req-70feb0ce-2a80-40c9-acd2-825889eec203 service nova] Lock "bcbe7449-6199-4e86-a8b6-c075e142aa34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:49:15 user nova-compute[73056]: DEBUG nova.compute.manager [req-9bbe4ce8-0e9c-4998-be0d-9a27f9b5ab37 req-70feb0ce-2a80-40c9-acd2-825889eec203 service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] No waiting events found dispatching network-vif-plugged-cb018af9-f526-4333-9a2f-0cc2d91d22b2 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:49:15 user nova-compute[73056]: WARNING nova.compute.manager [req-9bbe4ce8-0e9c-4998-be0d-9a27f9b5ab37 req-70feb0ce-2a80-40c9-acd2-825889eec203 service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Received unexpected event network-vif-plugged-cb018af9-f526-4333-9a2f-0cc2d91d22b2 for instance with vm_state building and task_state spawning.
Aug 14 16:49:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:16 user nova-compute[73056]: DEBUG nova.compute.manager [req-05ee1775-a1e3-4bcc-b43c-015fb313e433 req-a57f2d16-a62d-44a4-a10b-92f61fdb703d service nova] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Received event network-vif-plugged-57b63084-60a4-44c3-bfc8-6bc91aaedc95 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:49:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-05ee1775-a1e3-4bcc-b43c-015fb313e433 req-a57f2d16-a62d-44a4-a10b-92f61fdb703d service nova] Acquiring lock "9910444a-33ee-4937-9073-3b1f4d2f2fe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:49:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-05ee1775-a1e3-4bcc-b43c-015fb313e433 req-a57f2d16-a62d-44a4-a10b-92f61fdb703d service nova] Lock "9910444a-33ee-4937-9073-3b1f4d2f2fe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:49:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-05ee1775-a1e3-4bcc-b43c-015fb313e433 req-a57f2d16-a62d-44a4-a10b-92f61fdb703d service nova] Lock "9910444a-33ee-4937-9073-3b1f4d2f2fe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:49:16 user nova-compute[73056]: DEBUG nova.compute.manager [req-05ee1775-a1e3-4bcc-b43c-015fb313e433 req-a57f2d16-a62d-44a4-a10b-92f61fdb703d service nova] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] No waiting events found dispatching network-vif-plugged-57b63084-60a4-44c3-bfc8-6bc91aaedc95 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:49:16 user nova-compute[73056]: WARNING nova.compute.manager [req-05ee1775-a1e3-4bcc-b43c-015fb313e433 req-a57f2d16-a62d-44a4-a10b-92f61fdb703d service nova] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Received unexpected event network-vif-plugged-57b63084-60a4-44c3-bfc8-6bc91aaedc95 for instance with vm_state building and task_state spawning.
Aug 14 16:49:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:17 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031757.1461456, 9910444a-33ee-4937-9073-3b1f4d2f2fe9 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:49:17 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] VM Resumed (Lifecycle Event)
Aug 14 16:49:17 user nova-compute[73056]: DEBUG nova.compute.manager [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:49:17 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:49:17 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Instance spawned successfully.
Aug 14 16:49:17 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:49:17 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:49:17 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:49:17 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:49:17 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:49:17 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:49:17 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031757.1486135, 9910444a-33ee-4937-9073-3b1f4d2f2fe9 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:49:17 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] VM Started (Lifecycle Event)
Aug 14 16:49:17 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:49:17 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:49:17 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:49:17 user nova-compute[73056]: INFO nova.compute.manager [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Took 7.43 seconds to spawn the instance on the hypervisor.
Aug 14 16:49:17 user nova-compute[73056]: DEBUG nova.compute.manager [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:49:17 user nova-compute[73056]: INFO nova.compute.manager [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Took 24.41 seconds to build instance.
Aug 14 16:49:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fee2ecfa-65a0-4141-ab07-c0553411825e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "9910444a-33ee-4937-9073-3b1f4d2f2fe9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.685s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:49:17 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031757.7116117, bcbe7449-6199-4e86-a8b6-c075e142aa34 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:49:17 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] VM Resumed (Lifecycle Event)
Aug 14 16:49:17 user nova-compute[73056]: DEBUG nova.compute.manager [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:49:17 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:49:17 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Instance spawned successfully.
Aug 14 16:49:17 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:49:17 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:49:17 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:49:17 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:49:17 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:49:17 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:49:17 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:49:17 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:49:17 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:49:17 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:49:17 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031757.7148054, bcbe7449-6199-4e86-a8b6-c075e142aa34 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:49:17 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] VM Started (Lifecycle Event)
Aug 14 16:49:17 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:49:17 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:49:17 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:49:17 user nova-compute[73056]: DEBUG nova.compute.manager [req-0a0f737f-c7c6-4cb9-9a11-920a702b99c6 req-a60fc37f-5da0-4914-8c7a-04e479705c49 service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Received event network-vif-plugged-cb018af9-f526-4333-9a2f-0cc2d91d22b2 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:49:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0a0f737f-c7c6-4cb9-9a11-920a702b99c6 req-a60fc37f-5da0-4914-8c7a-04e479705c49 service nova] Acquiring lock "bcbe7449-6199-4e86-a8b6-c075e142aa34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:49:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0a0f737f-c7c6-4cb9-9a11-920a702b99c6 req-a60fc37f-5da0-4914-8c7a-04e479705c49 service nova] Lock "bcbe7449-6199-4e86-a8b6-c075e142aa34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:49:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0a0f737f-c7c6-4cb9-9a11-920a702b99c6 req-a60fc37f-5da0-4914-8c7a-04e479705c49 service nova] Lock "bcbe7449-6199-4e86-a8b6-c075e142aa34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:49:17 user nova-compute[73056]: DEBUG nova.compute.manager [req-0a0f737f-c7c6-4cb9-9a11-920a702b99c6 req-a60fc37f-5da0-4914-8c7a-04e479705c49 service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] No waiting events found dispatching network-vif-plugged-cb018af9-f526-4333-9a2f-0cc2d91d22b2 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:49:17 user nova-compute[73056]: WARNING nova.compute.manager [req-0a0f737f-c7c6-4cb9-9a11-920a702b99c6 req-a60fc37f-5da0-4914-8c7a-04e479705c49 service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Received unexpected event network-vif-plugged-cb018af9-f526-4333-9a2f-0cc2d91d22b2 for instance with vm_state building and task_state spawning.
Aug 14 16:49:17 user nova-compute[73056]: INFO nova.compute.manager [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Took 6.08 seconds to spawn the instance on the hypervisor.
Aug 14 16:49:17 user nova-compute[73056]: DEBUG nova.compute.manager [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:49:17 user nova-compute[73056]: INFO nova.compute.manager [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Took 6.87 seconds to build instance.
Aug 14 16:49:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6c864437-d183-4c06-bac5-c65bfb68a71f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "bcbe7449-6199-4e86-a8b6-c075e142aa34" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.959s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:49:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:39 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Acquiring lock "9c11423c-88d3-4fae-8917-c0d57021d194" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:49:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "9c11423c-88d3-4fae-8917-c0d57021d194" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:49:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Acquiring lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:49:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:49:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:49:39 user nova-compute[73056]: INFO nova.compute.manager [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Terminating instance
Aug 14 16:49:39 user nova-compute[73056]: DEBUG nova.compute.manager [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG nova.compute.manager [req-15dcdd1c-5ed4-4c0c-98f4-8019bc119746 req-c7bdd8a5-48c8-428b-9b23-71eefed983e7 service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Received event network-vif-unplugged-8491a73c-f38b-4cb4-ab87-d6e41992319d {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-15dcdd1c-5ed4-4c0c-98f4-8019bc119746 req-c7bdd8a5-48c8-428b-9b23-71eefed983e7 service nova] Acquiring lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-15dcdd1c-5ed4-4c0c-98f4-8019bc119746 req-c7bdd8a5-48c8-428b-9b23-71eefed983e7 service nova] Lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-15dcdd1c-5ed4-4c0c-98f4-8019bc119746 req-c7bdd8a5-48c8-428b-9b23-71eefed983e7 service nova] Lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG nova.compute.manager [req-15dcdd1c-5ed4-4c0c-98f4-8019bc119746 req-c7bdd8a5-48c8-428b-9b23-71eefed983e7 service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] No waiting events found dispatching network-vif-unplugged-8491a73c-f38b-4cb4-ab87-d6e41992319d {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG nova.compute.manager [req-15dcdd1c-5ed4-4c0c-98f4-8019bc119746 req-c7bdd8a5-48c8-428b-9b23-71eefed983e7 service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Received event network-vif-unplugged-8491a73c-f38b-4cb4-ab87-d6e41992319d for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:49:40 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Instance destroyed successfully.
Aug 14 16:49:40 user nova-compute[73056]: DEBUG nova.objects.instance [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lazy-loading 'resources' on Instance uuid 9c11423c-88d3-4fae-8917-c0d57021d194 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:40:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1141868820',display_name='tempest-ServerActionsTestOtherB-server-1141868820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1141868820',id=16,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsc3Uaz7vmbmV86lMnvYNdRaSVfJcdYXdG4vY0wVNgR/VZPzr09+A51tF4EmKhmmLDKglhmcpoAJJc05z8zlcL3Fqhx5uVkS7BbyNbqt0mNNKT7ar0AXFL2PnABSrfDLg==',key_name='tempest-keypair-1532112814',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:47:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4af3a3df4b8641c1ac0d02df893b524d',ramdisk_id='',reservation_id='r-z7s601zt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1168667086',owner_user_name='tempest-ServerActionsTestOtherB-1168667086-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:47:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c39b09d624bb4977b6d1b396f425f737',uuid=9c11423c-88d3-4fae-8917-c0d57021d194,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "address": "fa:16:3e:e6:4c:64", "network": {"id": "db548415-fd97-4612-8699-d431cfe3c1ec", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-66082327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af3a3df4b8641c1ac0d02df893b524d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8491a73c-f3", "ovs_interfaceid": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Converting VIF {"id": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "address": "fa:16:3e:e6:4c:64", "network": {"id": "db548415-fd97-4612-8699-d431cfe3c1ec", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-66082327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af3a3df4b8641c1ac0d02df893b524d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8491a73c-f3", "ovs_interfaceid": "8491a73c-f38b-4cb4-ab87-d6e41992319d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:4c:64,bridge_name='br-int',has_traffic_filtering=True,id=8491a73c-f38b-4cb4-ab87-d6e41992319d,network=Network(db548415-fd97-4612-8699-d431cfe3c1ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8491a73c-f3') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG os_vif [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:4c:64,bridge_name='br-int',has_traffic_filtering=True,id=8491a73c-f38b-4cb4-ab87-d6e41992319d,network=Network(db548415-fd97-4612-8699-d431cfe3c1ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8491a73c-f3') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8491a73c-f3, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:49:40 user nova-compute[73056]: INFO os_vif [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:4c:64,bridge_name='br-int',has_traffic_filtering=True,id=8491a73c-f38b-4cb4-ab87-d6e41992319d,network=Network(db548415-fd97-4612-8699-d431cfe3c1ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8491a73c-f3')
Aug 14 16:49:40 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iThIoFVw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:49:40 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:49:40 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[639a349d-cfc4-49bc-af14-3a1510b96a44]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3d3e4a-6001-492d-80b3-c31877560543]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:49:40 user nova-compute[73056]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)
Aug 14 16:49:40 user nova-compute[73056]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:49:40 user nova-compute[73056]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa (non-flash)
Aug 14 16:49:40 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:49:40 user nova-compute[73056]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 (non-flash)
Aug 14 16:49:40 user nova-compute[73056]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:49:40 user nova-compute[73056]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa (non-flash)
Aug 14 16:49:40 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff300202290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0'): ({'sdf'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Removing single pathed devices sdf {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc7d044-3c3f-42ef-9883-90adfa4054e6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d09796-a69e-48e8-b0d3-0946c35992f7]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Flushing IO for device /dev/sdf {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c2e85b-04ff-42e7-8c7b-bd699e232dbf]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81c2f2f-ea3f-4e92-b17f-ecd9225ca23a]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] SCSI volumes sdf have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e0ed4d-20e4-4d5d-9030-26053e119f9d]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:49:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:41 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:41 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a512c12-c7d4-4378-8855-9f9757ef5889]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:41 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0, portal: 172.16.0.220,3260]
Aug 14 16:49:41 user nova-compute[73056]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0, portal: 172.16.0.220,3260] successful.
Aug 14 16:49:41 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:49:41 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:41 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a09be2-92fa-4429-a416-13d78c74eda0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:41 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68e37fb-ecfe-44f1-8b3f-e4e0b8cbee66]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:41 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:49:41 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:49:41 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] <== disconnect_volume: return (299ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:49:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:49:41 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Deleting instance files /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194_del
Aug 14 16:49:41 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Deletion of /opt/stack/data/nova/instances/9c11423c-88d3-4fae-8917-c0d57021d194_del complete
Aug 14 16:49:41 user nova-compute[73056]: INFO nova.compute.manager [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 14 16:49:41 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 16:49:41 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 16:49:41 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 16:49:42 user nova-compute[73056]: DEBUG nova.compute.manager [req-c723d937-6418-46c1-8d2b-b962fe8a199c req-e943ebb6-8ea5-4902-a6c8-58acacfc065d service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Received event network-vif-plugged-8491a73c-f38b-4cb4-ab87-d6e41992319d {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:49:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c723d937-6418-46c1-8d2b-b962fe8a199c req-e943ebb6-8ea5-4902-a6c8-58acacfc065d service nova] Acquiring lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:49:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c723d937-6418-46c1-8d2b-b962fe8a199c req-e943ebb6-8ea5-4902-a6c8-58acacfc065d service nova] Lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:49:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c723d937-6418-46c1-8d2b-b962fe8a199c req-e943ebb6-8ea5-4902-a6c8-58acacfc065d service nova] Lock "9c11423c-88d3-4fae-8917-c0d57021d194-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:49:42 user nova-compute[73056]: DEBUG nova.compute.manager [req-c723d937-6418-46c1-8d2b-b962fe8a199c req-e943ebb6-8ea5-4902-a6c8-58acacfc065d service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] No waiting events found dispatching network-vif-plugged-8491a73c-f38b-4cb4-ab87-d6e41992319d {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:49:42 user nova-compute[73056]: WARNING nova.compute.manager [req-c723d937-6418-46c1-8d2b-b962fe8a199c req-e943ebb6-8ea5-4902-a6c8-58acacfc065d service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Received unexpected event network-vif-plugged-8491a73c-f38b-4cb4-ab87-d6e41992319d for instance with vm_state active and task_state deleting.
Aug 14 16:49:42 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:49:42 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Took 1.74 seconds to deallocate network for instance.
Aug 14 16:49:42 user nova-compute[73056]: DEBUG nova.compute.manager [req-96cfa6bf-4a3a-428f-b7a6-223a8e704569 req-afd480fc-362a-41d9-ac0b-63603f078c3e service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Received event network-vif-deleted-8491a73c-f38b-4cb4-ab87-d6e41992319d {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:49:42 user nova-compute[73056]: INFO nova.compute.manager [req-96cfa6bf-4a3a-428f-b7a6-223a8e704569 req-afd480fc-362a-41d9-ac0b-63603f078c3e service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Neutron deleted interface 8491a73c-f38b-4cb4-ab87-d6e41992319d; detaching it from the instance and deleting it from the info cache
Aug 14 16:49:42 user nova-compute[73056]: DEBUG nova.network.neutron [req-96cfa6bf-4a3a-428f-b7a6-223a8e704569 req-afd480fc-362a-41d9-ac0b-63603f078c3e service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:49:42 user nova-compute[73056]: DEBUG nova.compute.manager [req-96cfa6bf-4a3a-428f-b7a6-223a8e704569 req-afd480fc-362a-41d9-ac0b-63603f078c3e service nova] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Detach interface failed, port_id=8491a73c-f38b-4cb4-ab87-d6e41992319d, reason: Instance 9c11423c-88d3-4fae-8917-c0d57021d194 could not be found. {{(pid=73056) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 16:49:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:43 user nova-compute[73056]: INFO nova.compute.manager [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Took 0.85 seconds to detach 1 volumes for instance.
Aug 14 16:49:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:49:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:49:44 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:49:44 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:49:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.414s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:49:44 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Deleted allocations for instance 9c11423c-88d3-4fae-8917-c0d57021d194
Aug 14 16:49:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-52c15074-757a-46a5-8283-65d931f6e39d tempest-ServerActionsTestOtherB-1168667086 tempest-ServerActionsTestOtherB-1168667086-project-member] Lock "9c11423c-88d3-4fae-8917-c0d57021d194" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.389s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:49:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:46 user nova-compute[73056]: DEBUG nova.compute.manager [req-8e3a2ae1-7300-45e7-8917-3c8345031a7a req-f46f49b9-f984-48bb-9c1f-111ccb4bb668 service nova] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Received event network-changed-8301812a-2a56-49e5-8747-f50c95c3de26 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:49:46 user nova-compute[73056]: DEBUG nova.compute.manager [req-8e3a2ae1-7300-45e7-8917-3c8345031a7a req-f46f49b9-f984-48bb-9c1f-111ccb4bb668 service nova] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Refreshing instance network info cache due to event network-changed-8301812a-2a56-49e5-8747-f50c95c3de26. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:49:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8e3a2ae1-7300-45e7-8917-3c8345031a7a req-f46f49b9-f984-48bb-9c1f-111ccb4bb668 service nova] Acquiring lock "refresh_cache-61357ac0-230f-4711-8954-0bb04bfcb2f6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:49:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8e3a2ae1-7300-45e7-8917-3c8345031a7a req-f46f49b9-f984-48bb-9c1f-111ccb4bb668 service nova] Acquired lock "refresh_cache-61357ac0-230f-4711-8954-0bb04bfcb2f6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:49:46 user nova-compute[73056]: DEBUG nova.network.neutron [req-8e3a2ae1-7300-45e7-8917-3c8345031a7a req-f46f49b9-f984-48bb-9c1f-111ccb4bb668 service nova] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Refreshing network info cache for port 8301812a-2a56-49e5-8747-f50c95c3de26 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:49:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Acquiring lock "61357ac0-230f-4711-8954-0bb04bfcb2f6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:49:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "61357ac0-230f-4711-8954-0bb04bfcb2f6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:49:46 user nova-compute[73056]: DEBUG nova.objects.instance [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lazy-loading 'flavor' on Instance uuid 61357ac0-230f-4711-8954-0bb04bfcb2f6 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:49:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "61357ac0-230f-4711-8954-0bb04bfcb2f6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:49:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Acquiring lock "61357ac0-230f-4711-8954-0bb04bfcb2f6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:49:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "61357ac0-230f-4711-8954-0bb04bfcb2f6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:49:47 user nova-compute[73056]: INFO nova.compute.manager [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Attaching volume 6ae5a4a8-9820-4a4e-b77b-51139b7640e0 to /dev/vdb
Aug 14 16:49:47 user nova-compute[73056]: DEBUG os_brick.utils [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:49:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:47 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b46b79-357d-4899-9aad-6dc8f88aede7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:47 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa02ccb-424a-4c2e-8657-2bea45a1f4fb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:47 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1eaa19-1c09-4aee-adee-fa7c2707569e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:47 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f3c139-1d3a-458a-973d-fffe57ed5065]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:49:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:49:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:47 user nova-compute[73056]: DEBUG nova.network.neutron [req-8e3a2ae1-7300-45e7-8917-3c8345031a7a req-f46f49b9-f984-48bb-9c1f-111ccb4bb668 service nova] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Updated VIF entry in instance network info cache for port 8301812a-2a56-49e5-8747-f50c95c3de26. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:49:47 user nova-compute[73056]: DEBUG nova.network.neutron [req-8e3a2ae1-7300-45e7-8917-3c8345031a7a req-f46f49b9-f984-48bb-9c1f-111ccb4bb668 service nova] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Updating instance_info_cache with network_info: [{"id": "8301812a-2a56-49e5-8747-f50c95c3de26", "address": "fa:16:3e:77:f0:bf", "network": {"id": "c2b49cd1-a248-4bd2-924f-bd8b560aed47", "bridge": "br-int", "label": "tempest-TestStampPattern-1795667966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d796c14bd3489883e161ea1b311ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8301812a-2a", "ovs_interfaceid": "8301812a-2a56-49e5-8747-f50c95c3de26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:49:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:49:47 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:49:47 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c47081-3605-4acb-a81f-8cec57ef4ee2]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:49:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:49:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:49:47 user nova-compute[73056]: DEBUG os_brick.utils [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:49:47 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Updating existing volume attachment record: d06278d6-4090-42af-a8e7-cf18cd783b59 {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 16:49:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8e3a2ae1-7300-45e7-8917-3c8345031a7a req-f46f49b9-f984-48bb-9c1f-111ccb4bb668 service nova] Releasing lock "refresh_cache-61357ac0-230f-4711-8954-0bb04bfcb2f6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:49:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:54 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:49:54 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 16:49:55 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692031780.7211466, 9c11423c-88d3-4fae-8917-c0d57021d194 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:49:55 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] VM Stopped (Lifecycle Event)
Aug 14 16:49:55 user nova-compute[73056]: DEBUG nova.compute.manager [None req-bf0b5b5b-111c-4338-ac58-efc25356b521 None None] [instance: 9c11423c-88d3-4fae-8917-c0d57021d194] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:49:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OVnstvNM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:49:56 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:49:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:49:56 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:49:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:49:56 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:49:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0 -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa818d0e-3be8-46e2-b9b9-5c9d76822856]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:49:56 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a66857-5e56-436c-baf9-43f07235f4e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0] added
Aug 14 16:49:56 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d17ce2-010c-4055-a599-03e4bd7ec1bc]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ce5d71-0f73-44ca-9806-0da37534a4ca]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OVnstvNM {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OVnstvNM" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8eab4c-3daf-40b8-b092-4b4e8342c30a]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OVnstvNM'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a48c1cb-0ea9-4b0d-83c5-5d60c46ac156]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[424ad2ed-da9f-4fce-845c-95e844bd8f46]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:49:56 user nova-compute[73056]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:49:56 user nova-compute[73056]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa (non-flash)
Aug 14 16:49:56 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:49:56 user nova-compute[73056]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:49:56 user nova-compute[73056]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa (non-flash)
Aug 14 16:49:56 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0 -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6b47f3-6263-4d3a-890b-d7f27414e5d7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0, portal: 172.16.0.220,3260]
Aug 14 16:49:56 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0, portal: 172.16.0.220,3260] successful.
Aug 14 16:49:56 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0b1245-f1f8-44c8-b61a-235fe0c3228a]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5f2a6b-7bc7-446d-ad49-64cddc74fbcf]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:49:56 user nova-compute[73056]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:49:56 user nova-compute[73056]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa (non-flash)
Aug 14 16:49:56 user nova-compute[73056]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0 (non-flash)
Aug 14 16:49:56 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:49:56 user nova-compute[73056]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:49:56 user nova-compute[73056]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa (non-flash)
Aug 14 16:49:56 user nova-compute[73056]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0 (non-flash)
Aug 14 16:49:56 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8af6a29-50bc-4fd1-8653-979fd5033a81]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:49:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OVnstvNM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:49:57 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:49:57 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26431656436313030', 'path': '/dev/sde'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:49:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431656436313030', 'path': '/dev/sde'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:49:57 user nova-compute[73056]: DEBUG nova.objects.instance [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lazy-loading 'flavor' on Instance uuid 61357ac0-230f-4711-8954-0bb04bfcb2f6 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:49:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 16:49:57 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:49:57 user nova-compute[73056]:   <source dev="/dev/sde"/>
Aug 14 16:49:57 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:49:57 user nova-compute[73056]:   <serial>6ae5a4a8-9820-4a4e-b77b-51139b7640e0</serial>
Aug 14 16:49:57 user nova-compute[73056]: </disk>
Aug 14 16:49:57 user nova-compute[73056]:  {{(pid=73056) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 16:49:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:49:58 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:49:58 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:49:58 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] No VIF found with MAC fa:16:3e:77:f0:bf, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:49:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d5ee0733-7419-425f-ac73-5e093fe6a277 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "61357ac0-230f-4711-8954-0bb04bfcb2f6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.230s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:49:59 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:49:59 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 16:49:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-92c34cf0-fd39-49fc-9244-4da8ccae6eec" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:49:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-92c34cf0-fd39-49fc-9244-4da8ccae6eec" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:49:59 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 16:49:59 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Updating instance_info_cache with network_info: [{"id": "2a57f016-2b33-46f4-a885-51c4ac8658bb", "address": "fa:16:3e:11:b2:3a", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a57f016-2b", "ovs_interfaceid": "2a57f016-2b33-46f4-a885-51c4ac8658bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:49:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-92c34cf0-fd39-49fc-9244-4da8ccae6eec" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:49:59 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 16:50:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-e6aa087c-d1b9-4da8-a282-5fa93f67fa3f tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Acquiring lock "61357ac0-230f-4711-8954-0bb04bfcb2f6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:50:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-e6aa087c-d1b9-4da8-a282-5fa93f67fa3f tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "61357ac0-230f-4711-8954-0bb04bfcb2f6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:50:00 user nova-compute[73056]: INFO nova.compute.manager [None req-e6aa087c-d1b9-4da8-a282-5fa93f67fa3f tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Detaching volume 6ae5a4a8-9820-4a4e-b77b-51139b7640e0
Aug 14 16:50:00 user nova-compute[73056]: INFO nova.virt.block_device [None req-e6aa087c-d1b9-4da8-a282-5fa93f67fa3f tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Attempting to driver detach volume 6ae5a4a8-9820-4a4e-b77b-51139b7640e0 from mountpoint /dev/vdb
Aug 14 16:50:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-e6aa087c-d1b9-4da8-a282-5fa93f67fa3f tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Attempting to detach device vdb from instance 61357ac0-230f-4711-8954-0bb04bfcb2f6 from the persistent domain config. {{(pid=73056) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 16:50:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-e6aa087c-d1b9-4da8-a282-5fa93f67fa3f tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 16:50:00 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:50:00 user nova-compute[73056]:   <source dev="/dev/sde"/>
Aug 14 16:50:00 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:50:00 user nova-compute[73056]:   <serial>6ae5a4a8-9820-4a4e-b77b-51139b7640e0</serial>
Aug 14 16:50:00 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 16:50:00 user nova-compute[73056]: </disk>
Aug 14 16:50:00 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 16:50:00 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-e6aa087c-d1b9-4da8-a282-5fa93f67fa3f tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Successfully detached device vdb from instance 61357ac0-230f-4711-8954-0bb04bfcb2f6 from the persistent domain config.
Aug 14 16:50:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-e6aa087c-d1b9-4da8-a282-5fa93f67fa3f tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 61357ac0-230f-4711-8954-0bb04bfcb2f6 from the live domain config. {{(pid=73056) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 16:50:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-e6aa087c-d1b9-4da8-a282-5fa93f67fa3f tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 16:50:00 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:50:00 user nova-compute[73056]:   <source dev="/dev/sde"/>
Aug 14 16:50:00 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:50:00 user nova-compute[73056]:   <serial>6ae5a4a8-9820-4a4e-b77b-51139b7640e0</serial>
Aug 14 16:50:00 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 16:50:00 user nova-compute[73056]: </disk>
Aug 14 16:50:00 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 16:50:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:00 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Received event <DeviceRemovedEvent: 1692031801.237857, 61357ac0-230f-4711-8954-0bb04bfcb2f6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73056) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-e6aa087c-d1b9-4da8-a282-5fa93f67fa3f tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 61357ac0-230f-4711-8954-0bb04bfcb2f6 {{(pid=73056) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 16:50:01 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-e6aa087c-d1b9-4da8-a282-5fa93f67fa3f tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Successfully detached device vdb from instance 61357ac0-230f-4711-8954-0bb04bfcb2f6 from the live domain config.
Aug 14 16:50:01 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6aa087c-d1b9-4da8-a282-5fa93f67fa3f tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6aa087c-d1b9-4da8-a282-5fa93f67fa3f tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OVnstvNM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:50:01 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-e6aa087c-d1b9-4da8-a282-5fa93f67fa3f tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:50:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-e6aa087c-d1b9-4da8-a282-5fa93f67fa3f tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-e6aa087c-d1b9-4da8-a282-5fa93f67fa3f tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6aa087c-d1b9-4da8-a282-5fa93f67fa3f tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b2cccf-0574-4bbb-a653-6396a0d1b2aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5270daf2-f983-4e59-a82b-a23ffd0087f6]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6aa087c-d1b9-4da8-a282-5fa93f67fa3f tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:50:01 user nova-compute[73056]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:50:01 user nova-compute[73056]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa (non-flash)
Aug 14 16:50:01 user nova-compute[73056]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0 (non-flash)
Aug 14 16:50:01 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6aa087c-d1b9-4da8-a282-5fa93f67fa3f tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:50:01 user nova-compute[73056]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:50:01 user nova-compute[73056]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa (non-flash)
Aug 14 16:50:01 user nova-compute[73056]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0 (non-flash)
Aug 14 16:50:01 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6aa087c-d1b9-4da8-a282-5fa93f67fa3f tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff2dcd5a200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0'): ({'sde'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-e6aa087c-d1b9-4da8-a282-5fa93f67fa3f tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Removing single pathed devices sde {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7737ddcb-74a1-469c-8caf-69f5f7ae3cf6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5774f460-3cde-42c6-bec2-c313b6954ff7]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-e6aa087c-d1b9-4da8-a282-5fa93f67fa3f tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Flushing IO for device /dev/sde {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[643019d6-888c-477a-ac97-7cb89786ae5d]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-e6aa087c-d1b9-4da8-a282-5fa93f67fa3f tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad38d24-63c8-4161-84a8-b1f7b30bfa06]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-e6aa087c-d1b9-4da8-a282-5fa93f67fa3f tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-e6aa087c-d1b9-4da8-a282-5fa93f67fa3f tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] SCSI volumes sde have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6aa087c-d1b9-4da8-a282-5fa93f67fa3f tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[73430bec-26a7-49a9-857d-7081483b480c]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6aa087c-d1b9-4da8-a282-5fa93f67fa3f tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0 -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d66610b-ec71-4104-b5ed-16555846827e]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6aa087c-d1b9-4da8-a282-5fa93f67fa3f tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0, portal: 172.16.0.220,3260]
Aug 14 16:50:01 user nova-compute[73056]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0, portal: 172.16.0.220,3260] successful.
Aug 14 16:50:01 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0 -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae5a4a8-9820-4a4e-b77b-51139b7640e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6669c7f-7fd8-417b-8428-d6ec1e006db8]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6aa087c-d1b9-4da8-a282-5fa93f67fa3f tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-e6aa087c-d1b9-4da8-a282-5fa93f67fa3f tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6aa087c-d1b9-4da8-a282-5fa93f67fa3f tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] <== disconnect_volume: return (332ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6aa087c-d1b9-4da8-a282-5fa93f67fa3f tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:50:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:02 user nova-compute[73056]: DEBUG nova.objects.instance [None req-e6aa087c-d1b9-4da8-a282-5fa93f67fa3f tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lazy-loading 'flavor' on Instance uuid 61357ac0-230f-4711-8954-0bb04bfcb2f6 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:50:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-e6aa087c-d1b9-4da8-a282-5fa93f67fa3f tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "61357ac0-230f-4711-8954-0bb04bfcb2f6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.849s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:50:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:50:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Acquiring lock "6910e1fe-8863-4a4b-b975-48c9ebb0b087" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:50:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lock "6910e1fe-8863-4a4b-b975-48c9ebb0b087" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:50:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:03 user nova-compute[73056]: DEBUG nova.compute.manager [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:50:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:50:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:50:03 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:50:03 user nova-compute[73056]: INFO nova.compute.claims [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Claim successful on node user
Aug 14 16:50:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ab3878-9362-4be0-a5bf-3759469473c9/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:03 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:50:03 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:50:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.569s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:50:03 user nova-compute[73056]: DEBUG nova.compute.manager [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:50:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ab3878-9362-4be0-a5bf-3759469473c9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ab3878-9362-4be0-a5bf-3759469473c9/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:04 user nova-compute[73056]: DEBUG nova.compute.manager [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:50:04 user nova-compute[73056]: DEBUG nova.network.neutron [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:50:04 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:50:04 user nova-compute[73056]: DEBUG nova.compute.manager [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:50:04 user nova-compute[73056]: INFO nova.virt.block_device [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Booting with volume 5ee0e8f1-8f40-460f-98df-7326372dac7d at /dev/vda
Aug 14 16:50:04 user nova-compute[73056]: DEBUG nova.policy [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd586451958914503bac9c1fb5dedea9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd21ca04890479e82483a51d05ba69b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:50:04 user nova-compute[73056]: DEBUG os_brick.utils [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:50:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22b1213-b61c-4193-98c2-de1cf75d6ad5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ab3878-9362-4be0-a5bf-3759469473c9/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7434b0db-72ae-478a-a276-cf3eeb1919c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2db9d4b-5b60-4746-aa0f-a3e38815bf50]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[104aa114-4617-44e1-a9aa-dbab7052f736]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:50:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:50:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:50:04 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:50:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ec953a-48d8-4070-8e3b-798a75c79543]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:50:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:50:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:50:04 user nova-compute[73056]: DEBUG os_brick.utils [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:50:04 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Updating existing volume attachment record: d18302cd-0237-4561-84cf-a4c880cf314b {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 16:50:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1546794-fd57-4215-a997-39059f213a15/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1546794-fd57-4215-a997-39059f213a15/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1546794-fd57-4215-a997-39059f213a15/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:04 user nova-compute[73056]: DEBUG nova.network.neutron [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Successfully created port: 9cdd486e-fc3e-4637-8958-eb7e065728fc {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:50:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1546794-fd57-4215-a997-39059f213a15/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:50:05 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:50:05 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:50:05 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=7065MB free_disk=25.410400390625GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 16:50:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:50:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:50:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:05 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Applying migration context for instance d79c2f2c-0870-4d8e-b468-36e63496b769 as it has an incoming, in-progress migration 122b3979-ee5c-4c34-acdc-1d30b77eb2ed. Migration status is finished {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 14 16:50:05 user nova-compute[73056]: INFO nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Updating resource usage from migration 122b3979-ee5c-4c34-acdc-1d30b77eb2ed
Aug 14 16:50:05 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 9f3a7f8a-e3b9-4918-9663-968677fe5c90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:50:05 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance b580e3d0-88b5-42a3-a953-84b94c088f41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:50:05 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 92c34cf0-fd39-49fc-9244-4da8ccae6eec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:50:05 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 7526c6c3-6d3c-435e-8fc7-742c08be44d0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:50:05 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 61357ac0-230f-4711-8954-0bb04bfcb2f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:50:05 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 74ab3878-9362-4be0-a5bf-3759469473c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:50:05 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance c1546794-fd57-4215-a997-39059f213a15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:50:05 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Migration 122b3979-ee5c-4c34-acdc-1d30b77eb2ed is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 14 16:50:05 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance d79c2f2c-0870-4d8e-b468-36e63496b769 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:50:05 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 9910444a-33ee-4937-9073-3b1f4d2f2fe9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:50:05 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance bcbe7449-6199-4e86-a8b6-c075e142aa34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:50:05 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 6910e1fe-8863-4a4b-b975-48c9ebb0b087 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:50:05 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 16:50:05 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 16:50:05 user nova-compute[73056]: DEBUG nova.network.neutron [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Successfully updated port: 9cdd486e-fc3e-4637-8958-eb7e065728fc {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:50:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Acquiring lock "refresh_cache-6910e1fe-8863-4a4b-b975-48c9ebb0b087" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:50:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Acquired lock "refresh_cache-6910e1fe-8863-4a4b-b975-48c9ebb0b087" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:50:05 user nova-compute[73056]: DEBUG nova.network.neutron [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:50:06 user nova-compute[73056]: DEBUG nova.compute.manager [req-8ada2113-3a11-4d0e-90be-07b6be1edd03 req-eb4da589-ece0-4efe-8c1d-8b2310ca87f0 service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Received event network-changed-9cdd486e-fc3e-4637-8958-eb7e065728fc {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:50:06 user nova-compute[73056]: DEBUG nova.compute.manager [req-8ada2113-3a11-4d0e-90be-07b6be1edd03 req-eb4da589-ece0-4efe-8c1d-8b2310ca87f0 service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Refreshing instance network info cache due to event network-changed-9cdd486e-fc3e-4637-8958-eb7e065728fc. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:50:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8ada2113-3a11-4d0e-90be-07b6be1edd03 req-eb4da589-ece0-4efe-8c1d-8b2310ca87f0 service nova] Acquiring lock "refresh_cache-6910e1fe-8863-4a4b-b975-48c9ebb0b087" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:50:06 user nova-compute[73056]: DEBUG nova.network.neutron [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:50:06 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:50:06 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:50:06 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 16:50:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.638s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:50:06 user nova-compute[73056]: DEBUG nova.network.neutron [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Updating instance_info_cache with network_info: [{"id": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "address": "fa:16:3e:ef:51:62", "network": {"id": "73253aa9-a146-4f82-b5bb-1cc2dc68755c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1632478330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd21ca04890479e82483a51d05ba69b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cdd486e-fc", "ovs_interfaceid": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:50:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Releasing lock "refresh_cache-6910e1fe-8863-4a4b-b975-48c9ebb0b087" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:50:06 user nova-compute[73056]: DEBUG nova.compute.manager [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Instance network_info: |[{"id": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "address": "fa:16:3e:ef:51:62", "network": {"id": "73253aa9-a146-4f82-b5bb-1cc2dc68755c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1632478330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd21ca04890479e82483a51d05ba69b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cdd486e-fc", "ovs_interfaceid": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:50:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8ada2113-3a11-4d0e-90be-07b6be1edd03 req-eb4da589-ece0-4efe-8c1d-8b2310ca87f0 service nova] Acquired lock "refresh_cache-6910e1fe-8863-4a4b-b975-48c9ebb0b087" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:50:06 user nova-compute[73056]: DEBUG nova.network.neutron [req-8ada2113-3a11-4d0e-90be-07b6be1edd03 req-eb4da589-ece0-4efe-8c1d-8b2310ca87f0 service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Refreshing network info cache for port 9cdd486e-fc3e-4637-8958-eb7e065728fc {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:50:06 user nova-compute[73056]: DEBUG nova.network.neutron [req-8ada2113-3a11-4d0e-90be-07b6be1edd03 req-eb4da589-ece0-4efe-8c1d-8b2310ca87f0 service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Updated VIF entry in instance network info cache for port 9cdd486e-fc3e-4637-8958-eb7e065728fc. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:50:06 user nova-compute[73056]: DEBUG nova.network.neutron [req-8ada2113-3a11-4d0e-90be-07b6be1edd03 req-eb4da589-ece0-4efe-8c1d-8b2310ca87f0 service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Updating instance_info_cache with network_info: [{"id": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "address": "fa:16:3e:ef:51:62", "network": {"id": "73253aa9-a146-4f82-b5bb-1cc2dc68755c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1632478330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd21ca04890479e82483a51d05ba69b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cdd486e-fc", "ovs_interfaceid": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:50:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8ada2113-3a11-4d0e-90be-07b6be1edd03 req-eb4da589-ece0-4efe-8c1d-8b2310ca87f0 service nova] Releasing lock "refresh_cache-6910e1fe-8863-4a4b-b975-48c9ebb0b087" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:50:07 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:50:07 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:50:07 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:50:07 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:50:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG nova.compute.manager [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:50:13 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Creating image(s)
Aug 14 16:50:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Did not create local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Ensure instance console log exists: /opt/stack/data/nova/instances/6910e1fe-8863-4a4b-b975-48c9ebb0b087/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Start _get_guest_xml network_info=[{"id": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "address": "fa:16:3e:ef:51:62", "network": {"id": "73253aa9-a146-4f82-b5bb-1cc2dc68755c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1632478330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd21ca04890479e82483a51d05ba69b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cdd486e-fc", "ovs_interfaceid": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BinUXqAW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6910e1fe-8863-4a4b-b975-48c9ebb0b087', 'attached_at': '', 'detached_at': '', 'volume_id': '5ee0e8f1-8f40-460f-98df-7326372dac7d', 'serial': '5ee0e8f1-8f40-460f-98df-7326372dac7d'}, 'attachment_id': 'd18302cd-0237-4561-84cf-a4c880cf314b', 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:50:13 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:50:13 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:50:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BinUXqAW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:50:13 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:50:13 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:50:13 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:50:13 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:50:13 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:50:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa849896-ec3e-4bf6-b4fb-132fd7fb2349]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:50:13 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[644d8a2c-2266-4187-a416-de03185f03f5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d] added
Aug 14 16:50:13 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c72ca0-e678-4cf4-aaeb-0b7caeb3895b]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdaf4adc-1199-438b-ba1d-01c6d38cfa20]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BinUXqAW {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BinUXqAW" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a75d15-1d1c-4ebf-bfbb-5045ca14e4d3]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BinUXqAW'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[523c6f4d-ad8c-4d97-8920-bf02cd0fe283]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca46e2c0-911f-4ffb-93aa-12133f87517d]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:50:13 user nova-compute[73056]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:50:13 user nova-compute[73056]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa (non-flash)
Aug 14 16:50:13 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:50:13 user nova-compute[73056]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:50:13 user nova-compute[73056]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa (non-flash)
Aug 14 16:50:13 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03ec252-37c9-4374-9fdb-abb3818622c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d, portal: 172.16.0.220,3260]
Aug 14 16:50:13 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d, portal: 172.16.0.220,3260] successful.
Aug 14 16:50:13 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6b70c2-22a6-4531-8e2d-ed569ede3612]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5933c68c-8ee1-41de-851f-41259c25bd32]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:50:13 user nova-compute[73056]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:50:13 user nova-compute[73056]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa (non-flash)
Aug 14 16:50:13 user nova-compute[73056]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)
Aug 14 16:50:13 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:50:13 user nova-compute[73056]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:50:13 user nova-compute[73056]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa (non-flash)
Aug 14 16:50:13 user nova-compute[73056]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)
Aug 14 16:50:13 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] HCTL ('36', '-', '-', 0) found on session 37 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ba8f88-8efe-4d23-8c93-8d76ab654ce8]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:50:13 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BinUXqAW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:50:14 user nova-compute[73056]: DEBUG nova.compute.manager [req-746b8a46-88e5-46bb-b21a-4cd39c3daf56 req-14260be5-7edb-44f2-a28e-0125ffc47b1e service nova] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Received event network-changed-01cf063c-b53e-44c8-9bf5-a858b9d8c316 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:50:14 user nova-compute[73056]: DEBUG nova.compute.manager [req-746b8a46-88e5-46bb-b21a-4cd39c3daf56 req-14260be5-7edb-44f2-a28e-0125ffc47b1e service nova] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Refreshing instance network info cache due to event network-changed-01cf063c-b53e-44c8-9bf5-a858b9d8c316. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:50:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-746b8a46-88e5-46bb-b21a-4cd39c3daf56 req-14260be5-7edb-44f2-a28e-0125ffc47b1e service nova] Acquiring lock "refresh_cache-74ab3878-9362-4be0-a5bf-3759469473c9" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:50:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-746b8a46-88e5-46bb-b21a-4cd39c3daf56 req-14260be5-7edb-44f2-a28e-0125ffc47b1e service nova] Acquired lock "refresh_cache-74ab3878-9362-4be0-a5bf-3759469473c9" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:50:14 user nova-compute[73056]: DEBUG nova.network.neutron [req-746b8a46-88e5-46bb-b21a-4cd39c3daf56 req-14260be5-7edb-44f2-a28e-0125ffc47b1e service nova] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Refreshing network info cache for port 01cf063c-b53e-44c8-9bf5-a858b9d8c316 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:50:14 user nova-compute[73056]: DEBUG nova.network.neutron [req-746b8a46-88e5-46bb-b21a-4cd39c3daf56 req-14260be5-7edb-44f2-a28e-0125ffc47b1e service nova] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Updated VIF entry in instance network info cache for port 01cf063c-b53e-44c8-9bf5-a858b9d8c316. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:50:14 user nova-compute[73056]: DEBUG nova.network.neutron [req-746b8a46-88e5-46bb-b21a-4cd39c3daf56 req-14260be5-7edb-44f2-a28e-0125ffc47b1e service nova] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Updating instance_info_cache with network_info: [{"id": "01cf063c-b53e-44c8-9bf5-a858b9d8c316", "address": "fa:16:3e:21:24:7a", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cf063c-b5", "ovs_interfaceid": "01cf063c-b53e-44c8-9bf5-a858b9d8c316", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:50:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-746b8a46-88e5-46bb-b21a-4cd39c3daf56 req-14260be5-7edb-44f2-a28e-0125ffc47b1e service nova] Releasing lock "refresh_cache-74ab3878-9362-4be0-a5bf-3759469473c9" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:50:14 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:50:14 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23031353166663362', 'path': '/dev/sde'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:50:14 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031353166663362', 'path': '/dev/sde'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:50:15 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:50:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-717451743',display_name='tempest-TestShelveInstance-server-717451743',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-717451743',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDhRa2OjjgafvbJzcWrUCAP3qcSeG+uScQ8aA6hOwczKubuJ9/RnKumPvOjbV+/S/S6PA9IzzUTPPv8AfFZzY4UVcbBr5jN47hcUBtIDD3aa8Tw2SRUV7hGEyr2sbVldg==',key_name='tempest-TestShelveInstance-1292582580',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dcd21ca04890479e82483a51d05ba69b',ramdisk_id='',reservation_id='r-288qfle8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-559346633',owner_user_name='tempest-TestShelveInstance-559346633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:50:04Z,user_data=None,user_id='d586451958914503bac9c1fb5dedea9e',uuid=6910e1fe-8863-4a4b-b975-48c9ebb0b087,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "address": "fa:16:3e:ef:51:62", "network": {"id": "73253aa9-a146-4f82-b5bb-1cc2dc68755c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1632478330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd21ca04890479e82483a51d05ba69b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cdd486e-fc", "ovs_interfaceid": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:50:15 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Converting VIF {"id": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "address": "fa:16:3e:ef:51:62", "network": {"id": "73253aa9-a146-4f82-b5bb-1cc2dc68755c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1632478330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd21ca04890479e82483a51d05ba69b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cdd486e-fc", "ovs_interfaceid": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:50:15 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:51:62,bridge_name='br-int',has_traffic_filtering=True,id=9cdd486e-fc3e-4637-8958-eb7e065728fc,network=Network(73253aa9-a146-4f82-b5bb-1cc2dc68755c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cdd486e-fc') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:50:15 user nova-compute[73056]: DEBUG nova.objects.instance [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lazy-loading 'pci_devices' on Instance uuid 6910e1fe-8863-4a4b-b975-48c9ebb0b087 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:50:15 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:50:15 user nova-compute[73056]:   <uuid>6910e1fe-8863-4a4b-b975-48c9ebb0b087</uuid>
Aug 14 16:50:15 user nova-compute[73056]:   <name>instance-00000021</name>
Aug 14 16:50:15 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:50:15 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:50:15 user nova-compute[73056]:   <metadata>
Aug 14 16:50:15 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:50:15 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:50:15 user nova-compute[73056]:       <nova:name>tempest-TestShelveInstance-server-717451743</nova:name>
Aug 14 16:50:15 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:50:13</nova:creationTime>
Aug 14 16:50:15 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:50:15 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:50:15 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:50:15 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:50:15 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:50:15 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:50:15 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:50:15 user nova-compute[73056]:       <nova:owner>
Aug 14 16:50:15 user nova-compute[73056]:         <nova:user uuid="d586451958914503bac9c1fb5dedea9e">tempest-TestShelveInstance-559346633-project-member</nova:user>
Aug 14 16:50:15 user nova-compute[73056]:         <nova:project uuid="dcd21ca04890479e82483a51d05ba69b">tempest-TestShelveInstance-559346633</nova:project>
Aug 14 16:50:15 user nova-compute[73056]:       </nova:owner>
Aug 14 16:50:15 user nova-compute[73056]:       <nova:ports>
Aug 14 16:50:15 user nova-compute[73056]:         <nova:port uuid="9cdd486e-fc3e-4637-8958-eb7e065728fc">
Aug 14 16:50:15 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 16:50:15 user nova-compute[73056]:         </nova:port>
Aug 14 16:50:15 user nova-compute[73056]:       </nova:ports>
Aug 14 16:50:15 user nova-compute[73056]:     </nova:instance>
Aug 14 16:50:15 user nova-compute[73056]:   </metadata>
Aug 14 16:50:15 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:50:15 user nova-compute[73056]:     <system>
Aug 14 16:50:15 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:50:15 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:50:15 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:50:15 user nova-compute[73056]:       <entry name="serial">6910e1fe-8863-4a4b-b975-48c9ebb0b087</entry>
Aug 14 16:50:15 user nova-compute[73056]:       <entry name="uuid">6910e1fe-8863-4a4b-b975-48c9ebb0b087</entry>
Aug 14 16:50:15 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:50:15 user nova-compute[73056]:     </system>
Aug 14 16:50:15 user nova-compute[73056]:   </sysinfo>
Aug 14 16:50:15 user nova-compute[73056]:   <os>
Aug 14 16:50:15 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:50:15 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:50:15 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:50:15 user nova-compute[73056]:   </os>
Aug 14 16:50:15 user nova-compute[73056]:   <features>
Aug 14 16:50:15 user nova-compute[73056]:     <acpi/>
Aug 14 16:50:15 user nova-compute[73056]:     <apic/>
Aug 14 16:50:15 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:50:15 user nova-compute[73056]:   </features>
Aug 14 16:50:15 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:50:15 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:50:15 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:50:15 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:50:15 user nova-compute[73056]:   </clock>
Aug 14 16:50:15 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:50:15 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:50:15 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:50:15 user nova-compute[73056]:   </cpu>
Aug 14 16:50:15 user nova-compute[73056]:   <devices>
Aug 14 16:50:15 user nova-compute[73056]:     <disk type="block" device="disk">
Aug 14 16:50:15 user nova-compute[73056]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:50:15 user nova-compute[73056]:       <source dev="/dev/sde"/>
Aug 14 16:50:15 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:50:15 user nova-compute[73056]:       <serial>5ee0e8f1-8f40-460f-98df-7326372dac7d</serial>
Aug 14 16:50:15 user nova-compute[73056]:     </disk>
Aug 14 16:50:15 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:50:15 user nova-compute[73056]:       <mac address="fa:16:3e:ef:51:62"/>
Aug 14 16:50:15 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:50:15 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:50:15 user nova-compute[73056]:       <target dev="tap9cdd486e-fc"/>
Aug 14 16:50:15 user nova-compute[73056]:     </interface>
Aug 14 16:50:15 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:50:15 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/6910e1fe-8863-4a4b-b975-48c9ebb0b087/console.log" append="off"/>
Aug 14 16:50:15 user nova-compute[73056]:     </serial>
Aug 14 16:50:15 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:50:15 user nova-compute[73056]:     <video>
Aug 14 16:50:15 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:50:15 user nova-compute[73056]:     </video>
Aug 14 16:50:15 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:50:15 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:50:15 user nova-compute[73056]:     </rng>
Aug 14 16:50:15 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:50:15 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:50:15 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:50:15 user nova-compute[73056]:     </memballoon>
Aug 14 16:50:15 user nova-compute[73056]:   </devices>
Aug 14 16:50:15 user nova-compute[73056]: </domain>
Aug 14 16:50:15 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:50:15 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:50:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-717451743',display_name='tempest-TestShelveInstance-server-717451743',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-717451743',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDhRa2OjjgafvbJzcWrUCAP3qcSeG+uScQ8aA6hOwczKubuJ9/RnKumPvOjbV+/S/S6PA9IzzUTPPv8AfFZzY4UVcbBr5jN47hcUBtIDD3aa8Tw2SRUV7hGEyr2sbVldg==',key_name='tempest-TestShelveInstance-1292582580',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dcd21ca04890479e82483a51d05ba69b',ramdisk_id='',reservation_id='r-288qfle8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-559346633',owner_user_name='tempest-TestShelveInstance-559346633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:50:04Z,user_data=None,user_id='d586451958914503bac9c1fb5dedea9e',uuid=6910e1fe-8863-4a4b-b975-48c9ebb0b087,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "address": "fa:16:3e:ef:51:62", "network": {"id": "73253aa9-a146-4f82-b5bb-1cc2dc68755c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1632478330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd21ca04890479e82483a51d05ba69b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cdd486e-fc", "ovs_interfaceid": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:50:15 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Converting VIF {"id": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "address": "fa:16:3e:ef:51:62", "network": {"id": "73253aa9-a146-4f82-b5bb-1cc2dc68755c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1632478330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd21ca04890479e82483a51d05ba69b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cdd486e-fc", "ovs_interfaceid": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:50:15 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:51:62,bridge_name='br-int',has_traffic_filtering=True,id=9cdd486e-fc3e-4637-8958-eb7e065728fc,network=Network(73253aa9-a146-4f82-b5bb-1cc2dc68755c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cdd486e-fc') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:50:15 user nova-compute[73056]: DEBUG os_vif [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:51:62,bridge_name='br-int',has_traffic_filtering=True,id=9cdd486e-fc3e-4637-8958-eb7e065728fc,network=Network(73253aa9-a146-4f82-b5bb-1cc2dc68755c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cdd486e-fc') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:50:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:50:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:50:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9cdd486e-fc, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:50:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9cdd486e-fc, col_values=(('external_ids', {'iface-id': '9cdd486e-fc3e-4637-8958-eb7e065728fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:51:62', 'vm-uuid': '6910e1fe-8863-4a4b-b975-48c9ebb0b087'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:50:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:50:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:15 user nova-compute[73056]: INFO os_vif [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:51:62,bridge_name='br-int',has_traffic_filtering=True,id=9cdd486e-fc3e-4637-8958-eb7e065728fc,network=Network(73253aa9-a146-4f82-b5bb-1cc2dc68755c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cdd486e-fc')
Aug 14 16:50:15 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:50:15 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] No VIF found with MAC fa:16:3e:ef:51:62, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:50:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:16 user nova-compute[73056]: DEBUG nova.compute.manager [req-335ba9ee-3b32-4d0f-a143-23781c365b89 req-f388279d-92d0-49ef-9085-72b18522f916 service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Received event network-vif-plugged-9cdd486e-fc3e-4637-8958-eb7e065728fc {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:50:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-335ba9ee-3b32-4d0f-a143-23781c365b89 req-f388279d-92d0-49ef-9085-72b18522f916 service nova] Acquiring lock "6910e1fe-8863-4a4b-b975-48c9ebb0b087-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:50:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-335ba9ee-3b32-4d0f-a143-23781c365b89 req-f388279d-92d0-49ef-9085-72b18522f916 service nova] Lock "6910e1fe-8863-4a4b-b975-48c9ebb0b087-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:50:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-335ba9ee-3b32-4d0f-a143-23781c365b89 req-f388279d-92d0-49ef-9085-72b18522f916 service nova] Lock "6910e1fe-8863-4a4b-b975-48c9ebb0b087-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:50:16 user nova-compute[73056]: DEBUG nova.compute.manager [req-335ba9ee-3b32-4d0f-a143-23781c365b89 req-f388279d-92d0-49ef-9085-72b18522f916 service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] No waiting events found dispatching network-vif-plugged-9cdd486e-fc3e-4637-8958-eb7e065728fc {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:50:16 user nova-compute[73056]: WARNING nova.compute.manager [req-335ba9ee-3b32-4d0f-a143-23781c365b89 req-f388279d-92d0-49ef-9085-72b18522f916 service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Received unexpected event network-vif-plugged-9cdd486e-fc3e-4637-8958-eb7e065728fc for instance with vm_state building and task_state spawning.
Aug 14 16:50:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:18 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031818.4216611, 6910e1fe-8863-4a4b-b975-48c9ebb0b087 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:50:18 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] VM Resumed (Lifecycle Event)
Aug 14 16:50:18 user nova-compute[73056]: DEBUG nova.compute.manager [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:50:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:50:18 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Instance spawned successfully.
Aug 14 16:50:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:50:18 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:50:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:50:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:50:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:50:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:50:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:50:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:50:18 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:50:18 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:50:18 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031818.4229698, 6910e1fe-8863-4a4b-b975-48c9ebb0b087 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:50:18 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] VM Started (Lifecycle Event)
Aug 14 16:50:18 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:50:18 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:50:18 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:50:18 user nova-compute[73056]: INFO nova.compute.manager [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Took 4.97 seconds to spawn the instance on the hypervisor.
Aug 14 16:50:18 user nova-compute[73056]: DEBUG nova.compute.manager [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:50:18 user nova-compute[73056]: INFO nova.compute.manager [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Took 15.33 seconds to build instance.
Aug 14 16:50:18 user nova-compute[73056]: DEBUG nova.compute.manager [req-12c2820b-22ff-446c-b680-7e3ce180f30c req-eb172feb-238c-4489-b075-5e18359fd60a service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Received event network-vif-plugged-9cdd486e-fc3e-4637-8958-eb7e065728fc {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:50:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-12c2820b-22ff-446c-b680-7e3ce180f30c req-eb172feb-238c-4489-b075-5e18359fd60a service nova] Acquiring lock "6910e1fe-8863-4a4b-b975-48c9ebb0b087-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:50:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-12c2820b-22ff-446c-b680-7e3ce180f30c req-eb172feb-238c-4489-b075-5e18359fd60a service nova] Lock "6910e1fe-8863-4a4b-b975-48c9ebb0b087-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:50:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-12c2820b-22ff-446c-b680-7e3ce180f30c req-eb172feb-238c-4489-b075-5e18359fd60a service nova] Lock "6910e1fe-8863-4a4b-b975-48c9ebb0b087-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:50:18 user nova-compute[73056]: DEBUG nova.compute.manager [req-12c2820b-22ff-446c-b680-7e3ce180f30c req-eb172feb-238c-4489-b075-5e18359fd60a service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] No waiting events found dispatching network-vif-plugged-9cdd486e-fc3e-4637-8958-eb7e065728fc {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:50:18 user nova-compute[73056]: WARNING nova.compute.manager [req-12c2820b-22ff-446c-b680-7e3ce180f30c req-eb172feb-238c-4489-b075-5e18359fd60a service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Received unexpected event network-vif-plugged-9cdd486e-fc3e-4637-8958-eb7e065728fc for instance with vm_state active and task_state None.
Aug 14 16:50:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-734b0067-ba8d-48d0-84df-ebe702cdd393 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lock "6910e1fe-8863-4a4b-b975-48c9ebb0b087" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.469s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:50:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "74ab3878-9362-4be0-a5bf-3759469473c9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:50:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "74ab3878-9362-4be0-a5bf-3759469473c9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:50:19 user nova-compute[73056]: DEBUG nova.objects.instance [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lazy-loading 'flavor' on Instance uuid 74ab3878-9362-4be0-a5bf-3759469473c9 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:50:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "74ab3878-9362-4be0-a5bf-3759469473c9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:50:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "74ab3878-9362-4be0-a5bf-3759469473c9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:50:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "74ab3878-9362-4be0-a5bf-3759469473c9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:50:19 user nova-compute[73056]: INFO nova.compute.manager [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Attaching volume 989d64e3-44db-40d4-a57d-37880929827d to /dev/vdb
Aug 14 16:50:19 user nova-compute[73056]: DEBUG os_brick.utils [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:50:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:19 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9f4a05-8d38-4833-8cf5-23e36b9d58d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:19 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e012df-d8b2-4b5a-b141-11916594391a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:19 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da0d074-1476-4cf1-88b1-99bf7422d39d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:19 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d812d18-90ec-4161-a11c-32929faff2d0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:50:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:50:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:50:19 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:50:19 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b348c8b4-8ed6-4b90-b4b8-a255012d20b3]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:50:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:50:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:50:19 user nova-compute[73056]: DEBUG os_brick.utils [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:50:19 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Updating existing volume attachment record: b7abc6bf-b151-45d7-9779-3551169ca607 {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 16:50:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bccd5b2f-4df0-4c13-aca4-4b20ab7945c1 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Acquiring lock "c1546794-fd57-4215-a997-39059f213a15" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:50:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bccd5b2f-4df0-4c13-aca4-4b20ab7945c1 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Lock "c1546794-fd57-4215-a997-39059f213a15" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:50:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bccd5b2f-4df0-4c13-aca4-4b20ab7945c1 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Acquiring lock "c1546794-fd57-4215-a997-39059f213a15-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:50:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bccd5b2f-4df0-4c13-aca4-4b20ab7945c1 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Lock "c1546794-fd57-4215-a997-39059f213a15-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:50:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bccd5b2f-4df0-4c13-aca4-4b20ab7945c1 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Lock "c1546794-fd57-4215-a997-39059f213a15-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:50:27 user nova-compute[73056]: INFO nova.compute.manager [None req-bccd5b2f-4df0-4c13-aca4-4b20ab7945c1 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] [instance: c1546794-fd57-4215-a997-39059f213a15] Terminating instance
Aug 14 16:50:27 user nova-compute[73056]: DEBUG nova.compute.manager [None req-bccd5b2f-4df0-4c13-aca4-4b20ab7945c1 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] [instance: c1546794-fd57-4215-a997-39059f213a15] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 16:50:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:28 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: c1546794-fd57-4215-a997-39059f213a15] Instance destroyed successfully.
Aug 14 16:50:28 user nova-compute[73056]: DEBUG nova.objects.instance [None req-bccd5b2f-4df0-4c13-aca4-4b20ab7945c1 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Lazy-loading 'resources' on Instance uuid c1546794-fd57-4215-a997-39059f213a15 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-bccd5b2f-4df0-4c13-aca4-4b20ab7945c1 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:48:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1267792774',display_name='tempest-VolumesNegativeTest-instance-1267792774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1267792774',id=30,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:48:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f914f34411834a5ebd7a4133decf5804',ramdisk_id='',reservation_id='r-e82e3wds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-736999191',owner_user_name='tempest-VolumesNegativeTest-736999191-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:48:48Z,user_data=None,user_id='e0c43770efa24f4b81d2455d04610f4b',uuid=c1546794-fd57-4215-a997-39059f213a15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5721964-4792-4d0a-bae4-107701dbfabd", "address": "fa:16:3e:d9:0a:4b", "network": {"id": "72a6c745-f95a-4734-83b4-d013a21fdc9e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e74ab11f44a44d9a834e80f2683d87d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5721964-47", "ovs_interfaceid": "e5721964-4792-4d0a-bae4-107701dbfabd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-bccd5b2f-4df0-4c13-aca4-4b20ab7945c1 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Converting VIF {"id": "e5721964-4792-4d0a-bae4-107701dbfabd", "address": "fa:16:3e:d9:0a:4b", "network": {"id": "72a6c745-f95a-4734-83b4-d013a21fdc9e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e74ab11f44a44d9a834e80f2683d87d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5721964-47", "ovs_interfaceid": "e5721964-4792-4d0a-bae4-107701dbfabd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-bccd5b2f-4df0-4c13-aca4-4b20ab7945c1 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:0a:4b,bridge_name='br-int',has_traffic_filtering=True,id=e5721964-4792-4d0a-bae4-107701dbfabd,network=Network(72a6c745-f95a-4734-83b4-d013a21fdc9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5721964-47') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG os_vif [None req-bccd5b2f-4df0-4c13-aca4-4b20ab7945c1 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:0a:4b,bridge_name='br-int',has_traffic_filtering=True,id=e5721964-4792-4d0a-bae4-107701dbfabd,network=Network(72a6c745-f95a-4734-83b4-d013a21fdc9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5721964-47') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape5721964-47, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:50:28 user nova-compute[73056]: INFO os_vif [None req-bccd5b2f-4df0-4c13-aca4-4b20ab7945c1 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:0a:4b,bridge_name='br-int',has_traffic_filtering=True,id=e5721964-4792-4d0a-bae4-107701dbfabd,network=Network(72a6c745-f95a-4734-83b4-d013a21fdc9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5721964-47')
Aug 14 16:50:28 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-bccd5b2f-4df0-4c13-aca4-4b20ab7945c1 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] [instance: c1546794-fd57-4215-a997-39059f213a15] Deleting instance files /opt/stack/data/nova/instances/c1546794-fd57-4215-a997-39059f213a15_del
Aug 14 16:50:28 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-bccd5b2f-4df0-4c13-aca4-4b20ab7945c1 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] [instance: c1546794-fd57-4215-a997-39059f213a15] Deletion of /opt/stack/data/nova/instances/c1546794-fd57-4215-a997-39059f213a15_del complete
Aug 14 16:50:28 user nova-compute[73056]: INFO nova.compute.manager [None req-bccd5b2f-4df0-4c13-aca4-4b20ab7945c1 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] [instance: c1546794-fd57-4215-a997-39059f213a15] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 14 16:50:28 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-bccd5b2f-4df0-4c13-aca4-4b20ab7945c1 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: c1546794-fd57-4215-a997-39059f213a15] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: c1546794-fd57-4215-a997-39059f213a15] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG nova.compute.manager [req-64f6aea5-ce45-4346-81f3-9457e8386447 req-0fdc8070-0f15-4f03-919d-8a52df60f5ee service nova] [instance: c1546794-fd57-4215-a997-39059f213a15] Received event network-vif-unplugged-e5721964-4792-4d0a-bae4-107701dbfabd {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-64f6aea5-ce45-4346-81f3-9457e8386447 req-0fdc8070-0f15-4f03-919d-8a52df60f5ee service nova] Acquiring lock "c1546794-fd57-4215-a997-39059f213a15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-64f6aea5-ce45-4346-81f3-9457e8386447 req-0fdc8070-0f15-4f03-919d-8a52df60f5ee service nova] Lock "c1546794-fd57-4215-a997-39059f213a15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-64f6aea5-ce45-4346-81f3-9457e8386447 req-0fdc8070-0f15-4f03-919d-8a52df60f5ee service nova] Lock "c1546794-fd57-4215-a997-39059f213a15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG nova.compute.manager [req-64f6aea5-ce45-4346-81f3-9457e8386447 req-0fdc8070-0f15-4f03-919d-8a52df60f5ee service nova] [instance: c1546794-fd57-4215-a997-39059f213a15] No waiting events found dispatching network-vif-unplugged-e5721964-4792-4d0a-bae4-107701dbfabd {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG nova.compute.manager [req-64f6aea5-ce45-4346-81f3-9457e8386447 req-0fdc8070-0f15-4f03-919d-8a52df60f5ee service nova] [instance: c1546794-fd57-4215-a997-39059f213a15] Received event network-vif-unplugged-e5721964-4792-4d0a-bae4-107701dbfabd for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIlxePBO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:50:28 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:50:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:50:28 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:50:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:50:28 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:50:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[28da5a32-3103-40ae-ab07-56f8db90f1a5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:50:28 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb95829-4ffd-4927-9387-6945eb2009d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d] added
Aug 14 16:50:28 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b534f0c2-39cd-4a21-b6a3-6bb6fab8162d]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6da801e-6f28-46c2-9420-dfe96b8690a3]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yIlxePBO {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yIlxePBO" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fccaaa7-813b-45e5-9c06-43f00b3543dc]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yIlxePBO'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cead1f-003a-450f-82c5-ac2f416d7d86]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:50:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:29 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: c1546794-fd57-4215-a997-39059f213a15] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:50:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:29 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6978d5-4566-468b-a029-4b1453321aea]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:29 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:50:29 user nova-compute[73056]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:50:29 user nova-compute[73056]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa (non-flash)
Aug 14 16:50:29 user nova-compute[73056]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)
Aug 14 16:50:29 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:50:29 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:50:29 user nova-compute[73056]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:50:29 user nova-compute[73056]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa (non-flash)
Aug 14 16:50:29 user nova-compute[73056]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)
Aug 14 16:50:29 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:50:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:29 user nova-compute[73056]: DEBUG nova.compute.manager [req-b4418363-a7cc-42d0-b4e2-42f51519bed4 req-aabefa20-6c4c-4877-9006-423d04220097 service nova] [instance: c1546794-fd57-4215-a997-39059f213a15] Received event network-vif-deleted-e5721964-4792-4d0a-bae4-107701dbfabd {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:50:29 user nova-compute[73056]: INFO nova.compute.manager [req-b4418363-a7cc-42d0-b4e2-42f51519bed4 req-aabefa20-6c4c-4877-9006-423d04220097 service nova] [instance: c1546794-fd57-4215-a997-39059f213a15] Neutron deleted interface e5721964-4792-4d0a-bae4-107701dbfabd; detaching it from the instance and deleting it from the info cache
Aug 14 16:50:29 user nova-compute[73056]: DEBUG nova.network.neutron [req-b4418363-a7cc-42d0-b4e2-42f51519bed4 req-aabefa20-6c4c-4877-9006-423d04220097 service nova] [instance: c1546794-fd57-4215-a997-39059f213a15] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:50:29 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: c1546794-fd57-4215-a997-39059f213a15] Took 0.58 seconds to deallocate network for instance.
Aug 14 16:50:29 user nova-compute[73056]: DEBUG nova.compute.manager [req-b4418363-a7cc-42d0-b4e2-42f51519bed4 req-aabefa20-6c4c-4877-9006-423d04220097 service nova] [instance: c1546794-fd57-4215-a997-39059f213a15] Detach interface failed, port_id=e5721964-4792-4d0a-bae4-107701dbfabd, reason: Instance c1546794-fd57-4215-a997-39059f213a15 could not be found. {{(pid=73056) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 16:50:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:29 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67c7ee1-d272-4350-9c27-63c086942616]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:29 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d, portal: 172.16.0.220,3260]
Aug 14 16:50:29 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d, portal: 172.16.0.220,3260] successful.
Aug 14 16:50:29 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:50:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bccd5b2f-4df0-4c13-aca4-4b20ab7945c1 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:50:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bccd5b2f-4df0-4c13-aca4-4b20ab7945c1 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:50:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:29 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b67ec06-05d1-427d-8d3c-c8077b7636b2]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:29 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:50:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:29 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d969299-c8d0-4b65-a55b-bfefc6140e38]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:29 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:50:29 user nova-compute[73056]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:50:29 user nova-compute[73056]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa (non-flash)
Aug 14 16:50:29 user nova-compute[73056]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)
Aug 14 16:50:29 user nova-compute[73056]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d (non-flash)
Aug 14 16:50:29 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:50:29 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:50:29 user nova-compute[73056]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:50:29 user nova-compute[73056]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa (non-flash)
Aug 14 16:50:29 user nova-compute[73056]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)
Aug 14 16:50:29 user nova-compute[73056]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d (non-flash)
Aug 14 16:50:29 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:50:29 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:50:29 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:50:29 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] HCTL ('37', '-', '-', 0) found on session 38 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:50:29 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:50:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:29 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a8ef0d-3c8e-4133-9e65-fab3857fb27d]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:29 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: None {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:50:29 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-bccd5b2f-4df0-4c13-aca4-4b20ab7945c1 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:50:29 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-bccd5b2f-4df0-4c13-aca4-4b20ab7945c1 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:50:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bccd5b2f-4df0-4c13-aca4-4b20ab7945c1 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.396s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:50:29 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-bccd5b2f-4df0-4c13-aca4-4b20ab7945c1 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Deleted allocations for instance c1546794-fd57-4215-a997-39059f213a15
Aug 14 16:50:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-bccd5b2f-4df0-4c13-aca4-4b20ab7945c1 tempest-VolumesNegativeTest-736999191 tempest-VolumesNegativeTest-736999191-project-member] Lock "c1546794-fd57-4215-a997-39059f213a15" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.116s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:50:30 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:50:30 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIlxePBO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:50:30 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:50:30 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26162626433373934', 'path': '/dev/sdf'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:50:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162626433373934', 'path': '/dev/sdf'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:50:30 user nova-compute[73056]: DEBUG nova.objects.instance [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lazy-loading 'flavor' on Instance uuid 74ab3878-9362-4be0-a5bf-3759469473c9 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:50:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 16:50:30 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:50:30 user nova-compute[73056]:   <source dev="/dev/sdf"/>
Aug 14 16:50:30 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:50:30 user nova-compute[73056]:   <serial>989d64e3-44db-40d4-a57d-37880929827d</serial>
Aug 14 16:50:30 user nova-compute[73056]: </disk>
Aug 14 16:50:30 user nova-compute[73056]:  {{(pid=73056) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 16:50:30 user nova-compute[73056]: DEBUG nova.compute.manager [req-94af3dbc-7d6c-4056-b90a-7b3ef309927e req-a1d54c52-d786-4e55-9cf0-ac7910333d98 service nova] [instance: c1546794-fd57-4215-a997-39059f213a15] Received event network-vif-plugged-e5721964-4792-4d0a-bae4-107701dbfabd {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:50:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-94af3dbc-7d6c-4056-b90a-7b3ef309927e req-a1d54c52-d786-4e55-9cf0-ac7910333d98 service nova] Acquiring lock "c1546794-fd57-4215-a997-39059f213a15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:50:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-94af3dbc-7d6c-4056-b90a-7b3ef309927e req-a1d54c52-d786-4e55-9cf0-ac7910333d98 service nova] Lock "c1546794-fd57-4215-a997-39059f213a15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:50:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-94af3dbc-7d6c-4056-b90a-7b3ef309927e req-a1d54c52-d786-4e55-9cf0-ac7910333d98 service nova] Lock "c1546794-fd57-4215-a997-39059f213a15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:50:30 user nova-compute[73056]: DEBUG nova.compute.manager [req-94af3dbc-7d6c-4056-b90a-7b3ef309927e req-a1d54c52-d786-4e55-9cf0-ac7910333d98 service nova] [instance: c1546794-fd57-4215-a997-39059f213a15] No waiting events found dispatching network-vif-plugged-e5721964-4792-4d0a-bae4-107701dbfabd {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:50:30 user nova-compute[73056]: WARNING nova.compute.manager [req-94af3dbc-7d6c-4056-b90a-7b3ef309927e req-a1d54c52-d786-4e55-9cf0-ac7910333d98 service nova] [instance: c1546794-fd57-4215-a997-39059f213a15] Received unexpected event network-vif-plugged-e5721964-4792-4d0a-bae4-107701dbfabd for instance with vm_state deleted and task_state None.
Aug 14 16:50:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:50:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:50:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] No VIF found with MAC fa:16:3e:21:24:7a, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:50:30 user nova-compute[73056]: INFO nova.compute.manager [None req-0f7b713c-5a4b-400f-aa66-8aa9b785ab97 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Unrescuing
Aug 14 16:50:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0f7b713c-5a4b-400f-aa66-8aa9b785ab97 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "refresh_cache-b580e3d0-88b5-42a3-a953-84b94c088f41" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:50:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0f7b713c-5a4b-400f-aa66-8aa9b785ab97 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquired lock "refresh_cache-b580e3d0-88b5-42a3-a953-84b94c088f41" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:50:30 user nova-compute[73056]: DEBUG nova.network.neutron [None req-0f7b713c-5a4b-400f-aa66-8aa9b785ab97 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:50:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-1d4d7959-3f9d-46f7-bfa8-8aee7efd69de tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "74ab3878-9362-4be0-a5bf-3759469473c9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.386s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:50:31 user nova-compute[73056]: DEBUG nova.network.neutron [None req-0f7b713c-5a4b-400f-aa66-8aa9b785ab97 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Updating instance_info_cache with network_info: [{"id": "b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0", "address": "fa:16:3e:f9:ca:00", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb006576a-8b", "ovs_interfaceid": "b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:50:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0f7b713c-5a4b-400f-aa66-8aa9b785ab97 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Releasing lock "refresh_cache-b580e3d0-88b5-42a3-a953-84b94c088f41" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:50:31 user nova-compute[73056]: DEBUG nova.objects.instance [None req-0f7b713c-5a4b-400f-aa66-8aa9b785ab97 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lazy-loading 'flavor' on Instance uuid b580e3d0-88b5-42a3-a953-84b94c088f41 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:50:31 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:31 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:31 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:31 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0129f4b4-2338-4894-a974-1226b61bdd08 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "74ab3878-9362-4be0-a5bf-3759469473c9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:50:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0129f4b4-2338-4894-a974-1226b61bdd08 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "74ab3878-9362-4be0-a5bf-3759469473c9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:50:31 user nova-compute[73056]: INFO nova.compute.manager [None req-0129f4b4-2338-4894-a974-1226b61bdd08 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Detaching volume 989d64e3-44db-40d4-a57d-37880929827d
Aug 14 16:50:31 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Instance destroyed successfully.
Aug 14 16:50:31 user nova-compute[73056]: INFO nova.virt.block_device [None req-0129f4b4-2338-4894-a974-1226b61bdd08 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Attempting to driver detach volume 989d64e3-44db-40d4-a57d-37880929827d from mountpoint /dev/vdb
Aug 14 16:50:31 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-0129f4b4-2338-4894-a974-1226b61bdd08 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Attempting to detach device vdb from instance 74ab3878-9362-4be0-a5bf-3759469473c9 from the persistent domain config. {{(pid=73056) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 16:50:31 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-0129f4b4-2338-4894-a974-1226b61bdd08 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 16:50:31 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:50:31 user nova-compute[73056]:   <source dev="/dev/sdf"/>
Aug 14 16:50:31 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:50:31 user nova-compute[73056]:   <serial>989d64e3-44db-40d4-a57d-37880929827d</serial>
Aug 14 16:50:31 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 16:50:31 user nova-compute[73056]: </disk>
Aug 14 16:50:31 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 16:50:31 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-0129f4b4-2338-4894-a974-1226b61bdd08 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Successfully detached device vdb from instance 74ab3878-9362-4be0-a5bf-3759469473c9 from the persistent domain config.
Aug 14 16:50:31 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-0129f4b4-2338-4894-a974-1226b61bdd08 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 74ab3878-9362-4be0-a5bf-3759469473c9 from the live domain config. {{(pid=73056) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 16:50:31 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-0129f4b4-2338-4894-a974-1226b61bdd08 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 16:50:31 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:50:31 user nova-compute[73056]:   <source dev="/dev/sdf"/>
Aug 14 16:50:31 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:50:31 user nova-compute[73056]:   <serial>989d64e3-44db-40d4-a57d-37880929827d</serial>
Aug 14 16:50:31 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 16:50:31 user nova-compute[73056]: </disk>
Aug 14 16:50:31 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Received event <DeviceRemovedEvent: 1692031832.4402654, 74ab3878-9362-4be0-a5bf-3759469473c9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73056) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-0129f4b4-2338-4894-a974-1226b61bdd08 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 74ab3878-9362-4be0-a5bf-3759469473c9 {{(pid=73056) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 16:50:32 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-0129f4b4-2338-4894-a974-1226b61bdd08 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Successfully detached device vdb from instance 74ab3878-9362-4be0-a5bf-3759469473c9 from the live domain config.
Aug 14 16:50:32 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0129f4b4-2338-4894-a974-1226b61bdd08 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0129f4b4-2338-4894-a974-1226b61bdd08 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIlxePBO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:50:32 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-0129f4b4-2338-4894-a974-1226b61bdd08 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:50:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-0129f4b4-2338-4894-a974-1226b61bdd08 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-0129f4b4-2338-4894-a974-1226b61bdd08 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0129f4b4-2338-4894-a974-1226b61bdd08 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efbfe46-d3c5-4bc6-98b7-c706e567f5c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af31d7d-a8cb-43ea-b073-a4aaaa1999cc]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0129f4b4-2338-4894-a974-1226b61bdd08 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:50:32 user nova-compute[73056]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:50:32 user nova-compute[73056]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa (non-flash)
Aug 14 16:50:32 user nova-compute[73056]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)
Aug 14 16:50:32 user nova-compute[73056]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d (non-flash)
Aug 14 16:50:32 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0129f4b4-2338-4894-a974-1226b61bdd08 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:50:32 user nova-compute[73056]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:50:32 user nova-compute[73056]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa (non-flash)
Aug 14 16:50:32 user nova-compute[73056]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)
Aug 14 16:50:32 user nova-compute[73056]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d (non-flash)
Aug 14 16:50:32 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0129f4b4-2338-4894-a974-1226b61bdd08 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff300342680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d'): ({'sdf'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-0129f4b4-2338-4894-a974-1226b61bdd08 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Removing single pathed devices sdf {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a5f8a0-3a76-40e8-8e38-cb36378029ca]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[60325744-adbf-4a93-a82b-f6e0fdd637d8]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-0129f4b4-2338-4894-a974-1226b61bdd08 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Flushing IO for device /dev/sdf {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac59632b-d666-4897-85c4-df3a948af7f9]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-0129f4b4-2338-4894-a974-1226b61bdd08 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b8cf42-0c54-4989-9cb1-c544434438c4]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-0129f4b4-2338-4894-a974-1226b61bdd08 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-0129f4b4-2338-4894-a974-1226b61bdd08 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] SCSI volumes sdf have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0129f4b4-2338-4894-a974-1226b61bdd08 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d74ec69-e0f0-4ee4-990e-d197ccebc7e3]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0129f4b4-2338-4894-a974-1226b61bdd08 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG nova.compute.manager [req-d5ba7b85-5b43-4f1f-a382-ad6d24dc93b3 req-db2f08e6-86ed-45f4-b779-da97496ddda7 service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Received event network-vif-unplugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-d5ba7b85-5b43-4f1f-a382-ad6d24dc93b3 req-db2f08e6-86ed-45f4-b779-da97496ddda7 service nova] Acquiring lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-d5ba7b85-5b43-4f1f-a382-ad6d24dc93b3 req-db2f08e6-86ed-45f4-b779-da97496ddda7 service nova] Lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-d5ba7b85-5b43-4f1f-a382-ad6d24dc93b3 req-db2f08e6-86ed-45f4-b779-da97496ddda7 service nova] Lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG nova.compute.manager [req-d5ba7b85-5b43-4f1f-a382-ad6d24dc93b3 req-db2f08e6-86ed-45f4-b779-da97496ddda7 service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] No waiting events found dispatching network-vif-unplugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:50:32 user nova-compute[73056]: WARNING nova.compute.manager [req-d5ba7b85-5b43-4f1f-a382-ad6d24dc93b3 req-db2f08e6-86ed-45f4-b779-da97496ddda7 service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Received unexpected event network-vif-unplugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 for instance with vm_state rescued and task_state unrescuing.
Aug 14 16:50:32 user nova-compute[73056]: DEBUG nova.compute.manager [req-d5ba7b85-5b43-4f1f-a382-ad6d24dc93b3 req-db2f08e6-86ed-45f4-b779-da97496ddda7 service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Received event network-vif-plugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-d5ba7b85-5b43-4f1f-a382-ad6d24dc93b3 req-db2f08e6-86ed-45f4-b779-da97496ddda7 service nova] Acquiring lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-d5ba7b85-5b43-4f1f-a382-ad6d24dc93b3 req-db2f08e6-86ed-45f4-b779-da97496ddda7 service nova] Lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-d5ba7b85-5b43-4f1f-a382-ad6d24dc93b3 req-db2f08e6-86ed-45f4-b779-da97496ddda7 service nova] Lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG nova.compute.manager [req-d5ba7b85-5b43-4f1f-a382-ad6d24dc93b3 req-db2f08e6-86ed-45f4-b779-da97496ddda7 service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] No waiting events found dispatching network-vif-plugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:50:32 user nova-compute[73056]: WARNING nova.compute.manager [req-d5ba7b85-5b43-4f1f-a382-ad6d24dc93b3 req-db2f08e6-86ed-45f4-b779-da97496ddda7 service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Received unexpected event network-vif-plugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 for instance with vm_state rescued and task_state unrescuing.
Aug 14 16:50:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e593587a-c374-49b2-869e-dab800a02d29]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0129f4b4-2338-4894-a974-1226b61bdd08 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d, portal: 172.16.0.220,3260]
Aug 14 16:50:32 user nova-compute[73056]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d, portal: 172.16.0.220,3260] successful.
Aug 14 16:50:32 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:989d64e3-44db-40d4-a57d-37880929827d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[669cdaf7-de35-4f2b-bde3-282934c9c5d5]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0129f4b4-2338-4894-a974-1226b61bdd08 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-0129f4b4-2338-4894-a974-1226b61bdd08 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0129f4b4-2338-4894-a974-1226b61bdd08 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] <== disconnect_volume: return (313ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:50:32 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0129f4b4-2338-4894-a974-1226b61bdd08 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:50:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:33 user nova-compute[73056]: DEBUG nova.objects.instance [None req-0129f4b4-2338-4894-a974-1226b61bdd08 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lazy-loading 'flavor' on Instance uuid 74ab3878-9362-4be0-a5bf-3759469473c9 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:50:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0129f4b4-2338-4894-a974-1226b61bdd08 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "74ab3878-9362-4be0-a5bf-3759469473c9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.934s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:50:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:34 user nova-compute[73056]: DEBUG nova.compute.manager [req-768661f8-b9d1-45f5-bba5-2130ae3ec7e9 req-e8628ec1-54a6-419e-9299-6214fa4ca1a2 service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Received event network-vif-plugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:50:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-768661f8-b9d1-45f5-bba5-2130ae3ec7e9 req-e8628ec1-54a6-419e-9299-6214fa4ca1a2 service nova] Acquiring lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:50:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-768661f8-b9d1-45f5-bba5-2130ae3ec7e9 req-e8628ec1-54a6-419e-9299-6214fa4ca1a2 service nova] Lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:50:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-768661f8-b9d1-45f5-bba5-2130ae3ec7e9 req-e8628ec1-54a6-419e-9299-6214fa4ca1a2 service nova] Lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:50:34 user nova-compute[73056]: DEBUG nova.compute.manager [req-768661f8-b9d1-45f5-bba5-2130ae3ec7e9 req-e8628ec1-54a6-419e-9299-6214fa4ca1a2 service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] No waiting events found dispatching network-vif-plugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:50:34 user nova-compute[73056]: WARNING nova.compute.manager [req-768661f8-b9d1-45f5-bba5-2130ae3ec7e9 req-e8628ec1-54a6-419e-9299-6214fa4ca1a2 service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Received unexpected event network-vif-plugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 for instance with vm_state rescued and task_state unrescuing.
Aug 14 16:50:34 user nova-compute[73056]: DEBUG nova.compute.manager [req-768661f8-b9d1-45f5-bba5-2130ae3ec7e9 req-e8628ec1-54a6-419e-9299-6214fa4ca1a2 service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Received event network-vif-plugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:50:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-768661f8-b9d1-45f5-bba5-2130ae3ec7e9 req-e8628ec1-54a6-419e-9299-6214fa4ca1a2 service nova] Acquiring lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:50:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-768661f8-b9d1-45f5-bba5-2130ae3ec7e9 req-e8628ec1-54a6-419e-9299-6214fa4ca1a2 service nova] Lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:50:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-768661f8-b9d1-45f5-bba5-2130ae3ec7e9 req-e8628ec1-54a6-419e-9299-6214fa4ca1a2 service nova] Lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:50:34 user nova-compute[73056]: DEBUG nova.compute.manager [req-768661f8-b9d1-45f5-bba5-2130ae3ec7e9 req-e8628ec1-54a6-419e-9299-6214fa4ca1a2 service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] No waiting events found dispatching network-vif-plugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:50:34 user nova-compute[73056]: WARNING nova.compute.manager [req-768661f8-b9d1-45f5-bba5-2130ae3ec7e9 req-e8628ec1-54a6-419e-9299-6214fa4ca1a2 service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Received unexpected event network-vif-plugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 for instance with vm_state rescued and task_state unrescuing.
Aug 14 16:50:35 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-24d69496-0413-4e48-81a9-2768b1df554f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "d79c2f2c-0870-4d8e-b468-36e63496b769" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:50:35 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-24d69496-0413-4e48-81a9-2768b1df554f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "d79c2f2c-0870-4d8e-b468-36e63496b769" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:50:35 user nova-compute[73056]: DEBUG nova.compute.manager [None req-24d69496-0413-4e48-81a9-2768b1df554f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Going to confirm migration 2 {{(pid=73056) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 14 16:50:35 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-24d69496-0413-4e48-81a9-2768b1df554f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "refresh_cache-d79c2f2c-0870-4d8e-b468-36e63496b769" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:50:35 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-24d69496-0413-4e48-81a9-2768b1df554f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquired lock "refresh_cache-d79c2f2c-0870-4d8e-b468-36e63496b769" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:50:35 user nova-compute[73056]: DEBUG nova.network.neutron [None req-24d69496-0413-4e48-81a9-2768b1df554f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:50:35 user nova-compute[73056]: DEBUG nova.objects.instance [None req-24d69496-0413-4e48-81a9-2768b1df554f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lazy-loading 'info_cache' on Instance uuid d79c2f2c-0870-4d8e-b468-36e63496b769 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:50:35 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Removed pending event for b580e3d0-88b5-42a3-a953-84b94c088f41 due to event {{(pid=73056) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 16:50:35 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031835.7638268, b580e3d0-88b5-42a3-a953-84b94c088f41 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:50:35 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] VM Resumed (Lifecycle Event)
Aug 14 16:50:35 user nova-compute[73056]: DEBUG nova.compute.manager [None req-0f7b713c-5a4b-400f-aa66-8aa9b785ab97 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:50:35 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:50:35 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:50:35 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 16:50:35 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031835.7647657, b580e3d0-88b5-42a3-a953-84b94c088f41 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:50:35 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] VM Started (Lifecycle Event)
Aug 14 16:50:35 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:50:35 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:50:35 user nova-compute[73056]: DEBUG nova.network.neutron [None req-24d69496-0413-4e48-81a9-2768b1df554f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Updating instance_info_cache with network_info: [{"id": "c7a36ac9-68dc-462c-9e90-4eb844971548", "address": "fa:16:3e:44:b8:c2", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a36ac9-68", "ovs_interfaceid": "c7a36ac9-68dc-462c-9e90-4eb844971548", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:50:35 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-24d69496-0413-4e48-81a9-2768b1df554f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Releasing lock "refresh_cache-d79c2f2c-0870-4d8e-b468-36e63496b769" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:50:35 user nova-compute[73056]: DEBUG nova.objects.instance [None req-24d69496-0413-4e48-81a9-2768b1df554f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lazy-loading 'migration_context' on Instance uuid d79c2f2c-0870-4d8e-b468-36e63496b769 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:50:35 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-24d69496-0413-4e48-81a9-2768b1df554f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:50:35 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-24d69496-0413-4e48-81a9-2768b1df554f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:50:36 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-24d69496-0413-4e48-81a9-2768b1df554f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:50:36 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-24d69496-0413-4e48-81a9-2768b1df554f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:50:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-24d69496-0413-4e48-81a9-2768b1df554f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.353s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:50:36 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-24d69496-0413-4e48-81a9-2768b1df554f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Deleted allocation for migration 122b3979-ee5c-4c34-acdc-1d30b77eb2ed
Aug 14 16:50:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-24d69496-0413-4e48-81a9-2768b1df554f tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "d79c2f2c-0870-4d8e-b468-36e63496b769" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.328s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:50:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:43 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692031828.3328068, c1546794-fd57-4215-a997-39059f213a15 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:50:43 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: c1546794-fd57-4215-a997-39059f213a15] VM Stopped (Lifecycle Event)
Aug 14 16:50:43 user nova-compute[73056]: DEBUG nova.compute.manager [None req-25f8da3f-b158-4a21-8dec-7bb80f3a12ae None None] [instance: c1546794-fd57-4215-a997-39059f213a15] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:50:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:43 user nova-compute[73056]: DEBUG nova.compute.manager [req-c1b31831-7710-4d59-ad05-26f9cb73b849 req-9be62424-65b2-4f6c-9f86-ee02aebf864d service nova] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Received event network-changed-57b63084-60a4-44c3-bfc8-6bc91aaedc95 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:50:43 user nova-compute[73056]: DEBUG nova.compute.manager [req-c1b31831-7710-4d59-ad05-26f9cb73b849 req-9be62424-65b2-4f6c-9f86-ee02aebf864d service nova] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Refreshing instance network info cache due to event network-changed-57b63084-60a4-44c3-bfc8-6bc91aaedc95. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:50:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c1b31831-7710-4d59-ad05-26f9cb73b849 req-9be62424-65b2-4f6c-9f86-ee02aebf864d service nova] Acquiring lock "refresh_cache-9910444a-33ee-4937-9073-3b1f4d2f2fe9" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:50:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c1b31831-7710-4d59-ad05-26f9cb73b849 req-9be62424-65b2-4f6c-9f86-ee02aebf864d service nova] Acquired lock "refresh_cache-9910444a-33ee-4937-9073-3b1f4d2f2fe9" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:50:43 user nova-compute[73056]: DEBUG nova.network.neutron [req-c1b31831-7710-4d59-ad05-26f9cb73b849 req-9be62424-65b2-4f6c-9f86-ee02aebf864d service nova] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Refreshing network info cache for port 57b63084-60a4-44c3-bfc8-6bc91aaedc95 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:50:44 user nova-compute[73056]: DEBUG nova.network.neutron [req-c1b31831-7710-4d59-ad05-26f9cb73b849 req-9be62424-65b2-4f6c-9f86-ee02aebf864d service nova] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Updated VIF entry in instance network info cache for port 57b63084-60a4-44c3-bfc8-6bc91aaedc95. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:50:44 user nova-compute[73056]: DEBUG nova.network.neutron [req-c1b31831-7710-4d59-ad05-26f9cb73b849 req-9be62424-65b2-4f6c-9f86-ee02aebf864d service nova] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Updating instance_info_cache with network_info: [{"id": "57b63084-60a4-44c3-bfc8-6bc91aaedc95", "address": "fa:16:3e:21:99:e6", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57b63084-60", "ovs_interfaceid": "57b63084-60a4-44c3-bfc8-6bc91aaedc95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:50:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c1b31831-7710-4d59-ad05-26f9cb73b849 req-9be62424-65b2-4f6c-9f86-ee02aebf864d service nova] Releasing lock "refresh_cache-9910444a-33ee-4937-9073-3b1f4d2f2fe9" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:50:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "9910444a-33ee-4937-9073-3b1f4d2f2fe9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:50:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "9910444a-33ee-4937-9073-3b1f4d2f2fe9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:50:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "9910444a-33ee-4937-9073-3b1f4d2f2fe9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:50:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "9910444a-33ee-4937-9073-3b1f4d2f2fe9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:50:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "9910444a-33ee-4937-9073-3b1f4d2f2fe9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:50:44 user nova-compute[73056]: INFO nova.compute.manager [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Terminating instance
Aug 14 16:50:44 user nova-compute[73056]: DEBUG nova.compute.manager [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 16:50:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:44 user nova-compute[73056]: DEBUG nova.compute.manager [req-04c8430f-365d-4530-ba01-602df5a34064 req-eead9861-fbd6-47fd-bbaf-68224254e359 service nova] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Received event network-vif-unplugged-57b63084-60a4-44c3-bfc8-6bc91aaedc95 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:50:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-04c8430f-365d-4530-ba01-602df5a34064 req-eead9861-fbd6-47fd-bbaf-68224254e359 service nova] Acquiring lock "9910444a-33ee-4937-9073-3b1f4d2f2fe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:50:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-04c8430f-365d-4530-ba01-602df5a34064 req-eead9861-fbd6-47fd-bbaf-68224254e359 service nova] Lock "9910444a-33ee-4937-9073-3b1f4d2f2fe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:50:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-04c8430f-365d-4530-ba01-602df5a34064 req-eead9861-fbd6-47fd-bbaf-68224254e359 service nova] Lock "9910444a-33ee-4937-9073-3b1f4d2f2fe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:50:44 user nova-compute[73056]: DEBUG nova.compute.manager [req-04c8430f-365d-4530-ba01-602df5a34064 req-eead9861-fbd6-47fd-bbaf-68224254e359 service nova] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] No waiting events found dispatching network-vif-unplugged-57b63084-60a4-44c3-bfc8-6bc91aaedc95 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:50:44 user nova-compute[73056]: DEBUG nova.compute.manager [req-04c8430f-365d-4530-ba01-602df5a34064 req-eead9861-fbd6-47fd-bbaf-68224254e359 service nova] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Received event network-vif-unplugged-57b63084-60a4-44c3-bfc8-6bc91aaedc95 for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:50:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:45 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Instance destroyed successfully.
Aug 14 16:50:45 user nova-compute[73056]: DEBUG nova.objects.instance [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lazy-loading 'resources' on Instance uuid 9910444a-33ee-4937-9073-3b1f4d2f2fe9 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:48:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1391880076',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1391880076',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1391880076',id=31,image_ref='b22efe42-bb05-46d4-822a-39f836f6925f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuJqC/uSpYU3He6gO9R+qHwaAdN9yjmnxXSaJX/0vRV38kzGDqYOgrvyFpehKU1xVniTQn/vnW6s082XLnrdR9X6uKsuQtHi5VieND2iWZciYVdFNxsy8uH1bqyH2A1wg==',key_name='tempest-keypair-97762910',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:49:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cffb5203b9284500b8add8a6586cad49',ramdisk_id='',reservation_id='r-mosmrn34',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1676214558',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1676214558-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1676214558',owner_user_name='tempest-TestVolumeBootPattern-1676214558-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:49:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2be1b098ca9f4232bd198b515630f6ad',uuid=9910444a-33ee-4937-9073-3b1f4d2f2fe9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57b63084-60a4-44c3-bfc8-6bc91aaedc95", "address": "fa:16:3e:21:99:e6", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57b63084-60", "ovs_interfaceid": "57b63084-60a4-44c3-bfc8-6bc91aaedc95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Converting VIF {"id": "57b63084-60a4-44c3-bfc8-6bc91aaedc95", "address": "fa:16:3e:21:99:e6", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57b63084-60", "ovs_interfaceid": "57b63084-60a4-44c3-bfc8-6bc91aaedc95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:99:e6,bridge_name='br-int',has_traffic_filtering=True,id=57b63084-60a4-44c3-bfc8-6bc91aaedc95,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57b63084-60') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG os_vif [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:99:e6,bridge_name='br-int',has_traffic_filtering=True,id=57b63084-60a4-44c3-bfc8-6bc91aaedc95,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57b63084-60') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57b63084-60, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:45 user nova-compute[73056]: INFO os_vif [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:99:e6,bridge_name='br-int',has_traffic_filtering=True,id=57b63084-60a4-44c3-bfc8-6bc91aaedc95,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57b63084-60')
Aug 14 16:50:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LpthFKrG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:50:45 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:50:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e308dc1c-962d-489b-90f6-312b7eed1b4a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[027f7246-10f2-4de2-aef8-42f41f555df7]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:50:45 user nova-compute[73056]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:50:45 user nova-compute[73056]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa (non-flash)
Aug 14 16:50:45 user nova-compute[73056]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)
Aug 14 16:50:45 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:50:45 user nova-compute[73056]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:50:45 user nova-compute[73056]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa (non-flash)
Aug 14 16:50:45 user nova-compute[73056]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)
Aug 14 16:50:45 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff32c8b2050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa'): ({'sdc'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Removing single pathed devices sdc {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d7c7e2-aac8-41f0-a523-9123b4f2ab04]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[894b7ee3-4687-4c38-a512-d45d7f3a42a1]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Flushing IO for device /dev/sdc {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[912c3be0-5657-4715-9aa4-2b004bad7b2b]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ab24a9-8416-464a-82b9-13ae05c3d01e]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] SCSI volumes sdc have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23030313731343036', '/dev/disk/by-id/scsi-1SCST_BIOe2bac5d-001714061d48b057', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e2bac5d') {{(pid=83519) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6df5406-f803-4891-9eb6-03a444104c2f]: (4, None) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcaab44f-fca7-43e4-bfbc-c4d63a159767]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c7c5d7-1a4d-4536-887a-01ed2fb2628f]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa, portal: 172.16.0.220,3260]
Aug 14 16:50:45 user nova-compute[73056]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa, portal: 172.16.0.220,3260] successful.
Aug 14 16:50:45 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06f2c61e-a29e-4738-8ed3-859be9763eaa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8fd3fec-14a1-4d48-b3a2-0eeeac91a948]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] <== disconnect_volume: return (335ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:50:45 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Deleting instance files /opt/stack/data/nova/instances/9910444a-33ee-4937-9073-3b1f4d2f2fe9_del
Aug 14 16:50:45 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Deletion of /opt/stack/data/nova/instances/9910444a-33ee-4937-9073-3b1f4d2f2fe9_del complete
Aug 14 16:50:45 user nova-compute[73056]: INFO nova.compute.manager [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Took 1.28 seconds to destroy the instance on the hypervisor.
Aug 14 16:50:45 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 16:50:45 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 16:50:46 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:50:46 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Took 1.10 seconds to deallocate network for instance.
Aug 14 16:50:46 user nova-compute[73056]: DEBUG nova.compute.manager [req-b6631bfe-fd20-4185-b1a3-c39fdc7a246d req-44e69803-d9b0-4b0d-b642-629deeb9fbf3 service nova] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Received event network-vif-deleted-57b63084-60a4-44c3-bfc8-6bc91aaedc95 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:50:47 user nova-compute[73056]: DEBUG nova.compute.manager [req-84f4dd88-aad6-4772-8ea6-8e984d5be1e2 req-b1851c9a-d371-4918-8804-b9253e6b0431 service nova] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Received event network-vif-plugged-57b63084-60a4-44c3-bfc8-6bc91aaedc95 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:50:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-84f4dd88-aad6-4772-8ea6-8e984d5be1e2 req-b1851c9a-d371-4918-8804-b9253e6b0431 service nova] Acquiring lock "9910444a-33ee-4937-9073-3b1f4d2f2fe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:50:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-84f4dd88-aad6-4772-8ea6-8e984d5be1e2 req-b1851c9a-d371-4918-8804-b9253e6b0431 service nova] Lock "9910444a-33ee-4937-9073-3b1f4d2f2fe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:50:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-84f4dd88-aad6-4772-8ea6-8e984d5be1e2 req-b1851c9a-d371-4918-8804-b9253e6b0431 service nova] Lock "9910444a-33ee-4937-9073-3b1f4d2f2fe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:50:47 user nova-compute[73056]: DEBUG nova.compute.manager [req-84f4dd88-aad6-4772-8ea6-8e984d5be1e2 req-b1851c9a-d371-4918-8804-b9253e6b0431 service nova] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] No waiting events found dispatching network-vif-plugged-57b63084-60a4-44c3-bfc8-6bc91aaedc95 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:50:47 user nova-compute[73056]: WARNING nova.compute.manager [req-84f4dd88-aad6-4772-8ea6-8e984d5be1e2 req-b1851c9a-d371-4918-8804-b9253e6b0431 service nova] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Received unexpected event network-vif-plugged-57b63084-60a4-44c3-bfc8-6bc91aaedc95 for instance with vm_state active and task_state deleting.
Aug 14 16:50:47 user nova-compute[73056]: INFO nova.compute.manager [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Took 0.89 seconds to detach 1 volumes for instance.
Aug 14 16:50:47 user nova-compute[73056]: DEBUG nova.compute.manager [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Deleting volume: 06f2c61e-a29e-4738-8ed3-859be9763eaa {{(pid=73056) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 16:50:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:50:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:50:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:48 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:50:48 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:50:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:50:48 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Deleted allocations for instance 9910444a-33ee-4937-9073-3b1f4d2f2fe9
Aug 14 16:50:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ba3a030f-17db-4bea-a76b-2f1f2b3dc863 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "9910444a-33ee-4937-9073-3b1f4d2f2fe9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.913s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:50:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:55 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:50:55 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 16:50:56 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:50:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:50:59 user nova-compute[73056]: DEBUG nova.compute.manager [None req-73e156df-3313-40df-8c67-02c472322fe5 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:50:59 user nova-compute[73056]: INFO nova.compute.manager [None req-73e156df-3313-40df-8c67-02c472322fe5 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] instance snapshotting
Aug 14 16:50:59 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-73e156df-3313-40df-8c67-02c472322fe5 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Beginning live snapshot process
Aug 14 16:50:59 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:50:59 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 16:50:59 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Didn't find any instances for network info cache update. {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 16:50:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-73e156df-3313-40df-8c67-02c472322fe5 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk --force-share --output=json -f qcow2 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-73e156df-3313-40df-8c67-02c472322fe5 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-73e156df-3313-40df-8c67-02c472322fe5 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk --force-share --output=json -f qcow2 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-73e156df-3313-40df-8c67-02c472322fe5 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk --force-share --output=json -f qcow2" returned: 0 in 0.168s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-73e156df-3313-40df-8c67-02c472322fe5 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-73e156df-3313-40df-8c67-02c472322fe5 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.168s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-73e156df-3313-40df-8c67-02c472322fe5 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpj7jn3siy/249958470ef84dfaa88006353d0cfa80.delta 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:50:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-73e156df-3313-40df-8c67-02c472322fe5 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpj7jn3siy/249958470ef84dfaa88006353d0cfa80.delta 1073741824" returned: 0 in 0.044s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:50:59 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-73e156df-3313-40df-8c67-02c472322fe5 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 14 16:51:00 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692031845.3062613, 9910444a-33ee-4937-9073-3b1f4d2f2fe9 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:51:00 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] VM Stopped (Lifecycle Event)
Aug 14 16:51:00 user nova-compute[73056]: DEBUG nova.compute.manager [None req-90ad0aab-8f76-487b-aa38-46f345760229 None None] [instance: 9910444a-33ee-4937-9073-3b1f4d2f2fe9] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:51:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-73e156df-3313-40df-8c67-02c472322fe5 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=73056) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 16:51:01 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-73e156df-3313-40df-8c67-02c472322fe5 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] COPY block job progress, current cursor: 18350080 final cursor: 75563008 {{(pid=73056) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 16:51:01 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:51:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:51:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:51:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:51:01 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 16:51:01 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-73e156df-3313-40df-8c67-02c472322fe5 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73056) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 16:51:01 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-73e156df-3313-40df-8c67-02c472322fe5 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 14 16:51:01 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:51:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:01 user nova-compute[73056]: DEBUG nova.privsep.utils [None req-73e156df-3313-40df-8c67-02c472322fe5 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73056) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 16:51:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-73e156df-3313-40df-8c67-02c472322fe5 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpj7jn3siy/249958470ef84dfaa88006353d0cfa80.delta /opt/stack/data/nova/instances/snapshots/tmpj7jn3siy/249958470ef84dfaa88006353d0cfa80 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:51:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-73e156df-3313-40df-8c67-02c472322fe5 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpj7jn3siy/249958470ef84dfaa88006353d0cfa80.delta /opt/stack/data/nova/instances/snapshots/tmpj7jn3siy/249958470ef84dfaa88006353d0cfa80" returned: 0 in 0.558s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:02 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-73e156df-3313-40df-8c67-02c472322fe5 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Snapshot extracted, beginning image upload
Aug 14 16:51:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:02 user nova-compute[73056]: DEBUG nova.compute.manager [req-efa7d0f6-a8f2-42c0-b95c-f15f1599e095 req-50bb0c41-a0d5-4660-99cc-593020423afa service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Received event network-changed-cb018af9-f526-4333-9a2f-0cc2d91d22b2 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:51:02 user nova-compute[73056]: DEBUG nova.compute.manager [req-efa7d0f6-a8f2-42c0-b95c-f15f1599e095 req-50bb0c41-a0d5-4660-99cc-593020423afa service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Refreshing instance network info cache due to event network-changed-cb018af9-f526-4333-9a2f-0cc2d91d22b2. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:51:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-efa7d0f6-a8f2-42c0-b95c-f15f1599e095 req-50bb0c41-a0d5-4660-99cc-593020423afa service nova] Acquiring lock "refresh_cache-bcbe7449-6199-4e86-a8b6-c075e142aa34" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:51:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-efa7d0f6-a8f2-42c0-b95c-f15f1599e095 req-50bb0c41-a0d5-4660-99cc-593020423afa service nova] Acquired lock "refresh_cache-bcbe7449-6199-4e86-a8b6-c075e142aa34" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:51:02 user nova-compute[73056]: DEBUG nova.network.neutron [req-efa7d0f6-a8f2-42c0-b95c-f15f1599e095 req-50bb0c41-a0d5-4660-99cc-593020423afa service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Refreshing network info cache for port cb018af9-f526-4333-9a2f-0cc2d91d22b2 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:51:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:51:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:03 user nova-compute[73056]: DEBUG nova.network.neutron [req-efa7d0f6-a8f2-42c0-b95c-f15f1599e095 req-50bb0c41-a0d5-4660-99cc-593020423afa service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Updated VIF entry in instance network info cache for port cb018af9-f526-4333-9a2f-0cc2d91d22b2. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:51:03 user nova-compute[73056]: DEBUG nova.network.neutron [req-efa7d0f6-a8f2-42c0-b95c-f15f1599e095 req-50bb0c41-a0d5-4660-99cc-593020423afa service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Updating instance_info_cache with network_info: [{"id": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "address": "fa:16:3e:04:a3:9a", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb018af9-f5", "ovs_interfaceid": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:51:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-efa7d0f6-a8f2-42c0-b95c-f15f1599e095 req-50bb0c41-a0d5-4660-99cc-593020423afa service nova] Releasing lock "refresh_cache-bcbe7449-6199-4e86-a8b6-c075e142aa34" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:51:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ab3878-9362-4be0-a5bf-3759469473c9/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ab3878-9362-4be0-a5bf-3759469473c9/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ab3878-9362-4be0-a5bf-3759469473c9/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74ab3878-9362-4be0-a5bf-3759469473c9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:05 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:51:05 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:51:05 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=7293MB free_disk=25.407012939453125GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 16:51:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:51:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:51:05 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 9f3a7f8a-e3b9-4918-9663-968677fe5c90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:51:05 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance b580e3d0-88b5-42a3-a953-84b94c088f41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:51:05 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 92c34cf0-fd39-49fc-9244-4da8ccae6eec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:51:05 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 7526c6c3-6d3c-435e-8fc7-742c08be44d0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:51:05 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 61357ac0-230f-4711-8954-0bb04bfcb2f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:51:05 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 74ab3878-9362-4be0-a5bf-3759469473c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:51:05 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance d79c2f2c-0870-4d8e-b468-36e63496b769 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:51:05 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance bcbe7449-6199-4e86-a8b6-c075e142aa34 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:51:05 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 6910e1fe-8863-4a4b-b975-48c9ebb0b087 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:51:05 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 16:51:05 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 16:51:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:05 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-73e156df-3313-40df-8c67-02c472322fe5 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Snapshot image upload complete
Aug 14 16:51:05 user nova-compute[73056]: INFO nova.compute.manager [None req-73e156df-3313-40df-8c67-02c472322fe5 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Took 6.22 seconds to snapshot the instance on the hypervisor.
Aug 14 16:51:05 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:51:05 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:51:05 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 16:51:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.642s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:51:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:06 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:51:06 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:51:06 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:51:06 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:51:06 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:51:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Acquiring lock "c35f86ec-62d5-4c4d-a259-902e95aeb9d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:51:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "c35f86ec-62d5-4c4d-a259-902e95aeb9d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:51:08 user nova-compute[73056]: DEBUG nova.compute.manager [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:51:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:51:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:51:08 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:51:08 user nova-compute[73056]: INFO nova.compute.claims [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Claim successful on node user
Aug 14 16:51:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c4d4c65b-0bcd-4582-ab51-a78bd4004f70 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "bcbe7449-6199-4e86-a8b6-c075e142aa34" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:51:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c4d4c65b-0bcd-4582-ab51-a78bd4004f70 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "bcbe7449-6199-4e86-a8b6-c075e142aa34" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:51:08 user nova-compute[73056]: INFO nova.compute.manager [None req-c4d4c65b-0bcd-4582-ab51-a78bd4004f70 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Shelving
Aug 14 16:51:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:09 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:51:09 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:51:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.557s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:51:09 user nova-compute[73056]: DEBUG nova.compute.manager [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:51:09 user nova-compute[73056]: DEBUG nova.compute.manager [req-72d635a5-ff5d-4b2c-8a6c-995434fda038 req-c91c6eaa-58e1-4118-8320-1838b1495b76 service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Received event network-vif-unplugged-cb018af9-f526-4333-9a2f-0cc2d91d22b2 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:51:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-72d635a5-ff5d-4b2c-8a6c-995434fda038 req-c91c6eaa-58e1-4118-8320-1838b1495b76 service nova] Acquiring lock "bcbe7449-6199-4e86-a8b6-c075e142aa34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:51:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-72d635a5-ff5d-4b2c-8a6c-995434fda038 req-c91c6eaa-58e1-4118-8320-1838b1495b76 service nova] Lock "bcbe7449-6199-4e86-a8b6-c075e142aa34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:51:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-72d635a5-ff5d-4b2c-8a6c-995434fda038 req-c91c6eaa-58e1-4118-8320-1838b1495b76 service nova] Lock "bcbe7449-6199-4e86-a8b6-c075e142aa34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:51:09 user nova-compute[73056]: DEBUG nova.compute.manager [req-72d635a5-ff5d-4b2c-8a6c-995434fda038 req-c91c6eaa-58e1-4118-8320-1838b1495b76 service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] No waiting events found dispatching network-vif-unplugged-cb018af9-f526-4333-9a2f-0cc2d91d22b2 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:51:09 user nova-compute[73056]: WARNING nova.compute.manager [req-72d635a5-ff5d-4b2c-8a6c-995434fda038 req-c91c6eaa-58e1-4118-8320-1838b1495b76 service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Received unexpected event network-vif-unplugged-cb018af9-f526-4333-9a2f-0cc2d91d22b2 for instance with vm_state active and task_state shelving.
Aug 14 16:51:09 user nova-compute[73056]: DEBUG nova.compute.manager [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:51:09 user nova-compute[73056]: DEBUG nova.network.neutron [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:51:09 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:51:09 user nova-compute[73056]: DEBUG nova.compute.manager [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:51:09 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Instance destroyed successfully.
Aug 14 16:51:09 user nova-compute[73056]: DEBUG nova.policy [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '18edcf10dda041c8a2bde2fb231b4fde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d796c14bd3489883e161ea1b311ca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:51:09 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-c4d4c65b-0bcd-4582-ab51-a78bd4004f70 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Beginning cold snapshot process
Aug 14 16:51:10 user nova-compute[73056]: DEBUG nova.compute.manager [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:51:10 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:51:10 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Creating image(s)
Aug 14 16:51:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Acquiring lock "/opt/stack/data/nova/instances/c35f86ec-62d5-4c4d-a259-902e95aeb9d0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:51:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "/opt/stack/data/nova/instances/c35f86ec-62d5-4c4d-a259-902e95aeb9d0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:51:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "/opt/stack/data/nova/instances/c35f86ec-62d5-4c4d-a259-902e95aeb9d0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.142s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:51:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Acquiring lock "b0f2c3865387244922d1862e2292b5063d96c2f3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:51:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "b0f2c3865387244922d1862e2292b5063d96c2f3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:51:11 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0f2c3865387244922d1862e2292b5063d96c2f3.part --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:11 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:11 user nova-compute[73056]: DEBUG nova.compute.manager [req-e3202087-43c8-460c-949e-497b5cb4a926 req-63dc6120-f073-4ace-8806-9a0e892acf58 service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Received event network-vif-plugged-cb018af9-f526-4333-9a2f-0cc2d91d22b2 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:51:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e3202087-43c8-460c-949e-497b5cb4a926 req-63dc6120-f073-4ace-8806-9a0e892acf58 service nova] Acquiring lock "bcbe7449-6199-4e86-a8b6-c075e142aa34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:51:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e3202087-43c8-460c-949e-497b5cb4a926 req-63dc6120-f073-4ace-8806-9a0e892acf58 service nova] Lock "bcbe7449-6199-4e86-a8b6-c075e142aa34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:51:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e3202087-43c8-460c-949e-497b5cb4a926 req-63dc6120-f073-4ace-8806-9a0e892acf58 service nova] Lock "bcbe7449-6199-4e86-a8b6-c075e142aa34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:51:11 user nova-compute[73056]: DEBUG nova.compute.manager [req-e3202087-43c8-460c-949e-497b5cb4a926 req-63dc6120-f073-4ace-8806-9a0e892acf58 service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] No waiting events found dispatching network-vif-plugged-cb018af9-f526-4333-9a2f-0cc2d91d22b2 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:51:11 user nova-compute[73056]: WARNING nova.compute.manager [req-e3202087-43c8-460c-949e-497b5cb4a926 req-63dc6120-f073-4ace-8806-9a0e892acf58 service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Received unexpected event network-vif-plugged-cb018af9-f526-4333-9a2f-0cc2d91d22b2 for instance with vm_state active and task_state shelving_image_uploading.
Aug 14 16:51:11 user nova-compute[73056]: DEBUG nova.network.neutron [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Successfully created port: b83d80a5-3a19-412c-8d6b-89cb7f93c682 {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:51:11 user nova-compute[73056]: DEBUG nova.privsep.utils [None req-c4d4c65b-0bcd-4582-ab51-a78bd4004f70 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73056) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 16:51:11 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-c4d4c65b-0bcd-4582-ab51-a78bd4004f70 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34/disk /opt/stack/data/nova/instances/snapshots/tmp_tmljutf/5a5473f96a5c4e089bb0455845c06424 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:11 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0f2c3865387244922d1862e2292b5063d96c2f3.part --force-share --output=json" returned: 0 in 0.179s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:11 user nova-compute[73056]: DEBUG nova.virt.images [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] 445ac98e-6c98-4e6f-81b3-13b66d4c31a2 was qcow2, converting to raw {{(pid=73056) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 16:51:11 user nova-compute[73056]: DEBUG nova.privsep.utils [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73056) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 16:51:11 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b0f2c3865387244922d1862e2292b5063d96c2f3.part /opt/stack/data/nova/instances/_base/b0f2c3865387244922d1862e2292b5063d96c2f3.converted {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b0f2c3865387244922d1862e2292b5063d96c2f3.part /opt/stack/data/nova/instances/_base/b0f2c3865387244922d1862e2292b5063d96c2f3.converted" returned: 0 in 0.875s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0f2c3865387244922d1862e2292b5063d96c2f3.converted --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-c4d4c65b-0bcd-4582-ab51-a78bd4004f70 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34/disk /opt/stack/data/nova/instances/snapshots/tmp_tmljutf/5a5473f96a5c4e089bb0455845c06424" returned: 0 in 1.024s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:12 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-c4d4c65b-0bcd-4582-ab51-a78bd4004f70 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Snapshot extracted, beginning image upload
Aug 14 16:51:12 user nova-compute[73056]: DEBUG nova.network.neutron [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Successfully updated port: b83d80a5-3a19-412c-8d6b-89cb7f93c682 {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:51:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Acquiring lock "refresh_cache-c35f86ec-62d5-4c4d-a259-902e95aeb9d0" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:51:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Acquired lock "refresh_cache-c35f86ec-62d5-4c4d-a259-902e95aeb9d0" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:51:12 user nova-compute[73056]: DEBUG nova.network.neutron [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:51:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0f2c3865387244922d1862e2292b5063d96c2f3.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "b0f2c3865387244922d1862e2292b5063d96c2f3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.492s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:51:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0f2c3865387244922d1862e2292b5063d96c2f3 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:12 user nova-compute[73056]: DEBUG nova.network.neutron [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:51:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0f2c3865387244922d1862e2292b5063d96c2f3 --force-share --output=json" returned: 0 in 0.170s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Acquiring lock "b0f2c3865387244922d1862e2292b5063d96c2f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:51:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "b0f2c3865387244922d1862e2292b5063d96c2f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:51:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0f2c3865387244922d1862e2292b5063d96c2f3 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG nova.network.neutron [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Updating instance_info_cache with network_info: [{"id": "b83d80a5-3a19-412c-8d6b-89cb7f93c682", "address": "fa:16:3e:d6:de:25", "network": {"id": "c2b49cd1-a248-4bd2-924f-bd8b560aed47", "bridge": "br-int", "label": "tempest-TestStampPattern-1795667966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d796c14bd3489883e161ea1b311ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb83d80a5-3a", "ovs_interfaceid": "b83d80a5-3a19-412c-8d6b-89cb7f93c682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0f2c3865387244922d1862e2292b5063d96c2f3 --force-share --output=json" returned: 0 in 0.219s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b0f2c3865387244922d1862e2292b5063d96c2f3,backing_fmt=raw /opt/stack/data/nova/instances/c35f86ec-62d5-4c4d-a259-902e95aeb9d0/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Releasing lock "refresh_cache-c35f86ec-62d5-4c4d-a259-902e95aeb9d0" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG nova.compute.manager [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Instance network_info: |[{"id": "b83d80a5-3a19-412c-8d6b-89cb7f93c682", "address": "fa:16:3e:d6:de:25", "network": {"id": "c2b49cd1-a248-4bd2-924f-bd8b560aed47", "bridge": "br-int", "label": "tempest-TestStampPattern-1795667966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d796c14bd3489883e161ea1b311ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb83d80a5-3a", "ovs_interfaceid": "b83d80a5-3a19-412c-8d6b-89cb7f93c682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b0f2c3865387244922d1862e2292b5063d96c2f3,backing_fmt=raw /opt/stack/data/nova/instances/c35f86ec-62d5-4c4d-a259-902e95aeb9d0/disk 1073741824" returned: 0 in 0.058s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "b0f2c3865387244922d1862e2292b5063d96c2f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0f2c3865387244922d1862e2292b5063d96c2f3 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0f2c3865387244922d1862e2292b5063d96c2f3 --force-share --output=json" returned: 0 in 0.175s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG nova.objects.instance [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lazy-loading 'migration_context' on Instance uuid c35f86ec-62d5-4c4d-a259-902e95aeb9d0 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Ensure instance console log exists: /opt/stack/data/nova/instances/c35f86ec-62d5-4c4d-a259-902e95aeb9d0/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Start _get_guest_xml network_info=[{"id": "b83d80a5-3a19-412c-8d6b-89cb7f93c682", "address": "fa:16:3e:d6:de:25", "network": {"id": "c2b49cd1-a248-4bd2-924f-bd8b560aed47", "bridge": "br-int", "label": "tempest-TestStampPattern-1795667966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d796c14bd3489883e161ea1b311ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb83d80a5-3a", "ovs_interfaceid": "b83d80a5-3a19-412c-8d6b-89cb7f93c682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='4e0f0bb88240eb4ae04b42f7e1eabe3d',container_format='bare',created_at=2023-08-14T16:50:59Z,direct_url=<?>,disk_format='qcow2',id=445ac98e-6c98-4e6f-81b3-13b66d4c31a2,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1293444212',owner='d2d796c14bd3489883e161ea1b311ca5',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-14T16:51:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '445ac98e-6c98-4e6f-81b3-13b66d4c31a2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:51:13 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:51:13 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:51:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='4e0f0bb88240eb4ae04b42f7e1eabe3d',container_format='bare',created_at=2023-08-14T16:50:59Z,direct_url=<?>,disk_format='qcow2',id=445ac98e-6c98-4e6f-81b3-13b66d4c31a2,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1293444212',owner='d2d796c14bd3489883e161ea1b311ca5',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-14T16:51:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:51:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1316551467',display_name='tempest-TestStampPattern-server-1316551467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1316551467',id=34,image_ref='445ac98e-6c98-4e6f-81b3-13b66d4c31a2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1L8q/UE/lP/2VxMJW4uvrcAleicidYPp3XEOqORx+N0k8ZiuhpRRdaAVC38mPfWQU7Ahb0+HsQ9477x/V7V9afEg8xu6rOrZVCKgLaCY5Gqr1Mn3uZleqqMyDV507BJw==',key_name='tempest-TestStampPattern-2127629561',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2d796c14bd3489883e161ea1b311ca5',ramdisk_id='',reservation_id='r-2fgyvgrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='61357ac0-230f-4711-8954-0bb04bfcb2f6',image_min_disk='1',image_min_ram='0',image_owner_id='d2d796c14bd3489883e161ea1b311ca5',image_owner_project_name='tempest-TestStampPattern-1217754811',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1217754811-project-member',image_user_id='18edcf10dda041c8a2bde2fb231b4fde',network_allocated='True',owner_project_name='tempest-TestStampPattern-1217754811',owner_user_name='tempest-TestStampPattern-1217754811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:51:09Z,user_data=None,user_id='18edcf10dda041c8a2bde2fb231b4fde',uuid=c35f86ec-62d5-4c4d-a259-902e95aeb9d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b83d80a5-3a19-412c-8d6b-89cb7f93c682", "address": "fa:16:3e:d6:de:25", "network": {"id": "c2b49cd1-a248-4bd2-924f-bd8b560aed47", "bridge": "br-int", "label": "tempest-TestStampPattern-1795667966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d796c14bd3489883e161ea1b311ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb83d80a5-3a", "ovs_interfaceid": "b83d80a5-3a19-412c-8d6b-89cb7f93c682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Converting VIF {"id": "b83d80a5-3a19-412c-8d6b-89cb7f93c682", "address": "fa:16:3e:d6:de:25", "network": {"id": "c2b49cd1-a248-4bd2-924f-bd8b560aed47", "bridge": "br-int", "label": "tempest-TestStampPattern-1795667966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d796c14bd3489883e161ea1b311ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb83d80a5-3a", "ovs_interfaceid": "b83d80a5-3a19-412c-8d6b-89cb7f93c682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:de:25,bridge_name='br-int',has_traffic_filtering=True,id=b83d80a5-3a19-412c-8d6b-89cb7f93c682,network=Network(c2b49cd1-a248-4bd2-924f-bd8b560aed47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb83d80a5-3a') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG nova.objects.instance [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lazy-loading 'pci_devices' on Instance uuid c35f86ec-62d5-4c4d-a259-902e95aeb9d0 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG nova.compute.manager [req-754f7585-6dcc-4d4e-817e-4c0c52f735be req-e672cd04-91e8-4864-a74c-9158b16c4780 service nova] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Received event network-changed-b83d80a5-3a19-412c-8d6b-89cb7f93c682 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG nova.compute.manager [req-754f7585-6dcc-4d4e-817e-4c0c52f735be req-e672cd04-91e8-4864-a74c-9158b16c4780 service nova] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Refreshing instance network info cache due to event network-changed-b83d80a5-3a19-412c-8d6b-89cb7f93c682. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-754f7585-6dcc-4d4e-817e-4c0c52f735be req-e672cd04-91e8-4864-a74c-9158b16c4780 service nova] Acquiring lock "refresh_cache-c35f86ec-62d5-4c4d-a259-902e95aeb9d0" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-754f7585-6dcc-4d4e-817e-4c0c52f735be req-e672cd04-91e8-4864-a74c-9158b16c4780 service nova] Acquired lock "refresh_cache-c35f86ec-62d5-4c4d-a259-902e95aeb9d0" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG nova.network.neutron [req-754f7585-6dcc-4d4e-817e-4c0c52f735be req-e672cd04-91e8-4864-a74c-9158b16c4780 service nova] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Refreshing network info cache for port b83d80a5-3a19-412c-8d6b-89cb7f93c682 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:51:13 user nova-compute[73056]:   <uuid>c35f86ec-62d5-4c4d-a259-902e95aeb9d0</uuid>
Aug 14 16:51:13 user nova-compute[73056]:   <name>instance-00000022</name>
Aug 14 16:51:13 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:51:13 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:51:13 user nova-compute[73056]:   <metadata>
Aug 14 16:51:13 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:51:13 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:51:13 user nova-compute[73056]:       <nova:name>tempest-TestStampPattern-server-1316551467</nova:name>
Aug 14 16:51:13 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:51:13</nova:creationTime>
Aug 14 16:51:13 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:51:13 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:51:13 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:51:13 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:51:13 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:51:13 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:51:13 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:51:13 user nova-compute[73056]:       <nova:owner>
Aug 14 16:51:13 user nova-compute[73056]:         <nova:user uuid="18edcf10dda041c8a2bde2fb231b4fde">tempest-TestStampPattern-1217754811-project-member</nova:user>
Aug 14 16:51:13 user nova-compute[73056]:         <nova:project uuid="d2d796c14bd3489883e161ea1b311ca5">tempest-TestStampPattern-1217754811</nova:project>
Aug 14 16:51:13 user nova-compute[73056]:       </nova:owner>
Aug 14 16:51:13 user nova-compute[73056]:       <nova:root type="image" uuid="445ac98e-6c98-4e6f-81b3-13b66d4c31a2"/>
Aug 14 16:51:13 user nova-compute[73056]:       <nova:ports>
Aug 14 16:51:13 user nova-compute[73056]:         <nova:port uuid="b83d80a5-3a19-412c-8d6b-89cb7f93c682">
Aug 14 16:51:13 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 14 16:51:13 user nova-compute[73056]:         </nova:port>
Aug 14 16:51:13 user nova-compute[73056]:       </nova:ports>
Aug 14 16:51:13 user nova-compute[73056]:     </nova:instance>
Aug 14 16:51:13 user nova-compute[73056]:   </metadata>
Aug 14 16:51:13 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:51:13 user nova-compute[73056]:     <system>
Aug 14 16:51:13 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:51:13 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:51:13 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:51:13 user nova-compute[73056]:       <entry name="serial">c35f86ec-62d5-4c4d-a259-902e95aeb9d0</entry>
Aug 14 16:51:13 user nova-compute[73056]:       <entry name="uuid">c35f86ec-62d5-4c4d-a259-902e95aeb9d0</entry>
Aug 14 16:51:13 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:51:13 user nova-compute[73056]:     </system>
Aug 14 16:51:13 user nova-compute[73056]:   </sysinfo>
Aug 14 16:51:13 user nova-compute[73056]:   <os>
Aug 14 16:51:13 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:51:13 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:51:13 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:51:13 user nova-compute[73056]:   </os>
Aug 14 16:51:13 user nova-compute[73056]:   <features>
Aug 14 16:51:13 user nova-compute[73056]:     <acpi/>
Aug 14 16:51:13 user nova-compute[73056]:     <apic/>
Aug 14 16:51:13 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:51:13 user nova-compute[73056]:   </features>
Aug 14 16:51:13 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:51:13 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:51:13 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:51:13 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:51:13 user nova-compute[73056]:   </clock>
Aug 14 16:51:13 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:51:13 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:51:13 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:51:13 user nova-compute[73056]:   </cpu>
Aug 14 16:51:13 user nova-compute[73056]:   <devices>
Aug 14 16:51:13 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:51:13 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:51:13 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/c35f86ec-62d5-4c4d-a259-902e95aeb9d0/disk"/>
Aug 14 16:51:13 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:51:13 user nova-compute[73056]:     </disk>
Aug 14 16:51:13 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:51:13 user nova-compute[73056]:       <mac address="fa:16:3e:d6:de:25"/>
Aug 14 16:51:13 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:51:13 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:51:13 user nova-compute[73056]:       <target dev="tapb83d80a5-3a"/>
Aug 14 16:51:13 user nova-compute[73056]:     </interface>
Aug 14 16:51:13 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:51:13 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/c35f86ec-62d5-4c4d-a259-902e95aeb9d0/console.log" append="off"/>
Aug 14 16:51:13 user nova-compute[73056]:     </serial>
Aug 14 16:51:13 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:51:13 user nova-compute[73056]:     <video>
Aug 14 16:51:13 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:51:13 user nova-compute[73056]:     </video>
Aug 14 16:51:13 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:51:13 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:51:13 user nova-compute[73056]:     </rng>
Aug 14 16:51:13 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:51:13 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:51:13 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:51:13 user nova-compute[73056]:     </memballoon>
Aug 14 16:51:13 user nova-compute[73056]:   </devices>
Aug 14 16:51:13 user nova-compute[73056]: </domain>
Aug 14 16:51:13 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:51:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1316551467',display_name='tempest-TestStampPattern-server-1316551467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1316551467',id=34,image_ref='445ac98e-6c98-4e6f-81b3-13b66d4c31a2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1L8q/UE/lP/2VxMJW4uvrcAleicidYPp3XEOqORx+N0k8ZiuhpRRdaAVC38mPfWQU7Ahb0+HsQ9477x/V7V9afEg8xu6rOrZVCKgLaCY5Gqr1Mn3uZleqqMyDV507BJw==',key_name='tempest-TestStampPattern-2127629561',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2d796c14bd3489883e161ea1b311ca5',ramdisk_id='',reservation_id='r-2fgyvgrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='61357ac0-230f-4711-8954-0bb04bfcb2f6',image_min_disk='1',image_min_ram='0',image_owner_id='d2d796c14bd3489883e161ea1b311ca5',image_owner_project_name='tempest-TestStampPattern-1217754811',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1217754811-project-member',image_user_id='18edcf10dda041c8a2bde2fb231b4fde',network_allocated='True',owner_project_name='tempest-TestStampPattern-1217754811',owner_user_name='tempest-TestStampPattern-1217754811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:51:09Z,user_data=None,user_id='18edcf10dda041c8a2bde2fb231b4fde',uuid=c35f86ec-62d5-4c4d-a259-902e95aeb9d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b83d80a5-3a19-412c-8d6b-89cb7f93c682", "address": "fa:16:3e:d6:de:25", "network": {"id": "c2b49cd1-a248-4bd2-924f-bd8b560aed47", "bridge": "br-int", "label": "tempest-TestStampPattern-1795667966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d796c14bd3489883e161ea1b311ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb83d80a5-3a", "ovs_interfaceid": "b83d80a5-3a19-412c-8d6b-89cb7f93c682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Converting VIF {"id": "b83d80a5-3a19-412c-8d6b-89cb7f93c682", "address": "fa:16:3e:d6:de:25", "network": {"id": "c2b49cd1-a248-4bd2-924f-bd8b560aed47", "bridge": "br-int", "label": "tempest-TestStampPattern-1795667966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d796c14bd3489883e161ea1b311ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb83d80a5-3a", "ovs_interfaceid": "b83d80a5-3a19-412c-8d6b-89cb7f93c682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:de:25,bridge_name='br-int',has_traffic_filtering=True,id=b83d80a5-3a19-412c-8d6b-89cb7f93c682,network=Network(c2b49cd1-a248-4bd2-924f-bd8b560aed47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb83d80a5-3a') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG os_vif [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:de:25,bridge_name='br-int',has_traffic_filtering=True,id=b83d80a5-3a19-412c-8d6b-89cb7f93c682,network=Network(c2b49cd1-a248-4bd2-924f-bd8b560aed47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb83d80a5-3a') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb83d80a5-3a, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb83d80a5-3a, col_values=(('external_ids', {'iface-id': 'b83d80a5-3a19-412c-8d6b-89cb7f93c682', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:de:25', 'vm-uuid': 'c35f86ec-62d5-4c4d-a259-902e95aeb9d0'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:13 user nova-compute[73056]: INFO os_vif [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:de:25,bridge_name='br-int',has_traffic_filtering=True,id=b83d80a5-3a19-412c-8d6b-89cb7f93c682,network=Network(c2b49cd1-a248-4bd2-924f-bd8b560aed47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb83d80a5-3a')
Aug 14 16:51:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] No VIF found with MAC fa:16:3e:d6:de:25, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG nova.network.neutron [req-754f7585-6dcc-4d4e-817e-4c0c52f735be req-e672cd04-91e8-4864-a74c-9158b16c4780 service nova] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Updated VIF entry in instance network info cache for port b83d80a5-3a19-412c-8d6b-89cb7f93c682. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG nova.network.neutron [req-754f7585-6dcc-4d4e-817e-4c0c52f735be req-e672cd04-91e8-4864-a74c-9158b16c4780 service nova] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Updating instance_info_cache with network_info: [{"id": "b83d80a5-3a19-412c-8d6b-89cb7f93c682", "address": "fa:16:3e:d6:de:25", "network": {"id": "c2b49cd1-a248-4bd2-924f-bd8b560aed47", "bridge": "br-int", "label": "tempest-TestStampPattern-1795667966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d796c14bd3489883e161ea1b311ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb83d80a5-3a", "ovs_interfaceid": "b83d80a5-3a19-412c-8d6b-89cb7f93c682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:51:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-754f7585-6dcc-4d4e-817e-4c0c52f735be req-e672cd04-91e8-4864-a74c-9158b16c4780 service nova] Releasing lock "refresh_cache-c35f86ec-62d5-4c4d-a259-902e95aeb9d0" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:51:14 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:14 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:14 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:14 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:15 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-c4d4c65b-0bcd-4582-ab51-a78bd4004f70 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Snapshot image upload complete
Aug 14 16:51:15 user nova-compute[73056]: DEBUG nova.compute.manager [None req-c4d4c65b-0bcd-4582-ab51-a78bd4004f70 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:51:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:15 user nova-compute[73056]: INFO nova.compute.manager [None req-c4d4c65b-0bcd-4582-ab51-a78bd4004f70 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Shelve offloading
Aug 14 16:51:15 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Instance destroyed successfully.
Aug 14 16:51:15 user nova-compute[73056]: DEBUG nova.compute.manager [None req-c4d4c65b-0bcd-4582-ab51-a78bd4004f70 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:51:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c4d4c65b-0bcd-4582-ab51-a78bd4004f70 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "refresh_cache-bcbe7449-6199-4e86-a8b6-c075e142aa34" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:51:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c4d4c65b-0bcd-4582-ab51-a78bd4004f70 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquired lock "refresh_cache-bcbe7449-6199-4e86-a8b6-c075e142aa34" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:51:15 user nova-compute[73056]: DEBUG nova.network.neutron [None req-c4d4c65b-0bcd-4582-ab51-a78bd4004f70 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:51:15 user nova-compute[73056]: DEBUG nova.network.neutron [None req-c4d4c65b-0bcd-4582-ab51-a78bd4004f70 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Updating instance_info_cache with network_info: [{"id": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "address": "fa:16:3e:04:a3:9a", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb018af9-f5", "ovs_interfaceid": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:51:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c4d4c65b-0bcd-4582-ab51-a78bd4004f70 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Releasing lock "refresh_cache-bcbe7449-6199-4e86-a8b6-c075e142aa34" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:51:16 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Instance destroyed successfully.
Aug 14 16:51:16 user nova-compute[73056]: DEBUG nova.objects.instance [None req-c4d4c65b-0bcd-4582-ab51-a78bd4004f70 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lazy-loading 'resources' on Instance uuid bcbe7449-6199-4e86-a8b6-c075e142aa34 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:51:16 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-c4d4c65b-0bcd-4582-ab51-a78bd4004f70 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:49:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1786420487',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1786420487',id=32,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIdip50bFOgddyMp6IylDQR0N/sRWs26ps8mtW957zlQ+lUd9LWGr01UNUfLRmUqKtnkrF4wbWmLfe2tOUrlScj2d5EzqiHJaA+1Q0ekto05woc7a99HlXR6VMKQ86FEw==',key_name='tempest-keypair-1929561178',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:49:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c67a1c8fcd97416e90f6b5a50a886a75',ramdisk_id='',reservation_id='r-c4car4yy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1935390723',owner_user_name='tempest-AttachVolumeShelveTestJSON-1935390723-project-member',shelved_at='2023-08-14T16:51:15.149934',shelved_host='user',shelved_image_id='36d46849-dbe0-45d9-b1c4-81dbc21ac957'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:51:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a20dd4c88984674996e26fdcfa4f126',uuid=bcbe7449-6199-4e86-a8b6-c075e142aa34,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "address": "fa:16:3e:04:a3:9a", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb018af9-f5", "ovs_interfaceid": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:51:16 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-c4d4c65b-0bcd-4582-ab51-a78bd4004f70 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Converting VIF {"id": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "address": "fa:16:3e:04:a3:9a", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb018af9-f5", "ovs_interfaceid": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:51:16 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-c4d4c65b-0bcd-4582-ab51-a78bd4004f70 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:a3:9a,bridge_name='br-int',has_traffic_filtering=True,id=cb018af9-f526-4333-9a2f-0cc2d91d22b2,network=Network(20384d1d-92c0-4ac7-a993-956fa784cd87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb018af9-f5') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:51:16 user nova-compute[73056]: DEBUG os_vif [None req-c4d4c65b-0bcd-4582-ab51-a78bd4004f70 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:a3:9a,bridge_name='br-int',has_traffic_filtering=True,id=cb018af9-f526-4333-9a2f-0cc2d91d22b2,network=Network(20384d1d-92c0-4ac7-a993-956fa784cd87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb018af9-f5') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:51:16 user nova-compute[73056]: DEBUG nova.compute.manager [req-31025b06-01c5-404c-a1c3-16d3e86080e9 req-9421249a-be1f-42d5-88d2-9e5440fe617d service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Received event network-changed-cb018af9-f526-4333-9a2f-0cc2d91d22b2 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:51:16 user nova-compute[73056]: DEBUG nova.compute.manager [req-31025b06-01c5-404c-a1c3-16d3e86080e9 req-9421249a-be1f-42d5-88d2-9e5440fe617d service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Refreshing instance network info cache due to event network-changed-cb018af9-f526-4333-9a2f-0cc2d91d22b2. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:51:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-31025b06-01c5-404c-a1c3-16d3e86080e9 req-9421249a-be1f-42d5-88d2-9e5440fe617d service nova] Acquiring lock "refresh_cache-bcbe7449-6199-4e86-a8b6-c075e142aa34" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:51:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-31025b06-01c5-404c-a1c3-16d3e86080e9 req-9421249a-be1f-42d5-88d2-9e5440fe617d service nova] Acquired lock "refresh_cache-bcbe7449-6199-4e86-a8b6-c075e142aa34" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:51:16 user nova-compute[73056]: DEBUG nova.network.neutron [req-31025b06-01c5-404c-a1c3-16d3e86080e9 req-9421249a-be1f-42d5-88d2-9e5440fe617d service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Refreshing network info cache for port cb018af9-f526-4333-9a2f-0cc2d91d22b2 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:51:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb018af9-f5, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:51:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:51:16 user nova-compute[73056]: INFO os_vif [None req-c4d4c65b-0bcd-4582-ab51-a78bd4004f70 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:a3:9a,bridge_name='br-int',has_traffic_filtering=True,id=cb018af9-f526-4333-9a2f-0cc2d91d22b2,network=Network(20384d1d-92c0-4ac7-a993-956fa784cd87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb018af9-f5')
Aug 14 16:51:16 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-c4d4c65b-0bcd-4582-ab51-a78bd4004f70 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Deleting instance files /opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34_del
Aug 14 16:51:16 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-c4d4c65b-0bcd-4582-ab51-a78bd4004f70 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Deletion of /opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34_del complete
Aug 14 16:51:16 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-c4d4c65b-0bcd-4582-ab51-a78bd4004f70 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Deleted allocations for instance bcbe7449-6199-4e86-a8b6-c075e142aa34
Aug 14 16:51:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c4d4c65b-0bcd-4582-ab51-a78bd4004f70 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:51:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c4d4c65b-0bcd-4582-ab51-a78bd4004f70 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:51:16 user nova-compute[73056]: DEBUG nova.objects.instance [None req-c4d4c65b-0bcd-4582-ab51-a78bd4004f70 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lazy-loading 'numa_topology' on Instance uuid bcbe7449-6199-4e86-a8b6-c075e142aa34 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:51:16 user nova-compute[73056]: DEBUG nova.network.neutron [req-31025b06-01c5-404c-a1c3-16d3e86080e9 req-9421249a-be1f-42d5-88d2-9e5440fe617d service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Updated VIF entry in instance network info cache for port cb018af9-f526-4333-9a2f-0cc2d91d22b2. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:51:16 user nova-compute[73056]: DEBUG nova.network.neutron [req-31025b06-01c5-404c-a1c3-16d3e86080e9 req-9421249a-be1f-42d5-88d2-9e5440fe617d service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Updating instance_info_cache with network_info: [{"id": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "address": "fa:16:3e:04:a3:9a", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapcb018af9-f5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:51:16 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-c4d4c65b-0bcd-4582-ab51-a78bd4004f70 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:51:16 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-c4d4c65b-0bcd-4582-ab51-a78bd4004f70 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:51:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-31025b06-01c5-404c-a1c3-16d3e86080e9 req-9421249a-be1f-42d5-88d2-9e5440fe617d service nova] Releasing lock "refresh_cache-bcbe7449-6199-4e86-a8b6-c075e142aa34" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:51:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c4d4c65b-0bcd-4582-ab51-a78bd4004f70 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:51:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c4d4c65b-0bcd-4582-ab51-a78bd4004f70 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "bcbe7449-6199-4e86-a8b6-c075e142aa34" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.225s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:51:17 user nova-compute[73056]: DEBUG nova.compute.manager [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:51:17 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:51:17 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031877.0668583, c35f86ec-62d5-4c4d-a259-902e95aeb9d0 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:51:17 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] VM Resumed (Lifecycle Event)
Aug 14 16:51:17 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Instance spawned successfully.
Aug 14 16:51:17 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:51:17 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:51:17 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:51:17 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:51:17 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:51:17 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:51:17 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031877.068533, c35f86ec-62d5-4c4d-a259-902e95aeb9d0 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:51:17 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] VM Started (Lifecycle Event)
Aug 14 16:51:17 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:51:17 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:51:17 user nova-compute[73056]: INFO nova.compute.manager [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Took 7.14 seconds to spawn the instance on the hypervisor.
Aug 14 16:51:17 user nova-compute[73056]: DEBUG nova.compute.manager [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:51:17 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:51:17 user nova-compute[73056]: INFO nova.compute.manager [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Took 8.65 seconds to build instance.
Aug 14 16:51:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-62d2027c-3747-4597-b1ea-8e26d88fb522 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "c35f86ec-62d5-4c4d-a259-902e95aeb9d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.782s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:51:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:17 user nova-compute[73056]: DEBUG nova.compute.manager [req-71efb0a9-e9cb-4beb-8eb7-31f2e2a13454 req-0db8ab03-fe9f-48a3-bedb-876162db87c3 service nova] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Received event network-vif-plugged-b83d80a5-3a19-412c-8d6b-89cb7f93c682 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:51:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-71efb0a9-e9cb-4beb-8eb7-31f2e2a13454 req-0db8ab03-fe9f-48a3-bedb-876162db87c3 service nova] Acquiring lock "c35f86ec-62d5-4c4d-a259-902e95aeb9d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:51:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-71efb0a9-e9cb-4beb-8eb7-31f2e2a13454 req-0db8ab03-fe9f-48a3-bedb-876162db87c3 service nova] Lock "c35f86ec-62d5-4c4d-a259-902e95aeb9d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:51:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-71efb0a9-e9cb-4beb-8eb7-31f2e2a13454 req-0db8ab03-fe9f-48a3-bedb-876162db87c3 service nova] Lock "c35f86ec-62d5-4c4d-a259-902e95aeb9d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:51:17 user nova-compute[73056]: DEBUG nova.compute.manager [req-71efb0a9-e9cb-4beb-8eb7-31f2e2a13454 req-0db8ab03-fe9f-48a3-bedb-876162db87c3 service nova] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] No waiting events found dispatching network-vif-plugged-b83d80a5-3a19-412c-8d6b-89cb7f93c682 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:51:17 user nova-compute[73056]: WARNING nova.compute.manager [req-71efb0a9-e9cb-4beb-8eb7-31f2e2a13454 req-0db8ab03-fe9f-48a3-bedb-876162db87c3 service nova] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Received unexpected event network-vif-plugged-b83d80a5-3a19-412c-8d6b-89cb7f93c682 for instance with vm_state active and task_state None.
Aug 14 16:51:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:19 user nova-compute[73056]: DEBUG nova.compute.manager [req-061e6b8b-3f3a-494c-b73b-ccf48a3b6227 req-9a12d4a1-4271-47ad-acad-7ba8b01aa2ec service nova] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Received event network-vif-plugged-b83d80a5-3a19-412c-8d6b-89cb7f93c682 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:51:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-061e6b8b-3f3a-494c-b73b-ccf48a3b6227 req-9a12d4a1-4271-47ad-acad-7ba8b01aa2ec service nova] Acquiring lock "c35f86ec-62d5-4c4d-a259-902e95aeb9d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:51:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-061e6b8b-3f3a-494c-b73b-ccf48a3b6227 req-9a12d4a1-4271-47ad-acad-7ba8b01aa2ec service nova] Lock "c35f86ec-62d5-4c4d-a259-902e95aeb9d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:51:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-061e6b8b-3f3a-494c-b73b-ccf48a3b6227 req-9a12d4a1-4271-47ad-acad-7ba8b01aa2ec service nova] Lock "c35f86ec-62d5-4c4d-a259-902e95aeb9d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:51:19 user nova-compute[73056]: DEBUG nova.compute.manager [req-061e6b8b-3f3a-494c-b73b-ccf48a3b6227 req-9a12d4a1-4271-47ad-acad-7ba8b01aa2ec service nova] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] No waiting events found dispatching network-vif-plugged-b83d80a5-3a19-412c-8d6b-89cb7f93c682 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:51:19 user nova-compute[73056]: WARNING nova.compute.manager [req-061e6b8b-3f3a-494c-b73b-ccf48a3b6227 req-9a12d4a1-4271-47ad-acad-7ba8b01aa2ec service nova] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Received unexpected event network-vif-plugged-b83d80a5-3a19-412c-8d6b-89cb7f93c682 for instance with vm_state active and task_state None.
Aug 14 16:51:21 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-dc197605-7cce-48ce-aa32-e015a25176c3 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "74ab3878-9362-4be0-a5bf-3759469473c9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:51:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-dc197605-7cce-48ce-aa32-e015a25176c3 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "74ab3878-9362-4be0-a5bf-3759469473c9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:51:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-dc197605-7cce-48ce-aa32-e015a25176c3 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "74ab3878-9362-4be0-a5bf-3759469473c9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:51:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-dc197605-7cce-48ce-aa32-e015a25176c3 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "74ab3878-9362-4be0-a5bf-3759469473c9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:51:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-dc197605-7cce-48ce-aa32-e015a25176c3 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "74ab3878-9362-4be0-a5bf-3759469473c9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:51:22 user nova-compute[73056]: INFO nova.compute.manager [None req-dc197605-7cce-48ce-aa32-e015a25176c3 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Terminating instance
Aug 14 16:51:22 user nova-compute[73056]: DEBUG nova.compute.manager [None req-dc197605-7cce-48ce-aa32-e015a25176c3 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 16:51:22 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:22 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Acquiring lock "ee670695-1123-4d95-a7ad-ac79f9a4c16e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:51:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Lock "ee670695-1123-4d95-a7ad-ac79f9a4c16e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:51:22 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:22 user nova-compute[73056]: DEBUG nova.compute.manager [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:51:22 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:51:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:51:22 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:51:22 user nova-compute[73056]: INFO nova.compute.claims [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Claim successful on node user
Aug 14 16:51:22 user nova-compute[73056]: DEBUG nova.compute.manager [req-5ab59c90-5539-44b4-b630-fe90dc991ad6 req-4065b242-e14a-4bb5-89d0-d685f4a2a264 service nova] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Received event network-vif-unplugged-01cf063c-b53e-44c8-9bf5-a858b9d8c316 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:51:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-5ab59c90-5539-44b4-b630-fe90dc991ad6 req-4065b242-e14a-4bb5-89d0-d685f4a2a264 service nova] Acquiring lock "74ab3878-9362-4be0-a5bf-3759469473c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:51:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-5ab59c90-5539-44b4-b630-fe90dc991ad6 req-4065b242-e14a-4bb5-89d0-d685f4a2a264 service nova] Lock "74ab3878-9362-4be0-a5bf-3759469473c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:51:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-5ab59c90-5539-44b4-b630-fe90dc991ad6 req-4065b242-e14a-4bb5-89d0-d685f4a2a264 service nova] Lock "74ab3878-9362-4be0-a5bf-3759469473c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:51:22 user nova-compute[73056]: DEBUG nova.compute.manager [req-5ab59c90-5539-44b4-b630-fe90dc991ad6 req-4065b242-e14a-4bb5-89d0-d685f4a2a264 service nova] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] No waiting events found dispatching network-vif-unplugged-01cf063c-b53e-44c8-9bf5-a858b9d8c316 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:51:22 user nova-compute[73056]: DEBUG nova.compute.manager [req-5ab59c90-5539-44b4-b630-fe90dc991ad6 req-4065b242-e14a-4bb5-89d0-d685f4a2a264 service nova] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Received event network-vif-unplugged-01cf063c-b53e-44c8-9bf5-a858b9d8c316 for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:51:22 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:51:22 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:51:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.467s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:51:22 user nova-compute[73056]: DEBUG nova.compute.manager [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:51:22 user nova-compute[73056]: DEBUG nova.compute.manager [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:51:22 user nova-compute[73056]: DEBUG nova.network.neutron [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:51:22 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Instance destroyed successfully.
Aug 14 16:51:22 user nova-compute[73056]: DEBUG nova.objects.instance [None req-dc197605-7cce-48ce-aa32-e015a25176c3 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lazy-loading 'resources' on Instance uuid 74ab3878-9362-4be0-a5bf-3759469473c9 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:51:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-dc197605-7cce-48ce-aa32-e015a25176c3 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:48:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-437728536',display_name='tempest-AttachVolumeNegativeTest-server-437728536',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-437728536',id=29,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaOo9JxiSTPsJdcVjikuTvszYhyLIuD6PyVUOJHSD6xibhw9x7TDje6BG+FcLiyuFbUfNi1CmNeiV0cpRwcTeJd3b8wV7xS11JQSv72YOTSERq+cxCJOVVgA/VU6DgACg==',key_name='tempest-keypair-389707962',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:48:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d5a8e599b3141339ed0ae6729031b36',ramdisk_id='',reservation_id='r-x7kmal2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-860464885',owner_user_name='tempest-AttachVolumeNegativeTest-860464885-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:48:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dad45adee1047bda7350d8a3f8a2f54',uuid=74ab3878-9362-4be0-a5bf-3759469473c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01cf063c-b53e-44c8-9bf5-a858b9d8c316", "address": "fa:16:3e:21:24:7a", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cf063c-b5", "ovs_interfaceid": "01cf063c-b53e-44c8-9bf5-a858b9d8c316", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:51:23 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-dc197605-7cce-48ce-aa32-e015a25176c3 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Converting VIF {"id": "01cf063c-b53e-44c8-9bf5-a858b9d8c316", "address": "fa:16:3e:21:24:7a", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cf063c-b5", "ovs_interfaceid": "01cf063c-b53e-44c8-9bf5-a858b9d8c316", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:51:23 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-dc197605-7cce-48ce-aa32-e015a25176c3 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:24:7a,bridge_name='br-int',has_traffic_filtering=True,id=01cf063c-b53e-44c8-9bf5-a858b9d8c316,network=Network(ad323a8d-7318-46f5-8af4-cbc61ae589b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01cf063c-b5') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:51:23 user nova-compute[73056]: DEBUG os_vif [None req-dc197605-7cce-48ce-aa32-e015a25176c3 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:24:7a,bridge_name='br-int',has_traffic_filtering=True,id=01cf063c-b53e-44c8-9bf5-a858b9d8c316,network=Network(ad323a8d-7318-46f5-8af4-cbc61ae589b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01cf063c-b5') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:51:23 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:51:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01cf063c-b5, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:51:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:51:23 user nova-compute[73056]: DEBUG nova.compute.manager [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:51:23 user nova-compute[73056]: INFO os_vif [None req-dc197605-7cce-48ce-aa32-e015a25176c3 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:24:7a,bridge_name='br-int',has_traffic_filtering=True,id=01cf063c-b53e-44c8-9bf5-a858b9d8c316,network=Network(ad323a8d-7318-46f5-8af4-cbc61ae589b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01cf063c-b5')
Aug 14 16:51:23 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-dc197605-7cce-48ce-aa32-e015a25176c3 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Deleting instance files /opt/stack/data/nova/instances/74ab3878-9362-4be0-a5bf-3759469473c9_del
Aug 14 16:51:23 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-dc197605-7cce-48ce-aa32-e015a25176c3 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Deletion of /opt/stack/data/nova/instances/74ab3878-9362-4be0-a5bf-3759469473c9_del complete
Aug 14 16:51:23 user nova-compute[73056]: INFO nova.compute.manager [None req-dc197605-7cce-48ce-aa32-e015a25176c3 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 14 16:51:23 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-dc197605-7cce-48ce-aa32-e015a25176c3 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 16:51:23 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 16:51:23 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 16:51:23 user nova-compute[73056]: DEBUG nova.compute.manager [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:51:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:51:23 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Creating image(s)
Aug 14 16:51:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Acquiring lock "/opt/stack/data/nova/instances/ee670695-1123-4d95-a7ad-ac79f9a4c16e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:51:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Lock "/opt/stack/data/nova/instances/ee670695-1123-4d95-a7ad-ac79f9a4c16e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:51:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Lock "/opt/stack/data/nova/instances/ee670695-1123-4d95-a7ad-ac79f9a4c16e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:51:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:23 user nova-compute[73056]: DEBUG nova.policy [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a4b06c86dbd4deeab9487960525261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd5d01bac1242ec9897e6931102e1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:51:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.203s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Acquiring lock "c889592ab94cd0b0ce896f27a2af0323771db234" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:51:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:51:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.228s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/ee670695-1123-4d95-a7ad-ac79f9a4c16e/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/ee670695-1123-4d95-a7ad-ac79f9a4c16e/disk 1073741824" returned: 0 in 0.121s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.356s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:51:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.203s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:23 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ee670695-1123-4d95-a7ad-ac79f9a4c16e/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 16:51:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee670695-1123-4d95-a7ad-ac79f9a4c16e/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:24 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee670695-1123-4d95-a7ad-ac79f9a4c16e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:24 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Cannot resize image /opt/stack/data/nova/instances/ee670695-1123-4d95-a7ad-ac79f9a4c16e/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 16:51:24 user nova-compute[73056]: DEBUG nova.objects.instance [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Lazy-loading 'migration_context' on Instance uuid ee670695-1123-4d95-a7ad-ac79f9a4c16e {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:51:24 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 16:51:24 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Ensure instance console log exists: /opt/stack/data/nova/instances/ee670695-1123-4d95-a7ad-ac79f9a4c16e/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:51:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:51:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:51:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:51:24 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:51:24 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Took 1.10 seconds to deallocate network for instance.
Aug 14 16:51:24 user nova-compute[73056]: DEBUG nova.compute.manager [req-013aed79-5dd8-4c10-a16b-21c943ffac9a req-ad533dcd-7790-4f20-a43e-b12cad64ca2a service nova] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Received event network-vif-deleted-01cf063c-b53e-44c8-9bf5-a858b9d8c316 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:51:24 user nova-compute[73056]: DEBUG nova.network.neutron [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Successfully created port: 5fd92a95-cd11-4828-9731-91e305ac7b26 {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:51:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-dc197605-7cce-48ce-aa32-e015a25176c3 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:51:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-dc197605-7cce-48ce-aa32-e015a25176c3 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:51:24 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692031869.4932086, bcbe7449-6199-4e86-a8b6-c075e142aa34 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:51:24 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] VM Stopped (Lifecycle Event)
Aug 14 16:51:24 user nova-compute[73056]: DEBUG nova.compute.manager [req-9af540e8-2c95-43dc-9d07-e01dc81391d0 req-b2fcb36c-79ae-4b50-b0a4-e4c7c64415ec service nova] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Received event network-vif-plugged-01cf063c-b53e-44c8-9bf5-a858b9d8c316 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:51:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9af540e8-2c95-43dc-9d07-e01dc81391d0 req-b2fcb36c-79ae-4b50-b0a4-e4c7c64415ec service nova] Acquiring lock "74ab3878-9362-4be0-a5bf-3759469473c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:51:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9af540e8-2c95-43dc-9d07-e01dc81391d0 req-b2fcb36c-79ae-4b50-b0a4-e4c7c64415ec service nova] Lock "74ab3878-9362-4be0-a5bf-3759469473c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:51:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9af540e8-2c95-43dc-9d07-e01dc81391d0 req-b2fcb36c-79ae-4b50-b0a4-e4c7c64415ec service nova] Lock "74ab3878-9362-4be0-a5bf-3759469473c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:51:24 user nova-compute[73056]: DEBUG nova.compute.manager [req-9af540e8-2c95-43dc-9d07-e01dc81391d0 req-b2fcb36c-79ae-4b50-b0a4-e4c7c64415ec service nova] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] No waiting events found dispatching network-vif-plugged-01cf063c-b53e-44c8-9bf5-a858b9d8c316 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:51:24 user nova-compute[73056]: WARNING nova.compute.manager [req-9af540e8-2c95-43dc-9d07-e01dc81391d0 req-b2fcb36c-79ae-4b50-b0a4-e4c7c64415ec service nova] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Received unexpected event network-vif-plugged-01cf063c-b53e-44c8-9bf5-a858b9d8c316 for instance with vm_state deleted and task_state None.
Aug 14 16:51:24 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5db561a5-6988-4ec3-bd48-0ae46def44b7 None None] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:51:24 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-dc197605-7cce-48ce-aa32-e015a25176c3 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:51:24 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-dc197605-7cce-48ce-aa32-e015a25176c3 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:51:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-dc197605-7cce-48ce-aa32-e015a25176c3 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:51:24 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-dc197605-7cce-48ce-aa32-e015a25176c3 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Deleted allocations for instance 74ab3878-9362-4be0-a5bf-3759469473c9
Aug 14 16:51:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-dc197605-7cce-48ce-aa32-e015a25176c3 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "74ab3878-9362-4be0-a5bf-3759469473c9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.745s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG nova.network.neutron [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Successfully updated port: 5fd92a95-cd11-4828-9731-91e305ac7b26 {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Acquiring lock "refresh_cache-ee670695-1123-4d95-a7ad-ac79f9a4c16e" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Acquired lock "refresh_cache-ee670695-1123-4d95-a7ad-ac79f9a4c16e" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG nova.network.neutron [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG nova.network.neutron [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG nova.network.neutron [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Updating instance_info_cache with network_info: [{"id": "5fd92a95-cd11-4828-9731-91e305ac7b26", "address": "fa:16:3e:b4:d2:be", "network": {"id": "89b465ce-32d9-4246-ab29-eaca3017bf33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-295083994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bd5d01bac1242ec9897e6931102e1b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd92a95-cd", "ovs_interfaceid": "5fd92a95-cd11-4828-9731-91e305ac7b26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Releasing lock "refresh_cache-ee670695-1123-4d95-a7ad-ac79f9a4c16e" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG nova.compute.manager [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Instance network_info: |[{"id": "5fd92a95-cd11-4828-9731-91e305ac7b26", "address": "fa:16:3e:b4:d2:be", "network": {"id": "89b465ce-32d9-4246-ab29-eaca3017bf33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-295083994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bd5d01bac1242ec9897e6931102e1b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd92a95-cd", "ovs_interfaceid": "5fd92a95-cd11-4828-9731-91e305ac7b26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Start _get_guest_xml network_info=[{"id": "5fd92a95-cd11-4828-9731-91e305ac7b26", "address": "fa:16:3e:b4:d2:be", "network": {"id": "89b465ce-32d9-4246-ab29-eaca3017bf33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-295083994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bd5d01bac1242ec9897e6931102e1b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd92a95-cd", "ovs_interfaceid": "5fd92a95-cd11-4828-9731-91e305ac7b26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:51:25 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:51:25 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:51:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:51:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1307435377',display_name='tempest-SnapshotDataIntegrityTests-server-1307435377',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1307435377',id=35,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkVvreyh0PKcl3K/1he4BnJ7v28Teb+dIvDI1x122iDpfF3dyGYNX/Gx2zX8vCYtpZW9EHsORp9Ts3FXbIcpd8GxlO2fNOMGh0H42XplDA36Bq4nDVWXgq9NZ8wKxxFwg==',key_name='tempest-keypair-546350850',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2bd5d01bac1242ec9897e6931102e1b0',ramdisk_id='',reservation_id='r-4nwo5os7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-686395378',owner_user_name='tempest-SnapshotDataIntegrityTests-686395378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:51:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a4b06c86dbd4deeab9487960525261b',uuid=ee670695-1123-4d95-a7ad-ac79f9a4c16e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fd92a95-cd11-4828-9731-91e305ac7b26", "address": "fa:16:3e:b4:d2:be", "network": {"id": "89b465ce-32d9-4246-ab29-eaca3017bf33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-295083994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bd5d01bac1242ec9897e6931102e1b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd92a95-cd", "ovs_interfaceid": "5fd92a95-cd11-4828-9731-91e305ac7b26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Converting VIF {"id": "5fd92a95-cd11-4828-9731-91e305ac7b26", "address": "fa:16:3e:b4:d2:be", "network": {"id": "89b465ce-32d9-4246-ab29-eaca3017bf33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-295083994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bd5d01bac1242ec9897e6931102e1b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd92a95-cd", "ovs_interfaceid": "5fd92a95-cd11-4828-9731-91e305ac7b26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:d2:be,bridge_name='br-int',has_traffic_filtering=True,id=5fd92a95-cd11-4828-9731-91e305ac7b26,network=Network(89b465ce-32d9-4246-ab29-eaca3017bf33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fd92a95-cd') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG nova.objects.instance [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Lazy-loading 'pci_devices' on Instance uuid ee670695-1123-4d95-a7ad-ac79f9a4c16e {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:51:25 user nova-compute[73056]:   <uuid>ee670695-1123-4d95-a7ad-ac79f9a4c16e</uuid>
Aug 14 16:51:25 user nova-compute[73056]:   <name>instance-00000023</name>
Aug 14 16:51:25 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:51:25 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:51:25 user nova-compute[73056]:   <metadata>
Aug 14 16:51:25 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:51:25 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:51:25 user nova-compute[73056]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1307435377</nova:name>
Aug 14 16:51:25 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:51:25</nova:creationTime>
Aug 14 16:51:25 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:51:25 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:51:25 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:51:25 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:51:25 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:51:25 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:51:25 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:51:25 user nova-compute[73056]:       <nova:owner>
Aug 14 16:51:25 user nova-compute[73056]:         <nova:user uuid="4a4b06c86dbd4deeab9487960525261b">tempest-SnapshotDataIntegrityTests-686395378-project-member</nova:user>
Aug 14 16:51:25 user nova-compute[73056]:         <nova:project uuid="2bd5d01bac1242ec9897e6931102e1b0">tempest-SnapshotDataIntegrityTests-686395378</nova:project>
Aug 14 16:51:25 user nova-compute[73056]:       </nova:owner>
Aug 14 16:51:25 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:51:25 user nova-compute[73056]:       <nova:ports>
Aug 14 16:51:25 user nova-compute[73056]:         <nova:port uuid="5fd92a95-cd11-4828-9731-91e305ac7b26">
Aug 14 16:51:25 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 16:51:25 user nova-compute[73056]:         </nova:port>
Aug 14 16:51:25 user nova-compute[73056]:       </nova:ports>
Aug 14 16:51:25 user nova-compute[73056]:     </nova:instance>
Aug 14 16:51:25 user nova-compute[73056]:   </metadata>
Aug 14 16:51:25 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:51:25 user nova-compute[73056]:     <system>
Aug 14 16:51:25 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:51:25 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:51:25 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:51:25 user nova-compute[73056]:       <entry name="serial">ee670695-1123-4d95-a7ad-ac79f9a4c16e</entry>
Aug 14 16:51:25 user nova-compute[73056]:       <entry name="uuid">ee670695-1123-4d95-a7ad-ac79f9a4c16e</entry>
Aug 14 16:51:25 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:51:25 user nova-compute[73056]:     </system>
Aug 14 16:51:25 user nova-compute[73056]:   </sysinfo>
Aug 14 16:51:25 user nova-compute[73056]:   <os>
Aug 14 16:51:25 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:51:25 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:51:25 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:51:25 user nova-compute[73056]:   </os>
Aug 14 16:51:25 user nova-compute[73056]:   <features>
Aug 14 16:51:25 user nova-compute[73056]:     <acpi/>
Aug 14 16:51:25 user nova-compute[73056]:     <apic/>
Aug 14 16:51:25 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:51:25 user nova-compute[73056]:   </features>
Aug 14 16:51:25 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:51:25 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:51:25 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:51:25 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:51:25 user nova-compute[73056]:   </clock>
Aug 14 16:51:25 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:51:25 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:51:25 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:51:25 user nova-compute[73056]:   </cpu>
Aug 14 16:51:25 user nova-compute[73056]:   <devices>
Aug 14 16:51:25 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:51:25 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:51:25 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/ee670695-1123-4d95-a7ad-ac79f9a4c16e/disk"/>
Aug 14 16:51:25 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:51:25 user nova-compute[73056]:     </disk>
Aug 14 16:51:25 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:51:25 user nova-compute[73056]:       <mac address="fa:16:3e:b4:d2:be"/>
Aug 14 16:51:25 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:51:25 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:51:25 user nova-compute[73056]:       <target dev="tap5fd92a95-cd"/>
Aug 14 16:51:25 user nova-compute[73056]:     </interface>
Aug 14 16:51:25 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:51:25 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/ee670695-1123-4d95-a7ad-ac79f9a4c16e/console.log" append="off"/>
Aug 14 16:51:25 user nova-compute[73056]:     </serial>
Aug 14 16:51:25 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:51:25 user nova-compute[73056]:     <video>
Aug 14 16:51:25 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:51:25 user nova-compute[73056]:     </video>
Aug 14 16:51:25 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:51:25 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:51:25 user nova-compute[73056]:     </rng>
Aug 14 16:51:25 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:51:25 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:51:25 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:51:25 user nova-compute[73056]:     </memballoon>
Aug 14 16:51:25 user nova-compute[73056]:   </devices>
Aug 14 16:51:25 user nova-compute[73056]: </domain>
Aug 14 16:51:25 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:51:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1307435377',display_name='tempest-SnapshotDataIntegrityTests-server-1307435377',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1307435377',id=35,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkVvreyh0PKcl3K/1he4BnJ7v28Teb+dIvDI1x122iDpfF3dyGYNX/Gx2zX8vCYtpZW9EHsORp9Ts3FXbIcpd8GxlO2fNOMGh0H42XplDA36Bq4nDVWXgq9NZ8wKxxFwg==',key_name='tempest-keypair-546350850',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2bd5d01bac1242ec9897e6931102e1b0',ramdisk_id='',reservation_id='r-4nwo5os7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-686395378',owner_user_name='tempest-SnapshotDataIntegrityTests-686395378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:51:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a4b06c86dbd4deeab9487960525261b',uuid=ee670695-1123-4d95-a7ad-ac79f9a4c16e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fd92a95-cd11-4828-9731-91e305ac7b26", "address": "fa:16:3e:b4:d2:be", "network": {"id": "89b465ce-32d9-4246-ab29-eaca3017bf33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-295083994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bd5d01bac1242ec9897e6931102e1b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd92a95-cd", "ovs_interfaceid": "5fd92a95-cd11-4828-9731-91e305ac7b26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Converting VIF {"id": "5fd92a95-cd11-4828-9731-91e305ac7b26", "address": "fa:16:3e:b4:d2:be", "network": {"id": "89b465ce-32d9-4246-ab29-eaca3017bf33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-295083994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bd5d01bac1242ec9897e6931102e1b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd92a95-cd", "ovs_interfaceid": "5fd92a95-cd11-4828-9731-91e305ac7b26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:d2:be,bridge_name='br-int',has_traffic_filtering=True,id=5fd92a95-cd11-4828-9731-91e305ac7b26,network=Network(89b465ce-32d9-4246-ab29-eaca3017bf33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fd92a95-cd') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG os_vif [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:d2:be,bridge_name='br-int',has_traffic_filtering=True,id=5fd92a95-cd11-4828-9731-91e305ac7b26,network=Network(89b465ce-32d9-4246-ab29-eaca3017bf33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fd92a95-cd') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5fd92a95-cd, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5fd92a95-cd, col_values=(('external_ids', {'iface-id': '5fd92a95-cd11-4828-9731-91e305ac7b26', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:d2:be', 'vm-uuid': 'ee670695-1123-4d95-a7ad-ac79f9a4c16e'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:51:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:25 user nova-compute[73056]: INFO os_vif [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:d2:be,bridge_name='br-int',has_traffic_filtering=True,id=5fd92a95-cd11-4828-9731-91e305ac7b26,network=Network(89b465ce-32d9-4246-ab29-eaca3017bf33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fd92a95-cd')
Aug 14 16:51:26 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:51:26 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] No VIF found with MAC fa:16:3e:b4:d2:be, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:51:26 user nova-compute[73056]: DEBUG nova.compute.manager [req-cdb793d8-89f5-49bf-b25a-3171b3f5831e req-00391ea8-63fa-45ae-b14f-98d9e48005f2 service nova] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Received event network-changed-5fd92a95-cd11-4828-9731-91e305ac7b26 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:51:26 user nova-compute[73056]: DEBUG nova.compute.manager [req-cdb793d8-89f5-49bf-b25a-3171b3f5831e req-00391ea8-63fa-45ae-b14f-98d9e48005f2 service nova] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Refreshing instance network info cache due to event network-changed-5fd92a95-cd11-4828-9731-91e305ac7b26. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:51:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cdb793d8-89f5-49bf-b25a-3171b3f5831e req-00391ea8-63fa-45ae-b14f-98d9e48005f2 service nova] Acquiring lock "refresh_cache-ee670695-1123-4d95-a7ad-ac79f9a4c16e" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:51:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cdb793d8-89f5-49bf-b25a-3171b3f5831e req-00391ea8-63fa-45ae-b14f-98d9e48005f2 service nova] Acquired lock "refresh_cache-ee670695-1123-4d95-a7ad-ac79f9a4c16e" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:51:26 user nova-compute[73056]: DEBUG nova.network.neutron [req-cdb793d8-89f5-49bf-b25a-3171b3f5831e req-00391ea8-63fa-45ae-b14f-98d9e48005f2 service nova] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Refreshing network info cache for port 5fd92a95-cd11-4828-9731-91e305ac7b26 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:51:26 user nova-compute[73056]: DEBUG nova.network.neutron [req-cdb793d8-89f5-49bf-b25a-3171b3f5831e req-00391ea8-63fa-45ae-b14f-98d9e48005f2 service nova] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Updated VIF entry in instance network info cache for port 5fd92a95-cd11-4828-9731-91e305ac7b26. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:51:26 user nova-compute[73056]: DEBUG nova.network.neutron [req-cdb793d8-89f5-49bf-b25a-3171b3f5831e req-00391ea8-63fa-45ae-b14f-98d9e48005f2 service nova] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Updating instance_info_cache with network_info: [{"id": "5fd92a95-cd11-4828-9731-91e305ac7b26", "address": "fa:16:3e:b4:d2:be", "network": {"id": "89b465ce-32d9-4246-ab29-eaca3017bf33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-295083994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bd5d01bac1242ec9897e6931102e1b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd92a95-cd", "ovs_interfaceid": "5fd92a95-cd11-4828-9731-91e305ac7b26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:51:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cdb793d8-89f5-49bf-b25a-3171b3f5831e req-00391ea8-63fa-45ae-b14f-98d9e48005f2 service nova] Releasing lock "refresh_cache-ee670695-1123-4d95-a7ad-ac79f9a4c16e" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:51:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:27 user nova-compute[73056]: DEBUG nova.compute.manager [req-0722572c-eabd-4cbc-886d-981063671c32 req-c4bfd02e-3de4-429d-bd6c-ab404ecdd2c5 service nova] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Received event network-vif-plugged-5fd92a95-cd11-4828-9731-91e305ac7b26 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:51:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0722572c-eabd-4cbc-886d-981063671c32 req-c4bfd02e-3de4-429d-bd6c-ab404ecdd2c5 service nova] Acquiring lock "ee670695-1123-4d95-a7ad-ac79f9a4c16e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:51:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0722572c-eabd-4cbc-886d-981063671c32 req-c4bfd02e-3de4-429d-bd6c-ab404ecdd2c5 service nova] Lock "ee670695-1123-4d95-a7ad-ac79f9a4c16e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:51:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0722572c-eabd-4cbc-886d-981063671c32 req-c4bfd02e-3de4-429d-bd6c-ab404ecdd2c5 service nova] Lock "ee670695-1123-4d95-a7ad-ac79f9a4c16e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:51:27 user nova-compute[73056]: DEBUG nova.compute.manager [req-0722572c-eabd-4cbc-886d-981063671c32 req-c4bfd02e-3de4-429d-bd6c-ab404ecdd2c5 service nova] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] No waiting events found dispatching network-vif-plugged-5fd92a95-cd11-4828-9731-91e305ac7b26 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:51:27 user nova-compute[73056]: WARNING nova.compute.manager [req-0722572c-eabd-4cbc-886d-981063671c32 req-c4bfd02e-3de4-429d-bd6c-ab404ecdd2c5 service nova] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Received unexpected event network-vif-plugged-5fd92a95-cd11-4828-9731-91e305ac7b26 for instance with vm_state building and task_state spawning.
Aug 14 16:51:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:29 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031889.6870449, ee670695-1123-4d95-a7ad-ac79f9a4c16e => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:51:29 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] VM Resumed (Lifecycle Event)
Aug 14 16:51:29 user nova-compute[73056]: DEBUG nova.compute.manager [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:51:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:51:29 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Instance spawned successfully.
Aug 14 16:51:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:51:29 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:51:29 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:51:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:51:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:51:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:51:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:51:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:51:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:51:29 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:51:29 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031889.687229, ee670695-1123-4d95-a7ad-ac79f9a4c16e => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:51:29 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] VM Started (Lifecycle Event)
Aug 14 16:51:29 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:51:29 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:51:29 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:51:29 user nova-compute[73056]: INFO nova.compute.manager [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Took 6.66 seconds to spawn the instance on the hypervisor.
Aug 14 16:51:29 user nova-compute[73056]: DEBUG nova.compute.manager [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:51:29 user nova-compute[73056]: DEBUG nova.compute.manager [req-18f162a0-993c-4b78-b3b1-28fe1978f4be req-c38a68bb-6371-4265-bac7-659a9341c3ad service nova] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Received event network-vif-plugged-5fd92a95-cd11-4828-9731-91e305ac7b26 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:51:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-18f162a0-993c-4b78-b3b1-28fe1978f4be req-c38a68bb-6371-4265-bac7-659a9341c3ad service nova] Acquiring lock "ee670695-1123-4d95-a7ad-ac79f9a4c16e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:51:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-18f162a0-993c-4b78-b3b1-28fe1978f4be req-c38a68bb-6371-4265-bac7-659a9341c3ad service nova] Lock "ee670695-1123-4d95-a7ad-ac79f9a4c16e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:51:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-18f162a0-993c-4b78-b3b1-28fe1978f4be req-c38a68bb-6371-4265-bac7-659a9341c3ad service nova] Lock "ee670695-1123-4d95-a7ad-ac79f9a4c16e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:51:29 user nova-compute[73056]: DEBUG nova.compute.manager [req-18f162a0-993c-4b78-b3b1-28fe1978f4be req-c38a68bb-6371-4265-bac7-659a9341c3ad service nova] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] No waiting events found dispatching network-vif-plugged-5fd92a95-cd11-4828-9731-91e305ac7b26 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:51:29 user nova-compute[73056]: WARNING nova.compute.manager [req-18f162a0-993c-4b78-b3b1-28fe1978f4be req-c38a68bb-6371-4265-bac7-659a9341c3ad service nova] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Received unexpected event network-vif-plugged-5fd92a95-cd11-4828-9731-91e305ac7b26 for instance with vm_state building and task_state spawning.
Aug 14 16:51:29 user nova-compute[73056]: INFO nova.compute.manager [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Took 7.52 seconds to build instance.
Aug 14 16:51:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9787ce13-5be9-4da0-af68-6b33aba77b38 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Lock "ee670695-1123-4d95-a7ad-ac79f9a4c16e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.644s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:51:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:37 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692031882.9866874, 74ab3878-9362-4be0-a5bf-3759469473c9 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:51:37 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] VM Stopped (Lifecycle Event)
Aug 14 16:51:38 user nova-compute[73056]: DEBUG nova.compute.manager [None req-65903152-0bbc-48c7-a41c-42db0f78a65e None None] [instance: 74ab3878-9362-4be0-a5bf-3759469473c9] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:51:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "7526c6c3-6d3c-435e-8fc7-742c08be44d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:51:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "7526c6c3-6d3c-435e-8fc7-742c08be44d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:51:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "7526c6c3-6d3c-435e-8fc7-742c08be44d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:51:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "7526c6c3-6d3c-435e-8fc7-742c08be44d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:51:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "7526c6c3-6d3c-435e-8fc7-742c08be44d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:51:40 user nova-compute[73056]: INFO nova.compute.manager [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Terminating instance
Aug 14 16:51:40 user nova-compute[73056]: DEBUG nova.compute.manager [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 16:51:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG nova.compute.manager [req-c36a99d6-ba4b-4906-9a9a-a61b32481d5b req-442b4ece-4e6b-4e0a-9311-469f7b7ee08c service nova] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Received event network-vif-unplugged-a97a3360-819f-4ea9-98e9-2f475b260008 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c36a99d6-ba4b-4906-9a9a-a61b32481d5b req-442b4ece-4e6b-4e0a-9311-469f7b7ee08c service nova] Acquiring lock "7526c6c3-6d3c-435e-8fc7-742c08be44d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c36a99d6-ba4b-4906-9a9a-a61b32481d5b req-442b4ece-4e6b-4e0a-9311-469f7b7ee08c service nova] Lock "7526c6c3-6d3c-435e-8fc7-742c08be44d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c36a99d6-ba4b-4906-9a9a-a61b32481d5b req-442b4ece-4e6b-4e0a-9311-469f7b7ee08c service nova] Lock "7526c6c3-6d3c-435e-8fc7-742c08be44d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG nova.compute.manager [req-c36a99d6-ba4b-4906-9a9a-a61b32481d5b req-442b4ece-4e6b-4e0a-9311-469f7b7ee08c service nova] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] No waiting events found dispatching network-vif-unplugged-a97a3360-819f-4ea9-98e9-2f475b260008 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG nova.compute.manager [req-c36a99d6-ba4b-4906-9a9a-a61b32481d5b req-442b4ece-4e6b-4e0a-9311-469f7b7ee08c service nova] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Received event network-vif-unplugged-a97a3360-819f-4ea9-98e9-2f475b260008 for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:51:41 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Instance destroyed successfully.
Aug 14 16:51:41 user nova-compute[73056]: DEBUG nova.objects.instance [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lazy-loading 'resources' on Instance uuid 7526c6c3-6d3c-435e-8fc7-742c08be44d0 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:46:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-673849661',display_name='tempest-TestVolumeBootPattern-volume-backed-server-673849661',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-673849661',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGc7IuopkjjzNdNcFWYuM084+Lh0vN7ilsIJcPWDW1pU/oFfmkDOYKLrJp4Lj+eeUU6uItZQ8qnQhQYc71F1yS0jmLrNC3bnFKXcNCrNv/tf2zN9lbhSXYD17UdPUitKag==',key_name='tempest-keypair-2082052248',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:47:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cffb5203b9284500b8add8a6586cad49',ramdisk_id='',reservation_id='r-ri5hlptr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1676214558',owner_user_name='tempest-TestVolumeBootPattern-1676214558-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:47:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2be1b098ca9f4232bd198b515630f6ad',uuid=7526c6c3-6d3c-435e-8fc7-742c08be44d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a97a3360-819f-4ea9-98e9-2f475b260008", "address": "fa:16:3e:41:58:29", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa97a3360-81", "ovs_interfaceid": "a97a3360-819f-4ea9-98e9-2f475b260008", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Converting VIF {"id": "a97a3360-819f-4ea9-98e9-2f475b260008", "address": "fa:16:3e:41:58:29", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa97a3360-81", "ovs_interfaceid": "a97a3360-819f-4ea9-98e9-2f475b260008", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:58:29,bridge_name='br-int',has_traffic_filtering=True,id=a97a3360-819f-4ea9-98e9-2f475b260008,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa97a3360-81') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG os_vif [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:58:29,bridge_name='br-int',has_traffic_filtering=True,id=a97a3360-819f-4ea9-98e9-2f475b260008,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa97a3360-81') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa97a3360-81, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:51:41 user nova-compute[73056]: INFO os_vif [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:58:29,bridge_name='br-int',has_traffic_filtering=True,id=a97a3360-819f-4ea9-98e9-2f475b260008,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa97a3360-81')
Aug 14 16:51:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tqNQTZOd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:51:41 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:51:41 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[59370ff4-3e5d-490e-8f05-109ac1d1a45a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[df77666b-82e6-4156-8f57-0bf4160c228e]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:51:41 user nova-compute[73056]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:51:41 user nova-compute[73056]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)
Aug 14 16:51:41 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff (non-flash)
Aug 14 16:51:41 user nova-compute[73056]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:51:41 user nova-compute[73056]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)
Aug 14 16:51:41 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff2dcdcadd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff'): ({'sdd'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Removing single pathed devices sdd {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[87237483-7a7c-4576-a580-730c63ccf266]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[00295d35-ba77-4259-9e40-23990eec5050]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Flushing IO for device /dev/sdd {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc15b3c-21e8-40a1-8023-9142361e5834]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[120408d7-e6fb-4ac7-be88-748fa3b038f2]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] SCSI volumes sdd have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO8bd87418-e36a73b89931d8c1', '/dev/disk/by-id/scsi-26533366137336238', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8bd87418') {{(pid=83519) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a60430a-62b5-4418-8a47-bddeb1f3af98]: (4, None) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7822d2-6cdc-4310-879b-5071205eb9b2]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2a60eb-a6af-422c-901c-5cfc9ff1e1f7]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff, portal: 172.16.0.220,3260]
Aug 14 16:51:41 user nova-compute[73056]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff, portal: 172.16.0.220,3260] successful.
Aug 14 16:51:41 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00866544-b804-42b6-9c18-e2217e311cff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce6ff9b-6131-4161-a026-852bcc7690f3]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] <== disconnect_volume: return (325ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:51:41 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Deleting instance files /opt/stack/data/nova/instances/7526c6c3-6d3c-435e-8fc7-742c08be44d0_del
Aug 14 16:51:41 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Deletion of /opt/stack/data/nova/instances/7526c6c3-6d3c-435e-8fc7-742c08be44d0_del complete
Aug 14 16:51:41 user nova-compute[73056]: INFO nova.compute.manager [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Took 1.31 seconds to destroy the instance on the hypervisor.
Aug 14 16:51:41 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 16:51:41 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 16:51:42 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:51:42 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Took 1.21 seconds to deallocate network for instance.
Aug 14 16:51:42 user nova-compute[73056]: DEBUG nova.compute.manager [req-8e25eb72-b520-41f7-8842-a5bfba2955ce req-9c4a698a-a665-477c-907c-cab9660e87bc service nova] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Received event network-vif-deleted-a97a3360-819f-4ea9-98e9-2f475b260008 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:51:43 user nova-compute[73056]: DEBUG nova.compute.manager [req-2500feef-0048-4843-bb46-22a893ce1d71 req-2821b90c-1420-483c-a5e8-6b89cbff5800 service nova] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Received event network-vif-plugged-a97a3360-819f-4ea9-98e9-2f475b260008 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:51:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2500feef-0048-4843-bb46-22a893ce1d71 req-2821b90c-1420-483c-a5e8-6b89cbff5800 service nova] Acquiring lock "7526c6c3-6d3c-435e-8fc7-742c08be44d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:51:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2500feef-0048-4843-bb46-22a893ce1d71 req-2821b90c-1420-483c-a5e8-6b89cbff5800 service nova] Lock "7526c6c3-6d3c-435e-8fc7-742c08be44d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:51:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2500feef-0048-4843-bb46-22a893ce1d71 req-2821b90c-1420-483c-a5e8-6b89cbff5800 service nova] Lock "7526c6c3-6d3c-435e-8fc7-742c08be44d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:51:43 user nova-compute[73056]: DEBUG nova.compute.manager [req-2500feef-0048-4843-bb46-22a893ce1d71 req-2821b90c-1420-483c-a5e8-6b89cbff5800 service nova] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] No waiting events found dispatching network-vif-plugged-a97a3360-819f-4ea9-98e9-2f475b260008 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:51:43 user nova-compute[73056]: WARNING nova.compute.manager [req-2500feef-0048-4843-bb46-22a893ce1d71 req-2821b90c-1420-483c-a5e8-6b89cbff5800 service nova] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Received unexpected event network-vif-plugged-a97a3360-819f-4ea9-98e9-2f475b260008 for instance with vm_state active and task_state deleting.
Aug 14 16:51:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:43 user nova-compute[73056]: INFO nova.compute.manager [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Took 0.99 seconds to detach 1 volumes for instance.
Aug 14 16:51:43 user nova-compute[73056]: DEBUG nova.compute.manager [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Deleting volume: 00866544-b804-42b6-9c18-e2217e311cff {{(pid=73056) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 16:51:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:51:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:51:44 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:51:44 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:51:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:51:44 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Deleted allocations for instance 7526c6c3-6d3c-435e-8fc7-742c08be44d0
Aug 14 16:51:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-929e5997-a18c-4770-887f-d06049a547dd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "7526c6c3-6d3c-435e-8fc7-742c08be44d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.050s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:51:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:55 user nova-compute[73056]: DEBUG nova.compute.manager [req-d2af2b18-9c12-43a8-9d95-941535186e19 req-ded99106-7323-43d3-9784-45aca17b7edf service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Received event network-changed-9cdd486e-fc3e-4637-8958-eb7e065728fc {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:51:55 user nova-compute[73056]: DEBUG nova.compute.manager [req-d2af2b18-9c12-43a8-9d95-941535186e19 req-ded99106-7323-43d3-9784-45aca17b7edf service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Refreshing instance network info cache due to event network-changed-9cdd486e-fc3e-4637-8958-eb7e065728fc. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:51:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-d2af2b18-9c12-43a8-9d95-941535186e19 req-ded99106-7323-43d3-9784-45aca17b7edf service nova] Acquiring lock "refresh_cache-6910e1fe-8863-4a4b-b975-48c9ebb0b087" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:51:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-d2af2b18-9c12-43a8-9d95-941535186e19 req-ded99106-7323-43d3-9784-45aca17b7edf service nova] Acquired lock "refresh_cache-6910e1fe-8863-4a4b-b975-48c9ebb0b087" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:51:55 user nova-compute[73056]: DEBUG nova.network.neutron [req-d2af2b18-9c12-43a8-9d95-941535186e19 req-ded99106-7323-43d3-9784-45aca17b7edf service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Refreshing network info cache for port 9cdd486e-fc3e-4637-8958-eb7e065728fc {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:51:55 user nova-compute[73056]: DEBUG nova.network.neutron [req-d2af2b18-9c12-43a8-9d95-941535186e19 req-ded99106-7323-43d3-9784-45aca17b7edf service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Updated VIF entry in instance network info cache for port 9cdd486e-fc3e-4637-8958-eb7e065728fc. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:51:55 user nova-compute[73056]: DEBUG nova.network.neutron [req-d2af2b18-9c12-43a8-9d95-941535186e19 req-ded99106-7323-43d3-9784-45aca17b7edf service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Updating instance_info_cache with network_info: [{"id": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "address": "fa:16:3e:ef:51:62", "network": {"id": "73253aa9-a146-4f82-b5bb-1cc2dc68755c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1632478330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd21ca04890479e82483a51d05ba69b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cdd486e-fc", "ovs_interfaceid": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:51:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-d2af2b18-9c12-43a8-9d95-941535186e19 req-ded99106-7323-43d3-9784-45aca17b7edf service nova] Releasing lock "refresh_cache-6910e1fe-8863-4a4b-b975-48c9ebb0b087" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:51:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Acquiring lock "6910e1fe-8863-4a4b-b975-48c9ebb0b087" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:51:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lock "6910e1fe-8863-4a4b-b975-48c9ebb0b087" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:51:55 user nova-compute[73056]: INFO nova.compute.manager [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Shelve offloading
Aug 14 16:51:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:55 user nova-compute[73056]: DEBUG nova.compute.manager [req-a7635bc9-9389-40f0-bd78-c7ba6f8bd91b req-f3676403-85ce-40c8-88d6-924f38982ae7 service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Received event network-vif-unplugged-9cdd486e-fc3e-4637-8958-eb7e065728fc {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:51:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a7635bc9-9389-40f0-bd78-c7ba6f8bd91b req-f3676403-85ce-40c8-88d6-924f38982ae7 service nova] Acquiring lock "6910e1fe-8863-4a4b-b975-48c9ebb0b087-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:51:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a7635bc9-9389-40f0-bd78-c7ba6f8bd91b req-f3676403-85ce-40c8-88d6-924f38982ae7 service nova] Lock "6910e1fe-8863-4a4b-b975-48c9ebb0b087-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:51:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a7635bc9-9389-40f0-bd78-c7ba6f8bd91b req-f3676403-85ce-40c8-88d6-924f38982ae7 service nova] Lock "6910e1fe-8863-4a4b-b975-48c9ebb0b087-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:51:55 user nova-compute[73056]: DEBUG nova.compute.manager [req-a7635bc9-9389-40f0-bd78-c7ba6f8bd91b req-f3676403-85ce-40c8-88d6-924f38982ae7 service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] No waiting events found dispatching network-vif-unplugged-9cdd486e-fc3e-4637-8958-eb7e065728fc {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:51:55 user nova-compute[73056]: WARNING nova.compute.manager [req-a7635bc9-9389-40f0-bd78-c7ba6f8bd91b req-f3676403-85ce-40c8-88d6-924f38982ae7 service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Received unexpected event network-vif-unplugged-9cdd486e-fc3e-4637-8958-eb7e065728fc for instance with vm_state active and task_state shelving.
Aug 14 16:51:56 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692031901.0968704, 7526c6c3-6d3c-435e-8fc7-742c08be44d0 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:51:56 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] VM Stopped (Lifecycle Event)
Aug 14 16:51:56 user nova-compute[73056]: DEBUG nova.compute.manager [None req-6bb35f8f-8113-47ae-bc5e-77393d12ae87 None None] [instance: 7526c6c3-6d3c-435e-8fc7-742c08be44d0] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:51:56 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:56 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:56 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:51:56 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 16:51:56 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Instance destroyed successfully.
Aug 14 16:51:56 user nova-compute[73056]: DEBUG nova.compute.manager [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:51:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Acquiring lock "refresh_cache-6910e1fe-8863-4a4b-b975-48c9ebb0b087" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:51:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Acquired lock "refresh_cache-6910e1fe-8863-4a4b-b975-48c9ebb0b087" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:51:56 user nova-compute[73056]: DEBUG nova.network.neutron [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:51:56 user nova-compute[73056]: DEBUG nova.network.neutron [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Updating instance_info_cache with network_info: [{"id": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "address": "fa:16:3e:ef:51:62", "network": {"id": "73253aa9-a146-4f82-b5bb-1cc2dc68755c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1632478330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd21ca04890479e82483a51d05ba69b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cdd486e-fc", "ovs_interfaceid": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:51:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Releasing lock "refresh_cache-6910e1fe-8863-4a4b-b975-48c9ebb0b087" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:51:57 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Instance destroyed successfully.
Aug 14 16:51:57 user nova-compute[73056]: DEBUG nova.objects.instance [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lazy-loading 'resources' on Instance uuid 6910e1fe-8863-4a4b-b975-48c9ebb0b087 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG nova.compute.manager [req-bdabb1cd-11b9-4004-a3c6-a345d5eae6f8 req-7be04164-daa4-4eeb-b1d4-6d2ae3d9f35d service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Received event network-changed-9cdd486e-fc3e-4637-8958-eb7e065728fc {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG nova.compute.manager [req-bdabb1cd-11b9-4004-a3c6-a345d5eae6f8 req-7be04164-daa4-4eeb-b1d4-6d2ae3d9f35d service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Refreshing instance network info cache due to event network-changed-9cdd486e-fc3e-4637-8958-eb7e065728fc. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-bdabb1cd-11b9-4004-a3c6-a345d5eae6f8 req-7be04164-daa4-4eeb-b1d4-6d2ae3d9f35d service nova] Acquiring lock "refresh_cache-6910e1fe-8863-4a4b-b975-48c9ebb0b087" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-bdabb1cd-11b9-4004-a3c6-a345d5eae6f8 req-7be04164-daa4-4eeb-b1d4-6d2ae3d9f35d service nova] Acquired lock "refresh_cache-6910e1fe-8863-4a4b-b975-48c9ebb0b087" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG nova.network.neutron [req-bdabb1cd-11b9-4004-a3c6-a345d5eae6f8 req-7be04164-daa4-4eeb-b1d4-6d2ae3d9f35d service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Refreshing network info cache for port 9cdd486e-fc3e-4637-8958-eb7e065728fc {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:50:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-717451743',display_name='tempest-TestShelveInstance-server-717451743',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-717451743',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDhRa2OjjgafvbJzcWrUCAP3qcSeG+uScQ8aA6hOwczKubuJ9/RnKumPvOjbV+/S/S6PA9IzzUTPPv8AfFZzY4UVcbBr5jN47hcUBtIDD3aa8Tw2SRUV7hGEyr2sbVldg==',key_name='tempest-TestShelveInstance-1292582580',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:50:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dcd21ca04890479e82483a51d05ba69b',ramdisk_id='',reservation_id='r-288qfle8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-559346633',owner_user_name='tempest-TestShelveInstance-559346633-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:50:19Z,user_data=None,user_id='d586451958914503bac9c1fb5dedea9e',uuid=6910e1fe-8863-4a4b-b975-48c9ebb0b087,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "address": "fa:16:3e:ef:51:62", "network": {"id": "73253aa9-a146-4f82-b5bb-1cc2dc68755c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1632478330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd21ca04890479e82483a51d05ba69b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cdd486e-fc", "ovs_interfaceid": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Converting VIF {"id": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "address": "fa:16:3e:ef:51:62", "network": {"id": "73253aa9-a146-4f82-b5bb-1cc2dc68755c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1632478330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd21ca04890479e82483a51d05ba69b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cdd486e-fc", "ovs_interfaceid": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:51:62,bridge_name='br-int',has_traffic_filtering=True,id=9cdd486e-fc3e-4637-8958-eb7e065728fc,network=Network(73253aa9-a146-4f82-b5bb-1cc2dc68755c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cdd486e-fc') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG os_vif [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:51:62,bridge_name='br-int',has_traffic_filtering=True,id=9cdd486e-fc3e-4637-8958-eb7e065728fc,network=Network(73253aa9-a146-4f82-b5bb-1cc2dc68755c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cdd486e-fc') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9cdd486e-fc, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:51:57 user nova-compute[73056]: INFO os_vif [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:51:62,bridge_name='br-int',has_traffic_filtering=True,id=9cdd486e-fc3e-4637-8958-eb7e065728fc,network=Network(73253aa9-a146-4f82-b5bb-1cc2dc68755c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cdd486e-fc')
Aug 14 16:51:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BinUXqAW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:51:57 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:51:57 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f0ed25-21e5-4e37-976e-2f95ac174386]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4938d8-95d0-4644-9871-3e196cbd47a2]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:51:57 user nova-compute[73056]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)
Aug 14 16:51:57 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:51:57 user nova-compute[73056]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)
Aug 14 16:51:57 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff32c8b0d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d'): ({'sde'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Removing single pathed devices sde {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1637b71-b105-4ae3-bd5f-1a07f65fe655]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bc9de8-c2e7-4380-b38b-d00165e37492]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Flushing IO for device /dev/sde {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9603a46-8890-4e00-859d-b186fd3eac3e]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[551ca545-a5aa-4174-ab51-8b66ab891a1c]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] SCSI volumes sde have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6308f62-a756-4e30-a99d-7cf3faeb2ccf]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[583b97a9-6635-4546-8c5f-f7636196d3e3]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d, portal: 172.16.0.220,3260]
Aug 14 16:51:57 user nova-compute[73056]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d, portal: 172.16.0.220,3260] successful.
Aug 14 16:51:57 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:51:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:51:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:51:58 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[85eb4d81-d86f-4c80-beb9-ae96347aac50]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:51:58 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:51:58 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:51:58 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] <== disconnect_volume: return (278ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:51:58 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:51:58 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Deleting instance files /opt/stack/data/nova/instances/6910e1fe-8863-4a4b-b975-48c9ebb0b087_del
Aug 14 16:51:58 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Deletion of /opt/stack/data/nova/instances/6910e1fe-8863-4a4b-b975-48c9ebb0b087_del complete
Aug 14 16:51:58 user nova-compute[73056]: DEBUG nova.compute.manager [req-253d7b8b-6c57-4b8f-b78a-3bc4eaf87ecf req-284f8fb2-4c7a-407a-b774-edfd5d2f1963 service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Received event network-vif-plugged-9cdd486e-fc3e-4637-8958-eb7e065728fc {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:51:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-253d7b8b-6c57-4b8f-b78a-3bc4eaf87ecf req-284f8fb2-4c7a-407a-b774-edfd5d2f1963 service nova] Acquiring lock "6910e1fe-8863-4a4b-b975-48c9ebb0b087-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:51:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-253d7b8b-6c57-4b8f-b78a-3bc4eaf87ecf req-284f8fb2-4c7a-407a-b774-edfd5d2f1963 service nova] Lock "6910e1fe-8863-4a4b-b975-48c9ebb0b087-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:51:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-253d7b8b-6c57-4b8f-b78a-3bc4eaf87ecf req-284f8fb2-4c7a-407a-b774-edfd5d2f1963 service nova] Lock "6910e1fe-8863-4a4b-b975-48c9ebb0b087-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:51:58 user nova-compute[73056]: DEBUG nova.compute.manager [req-253d7b8b-6c57-4b8f-b78a-3bc4eaf87ecf req-284f8fb2-4c7a-407a-b774-edfd5d2f1963 service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] No waiting events found dispatching network-vif-plugged-9cdd486e-fc3e-4637-8958-eb7e065728fc {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:51:58 user nova-compute[73056]: WARNING nova.compute.manager [req-253d7b8b-6c57-4b8f-b78a-3bc4eaf87ecf req-284f8fb2-4c7a-407a-b774-edfd5d2f1963 service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Received unexpected event network-vif-plugged-9cdd486e-fc3e-4637-8958-eb7e065728fc for instance with vm_state active and task_state shelving.
Aug 14 16:51:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:51:58 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:51:58 user nova-compute[73056]: DEBUG nova.network.neutron [req-bdabb1cd-11b9-4004-a3c6-a345d5eae6f8 req-7be04164-daa4-4eeb-b1d4-6d2ae3d9f35d service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Updated VIF entry in instance network info cache for port 9cdd486e-fc3e-4637-8958-eb7e065728fc. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:51:58 user nova-compute[73056]: DEBUG nova.network.neutron [req-bdabb1cd-11b9-4004-a3c6-a345d5eae6f8 req-7be04164-daa4-4eeb-b1d4-6d2ae3d9f35d service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Updating instance_info_cache with network_info: [{"id": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "address": "fa:16:3e:ef:51:62", "network": {"id": "73253aa9-a146-4f82-b5bb-1cc2dc68755c", "bridge": null, "label": "tempest-TestShelveInstance-1632478330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd21ca04890479e82483a51d05ba69b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap9cdd486e-fc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:51:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-bdabb1cd-11b9-4004-a3c6-a345d5eae6f8 req-7be04164-daa4-4eeb-b1d4-6d2ae3d9f35d service nova] Releasing lock "refresh_cache-6910e1fe-8863-4a4b-b975-48c9ebb0b087" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:51:58 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Deleted allocations for instance 6910e1fe-8863-4a4b-b975-48c9ebb0b087
Aug 14 16:51:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:51:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:51:59 user nova-compute[73056]: DEBUG nova.objects.instance [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lazy-loading 'numa_topology' on Instance uuid 6910e1fe-8863-4a4b-b975-48c9ebb0b087 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:51:59 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:51:59 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:51:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.237s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:51:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25c4beeb-87db-407e-8a35-d1afa62340d3 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lock "6910e1fe-8863-4a4b-b975-48c9ebb0b087" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.624s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:52:01 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:52:01 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 16:52:01 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Rebuilding the list of instances to heal {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 16:52:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-9f3a7f8a-e3b9-4918-9663-968677fe5c90" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:52:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-9f3a7f8a-e3b9-4918-9663-968677fe5c90" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:52:01 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 16:52:01 user nova-compute[73056]: DEBUG nova.objects.instance [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lazy-loading 'info_cache' on Instance uuid 9f3a7f8a-e3b9-4918-9663-968677fe5c90 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:52:01 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Updating instance_info_cache with network_info: [{"id": "312bec25-d19f-423b-aca3-a4117119fc1f", "address": "fa:16:3e:03:ce:11", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312bec25-d1", "ovs_interfaceid": "312bec25-d19f-423b-aca3-a4117119fc1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:52:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-9f3a7f8a-e3b9-4918-9663-968677fe5c90" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:52:01 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 16:52:02 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:52:02 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:52:02 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:52:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:52:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:52:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:52:02 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 16:52:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:52:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:52:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:52:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:52:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:52:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:52:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:52:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:52:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35f86ec-62d5-4c4d-a259-902e95aeb9d0/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:52:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35f86ec-62d5-4c4d-a259-902e95aeb9d0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:52:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35f86ec-62d5-4c4d-a259-902e95aeb9d0/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:52:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35f86ec-62d5-4c4d-a259-902e95aeb9d0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:52:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:52:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:52:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:52:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:52:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:52:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:52:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:52:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:52:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:52:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee670695-1123-4d95-a7ad-ac79f9a4c16e/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:52:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee670695-1123-4d95-a7ad-ac79f9a4c16e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:52:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee670695-1123-4d95-a7ad-ac79f9a4c16e/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:52:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee670695-1123-4d95-a7ad-ac79f9a4c16e/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:52:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:52:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:52:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:52:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:52:05 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:52:05 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:52:05 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=7582MB free_disk=25.23947525024414GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 16:52:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:52:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:52:05 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 9f3a7f8a-e3b9-4918-9663-968677fe5c90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:52:05 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance b580e3d0-88b5-42a3-a953-84b94c088f41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:52:05 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 92c34cf0-fd39-49fc-9244-4da8ccae6eec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:52:05 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 61357ac0-230f-4711-8954-0bb04bfcb2f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:52:05 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance d79c2f2c-0870-4d8e-b468-36e63496b769 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:52:05 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance c35f86ec-62d5-4c4d-a259-902e95aeb9d0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:52:05 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance ee670695-1123-4d95-a7ad-ac79f9a4c16e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:52:05 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 16:52:05 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 16:52:06 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:52:06 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:52:06 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 16:52:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.601s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:52:06 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:52:06 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73056) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 16:52:07 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:52:07 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:52:07 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:52:07 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:52:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:11 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692031916.4352841, 6910e1fe-8863-4a4b-b975-48c9ebb0b087 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:52:11 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] VM Stopped (Lifecycle Event)
Aug 14 16:52:11 user nova-compute[73056]: DEBUG nova.compute.manager [None req-0eebcc8a-0f9e-4090-ac7f-eb8c74c3f2f1 None None] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:52:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:52:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 16:52:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 16:52:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 16:52:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "122c6152-2360-448b-b8e6-6d86bc736500" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:52:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "122c6152-2360-448b-b8e6-6d86bc736500" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:52:16 user nova-compute[73056]: DEBUG nova.compute.manager [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:52:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:52:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:52:16 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:52:16 user nova-compute[73056]: INFO nova.compute.claims [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Claim successful on node user
Aug 14 16:52:16 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:52:16 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:52:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.317s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:52:16 user nova-compute[73056]: DEBUG nova.compute.manager [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:52:16 user nova-compute[73056]: DEBUG nova.compute.manager [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:52:16 user nova-compute[73056]: DEBUG nova.network.neutron [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:52:16 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:52:16 user nova-compute[73056]: DEBUG nova.compute.manager [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:52:16 user nova-compute[73056]: DEBUG nova.policy [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3dad45adee1047bda7350d8a3f8a2f54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d5a8e599b3141339ed0ae6729031b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:52:16 user nova-compute[73056]: DEBUG nova.compute.manager [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:52:16 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:52:16 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Creating image(s)
Aug 14 16:52:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "/opt/stack/data/nova/instances/122c6152-2360-448b-b8e6-6d86bc736500/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:52:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "/opt/stack/data/nova/instances/122c6152-2360-448b-b8e6-6d86bc736500/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:52:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "/opt/stack/data/nova/instances/122c6152-2360-448b-b8e6-6d86bc736500/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:52:16 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:52:16 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.176s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:52:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "c889592ab94cd0b0ce896f27a2af0323771db234" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:52:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:52:16 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:52:17 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.172s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:52:17 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/122c6152-2360-448b-b8e6-6d86bc736500/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:52:17 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/122c6152-2360-448b-b8e6-6d86bc736500/disk 1073741824" returned: 0 in 0.201s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:52:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.381s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:52:17 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:52:17 user nova-compute[73056]: DEBUG nova.network.neutron [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Successfully created port: 94165c29-4578-453b-aa55-f9440d4ae07c {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:52:17 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:52:17 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Cleaning up deleted instances {{(pid=73056) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 16:52:17 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] There are 0 instances to clean {{(pid=73056) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 16:52:17 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.171s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:52:17 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Checking if we can resize image /opt/stack/data/nova/instances/122c6152-2360-448b-b8e6-6d86bc736500/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 16:52:17 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/122c6152-2360-448b-b8e6-6d86bc736500/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:52:17 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/122c6152-2360-448b-b8e6-6d86bc736500/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:52:17 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Cannot resize image /opt/stack/data/nova/instances/122c6152-2360-448b-b8e6-6d86bc736500/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 16:52:17 user nova-compute[73056]: DEBUG nova.objects.instance [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lazy-loading 'migration_context' on Instance uuid 122c6152-2360-448b-b8e6-6d86bc736500 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:52:17 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 16:52:17 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Ensure instance console log exists: /opt/stack/data/nova/instances/122c6152-2360-448b-b8e6-6d86bc736500/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:52:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:52:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:52:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:52:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG nova.network.neutron [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Successfully updated port: 94165c29-4578-453b-aa55-f9440d4ae07c {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "refresh_cache-122c6152-2360-448b-b8e6-6d86bc736500" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquired lock "refresh_cache-122c6152-2360-448b-b8e6-6d86bc736500" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG nova.network.neutron [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG nova.compute.manager [req-a5904c20-703c-4dc8-86bb-0c781fe735aa req-d239019a-16f8-40a6-a92f-efb5f42407db service nova] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Received event network-changed-94165c29-4578-453b-aa55-f9440d4ae07c {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG nova.compute.manager [req-a5904c20-703c-4dc8-86bb-0c781fe735aa req-d239019a-16f8-40a6-a92f-efb5f42407db service nova] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Refreshing instance network info cache due to event network-changed-94165c29-4578-453b-aa55-f9440d4ae07c. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a5904c20-703c-4dc8-86bb-0c781fe735aa req-d239019a-16f8-40a6-a92f-efb5f42407db service nova] Acquiring lock "refresh_cache-122c6152-2360-448b-b8e6-6d86bc736500" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG nova.network.neutron [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG nova.network.neutron [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Updating instance_info_cache with network_info: [{"id": "94165c29-4578-453b-aa55-f9440d4ae07c", "address": "fa:16:3e:88:c9:e1", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94165c29-45", "ovs_interfaceid": "94165c29-4578-453b-aa55-f9440d4ae07c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Releasing lock "refresh_cache-122c6152-2360-448b-b8e6-6d86bc736500" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG nova.compute.manager [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Instance network_info: |[{"id": "94165c29-4578-453b-aa55-f9440d4ae07c", "address": "fa:16:3e:88:c9:e1", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94165c29-45", "ovs_interfaceid": "94165c29-4578-453b-aa55-f9440d4ae07c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a5904c20-703c-4dc8-86bb-0c781fe735aa req-d239019a-16f8-40a6-a92f-efb5f42407db service nova] Acquired lock "refresh_cache-122c6152-2360-448b-b8e6-6d86bc736500" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG nova.network.neutron [req-a5904c20-703c-4dc8-86bb-0c781fe735aa req-d239019a-16f8-40a6-a92f-efb5f42407db service nova] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Refreshing network info cache for port 94165c29-4578-453b-aa55-f9440d4ae07c {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Start _get_guest_xml network_info=[{"id": "94165c29-4578-453b-aa55-f9440d4ae07c", "address": "fa:16:3e:88:c9:e1", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94165c29-45", "ovs_interfaceid": "94165c29-4578-453b-aa55-f9440d4ae07c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:52:18 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:52:18 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:52:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:52:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1587330365',display_name='tempest-AttachVolumeNegativeTest-server-1587330365',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1587330365',id=36,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/vyJHY4k/x5v76yhBD61wZ8W7EeilfJSD6Uj8zftQOcs5z3AcwtOXgSDNC/bP7lsqI56m9X2DMIi8A3RxbrLrWUPAsLf61qfy3EOIybMzx/eml54ZFYBKVLpR7xYoNCg==',key_name='tempest-keypair-1294610267',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d5a8e599b3141339ed0ae6729031b36',ramdisk_id='',reservation_id='r-2px6s0tn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-860464885',owner_user_name='tempest-AttachVolumeNegativeTest-860464885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:52:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dad45adee1047bda7350d8a3f8a2f54',uuid=122c6152-2360-448b-b8e6-6d86bc736500,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94165c29-4578-453b-aa55-f9440d4ae07c", "address": "fa:16:3e:88:c9:e1", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94165c29-45", "ovs_interfaceid": "94165c29-4578-453b-aa55-f9440d4ae07c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Converting VIF {"id": "94165c29-4578-453b-aa55-f9440d4ae07c", "address": "fa:16:3e:88:c9:e1", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94165c29-45", "ovs_interfaceid": "94165c29-4578-453b-aa55-f9440d4ae07c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:c9:e1,bridge_name='br-int',has_traffic_filtering=True,id=94165c29-4578-453b-aa55-f9440d4ae07c,network=Network(ad323a8d-7318-46f5-8af4-cbc61ae589b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94165c29-45') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG nova.objects.instance [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lazy-loading 'pci_devices' on Instance uuid 122c6152-2360-448b-b8e6-6d86bc736500 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:52:18 user nova-compute[73056]:   <uuid>122c6152-2360-448b-b8e6-6d86bc736500</uuid>
Aug 14 16:52:18 user nova-compute[73056]:   <name>instance-00000024</name>
Aug 14 16:52:18 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:52:18 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:52:18 user nova-compute[73056]:   <metadata>
Aug 14 16:52:18 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:52:18 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:52:18 user nova-compute[73056]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1587330365</nova:name>
Aug 14 16:52:18 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:52:18</nova:creationTime>
Aug 14 16:52:18 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:52:18 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:52:18 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:52:18 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:52:18 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:52:18 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:52:18 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:52:18 user nova-compute[73056]:       <nova:owner>
Aug 14 16:52:18 user nova-compute[73056]:         <nova:user uuid="3dad45adee1047bda7350d8a3f8a2f54">tempest-AttachVolumeNegativeTest-860464885-project-member</nova:user>
Aug 14 16:52:18 user nova-compute[73056]:         <nova:project uuid="9d5a8e599b3141339ed0ae6729031b36">tempest-AttachVolumeNegativeTest-860464885</nova:project>
Aug 14 16:52:18 user nova-compute[73056]:       </nova:owner>
Aug 14 16:52:18 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:52:18 user nova-compute[73056]:       <nova:ports>
Aug 14 16:52:18 user nova-compute[73056]:         <nova:port uuid="94165c29-4578-453b-aa55-f9440d4ae07c">
Aug 14 16:52:18 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 16:52:18 user nova-compute[73056]:         </nova:port>
Aug 14 16:52:18 user nova-compute[73056]:       </nova:ports>
Aug 14 16:52:18 user nova-compute[73056]:     </nova:instance>
Aug 14 16:52:18 user nova-compute[73056]:   </metadata>
Aug 14 16:52:18 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:52:18 user nova-compute[73056]:     <system>
Aug 14 16:52:18 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:52:18 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:52:18 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:52:18 user nova-compute[73056]:       <entry name="serial">122c6152-2360-448b-b8e6-6d86bc736500</entry>
Aug 14 16:52:18 user nova-compute[73056]:       <entry name="uuid">122c6152-2360-448b-b8e6-6d86bc736500</entry>
Aug 14 16:52:18 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:52:18 user nova-compute[73056]:     </system>
Aug 14 16:52:18 user nova-compute[73056]:   </sysinfo>
Aug 14 16:52:18 user nova-compute[73056]:   <os>
Aug 14 16:52:18 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:52:18 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:52:18 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:52:18 user nova-compute[73056]:   </os>
Aug 14 16:52:18 user nova-compute[73056]:   <features>
Aug 14 16:52:18 user nova-compute[73056]:     <acpi/>
Aug 14 16:52:18 user nova-compute[73056]:     <apic/>
Aug 14 16:52:18 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:52:18 user nova-compute[73056]:   </features>
Aug 14 16:52:18 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:52:18 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:52:18 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:52:18 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:52:18 user nova-compute[73056]:   </clock>
Aug 14 16:52:18 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:52:18 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:52:18 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:52:18 user nova-compute[73056]:   </cpu>
Aug 14 16:52:18 user nova-compute[73056]:   <devices>
Aug 14 16:52:18 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:52:18 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:52:18 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/122c6152-2360-448b-b8e6-6d86bc736500/disk"/>
Aug 14 16:52:18 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:52:18 user nova-compute[73056]:     </disk>
Aug 14 16:52:18 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:52:18 user nova-compute[73056]:       <mac address="fa:16:3e:88:c9:e1"/>
Aug 14 16:52:18 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:52:18 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:52:18 user nova-compute[73056]:       <target dev="tap94165c29-45"/>
Aug 14 16:52:18 user nova-compute[73056]:     </interface>
Aug 14 16:52:18 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:52:18 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/122c6152-2360-448b-b8e6-6d86bc736500/console.log" append="off"/>
Aug 14 16:52:18 user nova-compute[73056]:     </serial>
Aug 14 16:52:18 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:52:18 user nova-compute[73056]:     <video>
Aug 14 16:52:18 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:52:18 user nova-compute[73056]:     </video>
Aug 14 16:52:18 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:52:18 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:52:18 user nova-compute[73056]:     </rng>
Aug 14 16:52:18 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:52:18 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:52:18 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:52:18 user nova-compute[73056]:     </memballoon>
Aug 14 16:52:18 user nova-compute[73056]:   </devices>
Aug 14 16:52:18 user nova-compute[73056]: </domain>
Aug 14 16:52:18 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:52:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1587330365',display_name='tempest-AttachVolumeNegativeTest-server-1587330365',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1587330365',id=36,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/vyJHY4k/x5v76yhBD61wZ8W7EeilfJSD6Uj8zftQOcs5z3AcwtOXgSDNC/bP7lsqI56m9X2DMIi8A3RxbrLrWUPAsLf61qfy3EOIybMzx/eml54ZFYBKVLpR7xYoNCg==',key_name='tempest-keypair-1294610267',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d5a8e599b3141339ed0ae6729031b36',ramdisk_id='',reservation_id='r-2px6s0tn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-860464885',owner_user_name='tempest-AttachVolumeNegativeTest-860464885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:52:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dad45adee1047bda7350d8a3f8a2f54',uuid=122c6152-2360-448b-b8e6-6d86bc736500,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94165c29-4578-453b-aa55-f9440d4ae07c", "address": "fa:16:3e:88:c9:e1", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94165c29-45", "ovs_interfaceid": "94165c29-4578-453b-aa55-f9440d4ae07c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Converting VIF {"id": "94165c29-4578-453b-aa55-f9440d4ae07c", "address": "fa:16:3e:88:c9:e1", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94165c29-45", "ovs_interfaceid": "94165c29-4578-453b-aa55-f9440d4ae07c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:c9:e1,bridge_name='br-int',has_traffic_filtering=True,id=94165c29-4578-453b-aa55-f9440d4ae07c,network=Network(ad323a8d-7318-46f5-8af4-cbc61ae589b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94165c29-45') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG os_vif [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:c9:e1,bridge_name='br-int',has_traffic_filtering=True,id=94165c29-4578-453b-aa55-f9440d4ae07c,network=Network(ad323a8d-7318-46f5-8af4-cbc61ae589b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94165c29-45') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94165c29-45, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap94165c29-45, col_values=(('external_ids', {'iface-id': '94165c29-4578-453b-aa55-f9440d4ae07c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:c9:e1', 'vm-uuid': '122c6152-2360-448b-b8e6-6d86bc736500'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:18 user nova-compute[73056]: INFO os_vif [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:c9:e1,bridge_name='br-int',has_traffic_filtering=True,id=94165c29-4578-453b-aa55-f9440d4ae07c,network=Network(ad323a8d-7318-46f5-8af4-cbc61ae589b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94165c29-45')
Aug 14 16:52:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] No VIF found with MAC fa:16:3e:88:c9:e1, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG nova.network.neutron [req-a5904c20-703c-4dc8-86bb-0c781fe735aa req-d239019a-16f8-40a6-a92f-efb5f42407db service nova] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Updated VIF entry in instance network info cache for port 94165c29-4578-453b-aa55-f9440d4ae07c. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG nova.network.neutron [req-a5904c20-703c-4dc8-86bb-0c781fe735aa req-d239019a-16f8-40a6-a92f-efb5f42407db service nova] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Updating instance_info_cache with network_info: [{"id": "94165c29-4578-453b-aa55-f9440d4ae07c", "address": "fa:16:3e:88:c9:e1", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94165c29-45", "ovs_interfaceid": "94165c29-4578-453b-aa55-f9440d4ae07c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:52:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a5904c20-703c-4dc8-86bb-0c781fe735aa req-d239019a-16f8-40a6-a92f-efb5f42407db service nova] Releasing lock "refresh_cache-122c6152-2360-448b-b8e6-6d86bc736500" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:52:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:20 user nova-compute[73056]: DEBUG nova.compute.manager [req-8b17f280-3c8e-4bd7-903b-38865c79f774 req-6f3e0799-cbdd-4611-9738-69455a809a9c service nova] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Received event network-vif-plugged-94165c29-4578-453b-aa55-f9440d4ae07c {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:52:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8b17f280-3c8e-4bd7-903b-38865c79f774 req-6f3e0799-cbdd-4611-9738-69455a809a9c service nova] Acquiring lock "122c6152-2360-448b-b8e6-6d86bc736500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:52:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8b17f280-3c8e-4bd7-903b-38865c79f774 req-6f3e0799-cbdd-4611-9738-69455a809a9c service nova] Lock "122c6152-2360-448b-b8e6-6d86bc736500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:52:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8b17f280-3c8e-4bd7-903b-38865c79f774 req-6f3e0799-cbdd-4611-9738-69455a809a9c service nova] Lock "122c6152-2360-448b-b8e6-6d86bc736500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:52:20 user nova-compute[73056]: DEBUG nova.compute.manager [req-8b17f280-3c8e-4bd7-903b-38865c79f774 req-6f3e0799-cbdd-4611-9738-69455a809a9c service nova] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] No waiting events found dispatching network-vif-plugged-94165c29-4578-453b-aa55-f9440d4ae07c {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:52:20 user nova-compute[73056]: WARNING nova.compute.manager [req-8b17f280-3c8e-4bd7-903b-38865c79f774 req-6f3e0799-cbdd-4611-9738-69455a809a9c service nova] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Received unexpected event network-vif-plugged-94165c29-4578-453b-aa55-f9440d4ae07c for instance with vm_state building and task_state spawning.
Aug 14 16:52:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:21 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031941.9363062, 122c6152-2360-448b-b8e6-6d86bc736500 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:52:21 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] VM Resumed (Lifecycle Event)
Aug 14 16:52:21 user nova-compute[73056]: DEBUG nova.compute.manager [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:52:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:52:21 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Instance spawned successfully.
Aug 14 16:52:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:52:21 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:52:21 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:52:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:52:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:52:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:52:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:52:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:52:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:52:21 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:52:21 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031941.9372318, 122c6152-2360-448b-b8e6-6d86bc736500 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:52:21 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] VM Started (Lifecycle Event)
Aug 14 16:52:22 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:52:22 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:52:22 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:52:22 user nova-compute[73056]: INFO nova.compute.manager [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Took 5.36 seconds to spawn the instance on the hypervisor.
Aug 14 16:52:22 user nova-compute[73056]: DEBUG nova.compute.manager [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:52:22 user nova-compute[73056]: INFO nova.compute.manager [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Took 6.00 seconds to build instance.
Aug 14 16:52:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c1755636-a59d-4229-9632-e3f7061bdeb2 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "122c6152-2360-448b-b8e6-6d86bc736500" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.091s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:52:22 user nova-compute[73056]: DEBUG nova.compute.manager [req-1cd36733-2130-46ca-b774-68f921b8ee35 req-568c3792-0a1a-463a-a6c4-7575e1b16566 service nova] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Received event network-vif-plugged-94165c29-4578-453b-aa55-f9440d4ae07c {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:52:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1cd36733-2130-46ca-b774-68f921b8ee35 req-568c3792-0a1a-463a-a6c4-7575e1b16566 service nova] Acquiring lock "122c6152-2360-448b-b8e6-6d86bc736500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:52:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1cd36733-2130-46ca-b774-68f921b8ee35 req-568c3792-0a1a-463a-a6c4-7575e1b16566 service nova] Lock "122c6152-2360-448b-b8e6-6d86bc736500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:52:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1cd36733-2130-46ca-b774-68f921b8ee35 req-568c3792-0a1a-463a-a6c4-7575e1b16566 service nova] Lock "122c6152-2360-448b-b8e6-6d86bc736500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:52:22 user nova-compute[73056]: DEBUG nova.compute.manager [req-1cd36733-2130-46ca-b774-68f921b8ee35 req-568c3792-0a1a-463a-a6c4-7575e1b16566 service nova] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] No waiting events found dispatching network-vif-plugged-94165c29-4578-453b-aa55-f9440d4ae07c {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:52:22 user nova-compute[73056]: WARNING nova.compute.manager [req-1cd36733-2130-46ca-b774-68f921b8ee35 req-568c3792-0a1a-463a-a6c4-7575e1b16566 service nova] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Received unexpected event network-vif-plugged-94165c29-4578-453b-aa55-f9440d4ae07c for instance with vm_state active and task_state None.
Aug 14 16:52:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:26 user nova-compute[73056]: INFO nova.compute.manager [None req-f29f9300-bba8-41e2-8920-1b18988896de tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Get console output
Aug 14 16:52:26 user nova-compute[73056]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 14 16:52:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:52:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:52:27 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:52:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:52:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:52:27 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:52:27 user nova-compute[73056]: INFO nova.compute.claims [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Claim successful on node user
Aug 14 16:52:28 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:52:28 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:52:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.359s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:52:28 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:52:28 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:52:28 user nova-compute[73056]: DEBUG nova.network.neutron [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:52:28 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:52:28 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:52:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:28 user nova-compute[73056]: DEBUG nova.policy [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e9f89462f2734ec48d78921ab3d654b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b7b0f153a945ac9ce96fe462b17fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:52:28 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:52:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:52:28 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Creating image(s)
Aug 14 16:52:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "/opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:52:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "/opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:52:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "/opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:52:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:52:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.197s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:52:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "c889592ab94cd0b0ce896f27a2af0323771db234" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:52:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:52:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:52:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.177s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:52:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:52:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk 1073741824" returned: 0 in 0.051s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:52:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:52:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:52:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.181s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:52:28 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 16:52:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:52:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:52:29 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Cannot resize image /opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 16:52:29 user nova-compute[73056]: DEBUG nova.objects.instance [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lazy-loading 'migration_context' on Instance uuid 5914b70b-665a-4ce0-ab4e-11db2b8bc057 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:52:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 16:52:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Ensure instance console log exists: /opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:52:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:52:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:52:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:52:29 user nova-compute[73056]: DEBUG nova.network.neutron [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Successfully created port: c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:52:29 user nova-compute[73056]: DEBUG nova.network.neutron [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Successfully updated port: c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:52:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "refresh_cache-5914b70b-665a-4ce0-ab4e-11db2b8bc057" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:52:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquired lock "refresh_cache-5914b70b-665a-4ce0-ab4e-11db2b8bc057" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:52:29 user nova-compute[73056]: DEBUG nova.network.neutron [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:52:29 user nova-compute[73056]: DEBUG nova.compute.manager [req-bcc2365d-948a-407a-9f80-2d3e2f0bf91c req-39ab17cf-2766-4402-b1f5-eed8f0188f96 service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Received event network-changed-c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:52:29 user nova-compute[73056]: DEBUG nova.compute.manager [req-bcc2365d-948a-407a-9f80-2d3e2f0bf91c req-39ab17cf-2766-4402-b1f5-eed8f0188f96 service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Refreshing instance network info cache due to event network-changed-c9eb236b-5c65-4108-9527-dbf9550cf01f. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:52:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-bcc2365d-948a-407a-9f80-2d3e2f0bf91c req-39ab17cf-2766-4402-b1f5-eed8f0188f96 service nova] Acquiring lock "refresh_cache-5914b70b-665a-4ce0-ab4e-11db2b8bc057" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:52:29 user nova-compute[73056]: DEBUG nova.network.neutron [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG nova.network.neutron [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Updating instance_info_cache with network_info: [{"id": "c9eb236b-5c65-4108-9527-dbf9550cf01f", "address": "fa:16:3e:af:d2:e8", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9eb236b-5c", "ovs_interfaceid": "c9eb236b-5c65-4108-9527-dbf9550cf01f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Releasing lock "refresh_cache-5914b70b-665a-4ce0-ab4e-11db2b8bc057" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Instance network_info: |[{"id": "c9eb236b-5c65-4108-9527-dbf9550cf01f", "address": "fa:16:3e:af:d2:e8", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9eb236b-5c", "ovs_interfaceid": "c9eb236b-5c65-4108-9527-dbf9550cf01f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-bcc2365d-948a-407a-9f80-2d3e2f0bf91c req-39ab17cf-2766-4402-b1f5-eed8f0188f96 service nova] Acquired lock "refresh_cache-5914b70b-665a-4ce0-ab4e-11db2b8bc057" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG nova.network.neutron [req-bcc2365d-948a-407a-9f80-2d3e2f0bf91c req-39ab17cf-2766-4402-b1f5-eed8f0188f96 service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Refreshing network info cache for port c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Start _get_guest_xml network_info=[{"id": "c9eb236b-5c65-4108-9527-dbf9550cf01f", "address": "fa:16:3e:af:d2:e8", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9eb236b-5c", "ovs_interfaceid": "c9eb236b-5c65-4108-9527-dbf9550cf01f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:52:30 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:52:30 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:52:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:52:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1952339710',display_name='tempest-ServerRescueNegativeTestJSON-server-1952339710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1952339710',id=37,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAp0LikYCQHNfSYD4UvT4Zxh43XbzRmqoiU2ZnOfp1CYD0BrAg4r5J/RAcQQuADIA2Ho1aSstdK7xXiTXNXXMeOhkn7JZ7x8dywIzuMsJtJLPFvrAuj2FTi45iY+XI0yxg==',key_name='tempest-keypair-1806914521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09b7b0f153a945ac9ce96fe462b17fd5',ramdisk_id='',reservation_id='r-7dv7kuyc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-201205905',owner_user_name='tempest-ServerRescueNegativeTestJSON-201205905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:52:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9f89462f2734ec48d78921ab3d654b2',uuid=5914b70b-665a-4ce0-ab4e-11db2b8bc057,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9eb236b-5c65-4108-9527-dbf9550cf01f", "address": "fa:16:3e:af:d2:e8", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9eb236b-5c", "ovs_interfaceid": "c9eb236b-5c65-4108-9527-dbf9550cf01f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Converting VIF {"id": "c9eb236b-5c65-4108-9527-dbf9550cf01f", "address": "fa:16:3e:af:d2:e8", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9eb236b-5c", "ovs_interfaceid": "c9eb236b-5c65-4108-9527-dbf9550cf01f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:d2:e8,bridge_name='br-int',has_traffic_filtering=True,id=c9eb236b-5c65-4108-9527-dbf9550cf01f,network=Network(9f4305e9-4b75-4f5d-b1b2-f1184c408739),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9eb236b-5c') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG nova.objects.instance [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lazy-loading 'pci_devices' on Instance uuid 5914b70b-665a-4ce0-ab4e-11db2b8bc057 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:52:30 user nova-compute[73056]:   <uuid>5914b70b-665a-4ce0-ab4e-11db2b8bc057</uuid>
Aug 14 16:52:30 user nova-compute[73056]:   <name>instance-00000025</name>
Aug 14 16:52:30 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:52:30 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:52:30 user nova-compute[73056]:   <metadata>
Aug 14 16:52:30 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:52:30 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:52:30 user nova-compute[73056]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1952339710</nova:name>
Aug 14 16:52:30 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:52:30</nova:creationTime>
Aug 14 16:52:30 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:52:30 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:52:30 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:52:30 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:52:30 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:52:30 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:52:30 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:52:30 user nova-compute[73056]:       <nova:owner>
Aug 14 16:52:30 user nova-compute[73056]:         <nova:user uuid="e9f89462f2734ec48d78921ab3d654b2">tempest-ServerRescueNegativeTestJSON-201205905-project-member</nova:user>
Aug 14 16:52:30 user nova-compute[73056]:         <nova:project uuid="09b7b0f153a945ac9ce96fe462b17fd5">tempest-ServerRescueNegativeTestJSON-201205905</nova:project>
Aug 14 16:52:30 user nova-compute[73056]:       </nova:owner>
Aug 14 16:52:30 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:52:30 user nova-compute[73056]:       <nova:ports>
Aug 14 16:52:30 user nova-compute[73056]:         <nova:port uuid="c9eb236b-5c65-4108-9527-dbf9550cf01f">
Aug 14 16:52:30 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 16:52:30 user nova-compute[73056]:         </nova:port>
Aug 14 16:52:30 user nova-compute[73056]:       </nova:ports>
Aug 14 16:52:30 user nova-compute[73056]:     </nova:instance>
Aug 14 16:52:30 user nova-compute[73056]:   </metadata>
Aug 14 16:52:30 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:52:30 user nova-compute[73056]:     <system>
Aug 14 16:52:30 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:52:30 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:52:30 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:52:30 user nova-compute[73056]:       <entry name="serial">5914b70b-665a-4ce0-ab4e-11db2b8bc057</entry>
Aug 14 16:52:30 user nova-compute[73056]:       <entry name="uuid">5914b70b-665a-4ce0-ab4e-11db2b8bc057</entry>
Aug 14 16:52:30 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:52:30 user nova-compute[73056]:     </system>
Aug 14 16:52:30 user nova-compute[73056]:   </sysinfo>
Aug 14 16:52:30 user nova-compute[73056]:   <os>
Aug 14 16:52:30 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:52:30 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:52:30 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:52:30 user nova-compute[73056]:   </os>
Aug 14 16:52:30 user nova-compute[73056]:   <features>
Aug 14 16:52:30 user nova-compute[73056]:     <acpi/>
Aug 14 16:52:30 user nova-compute[73056]:     <apic/>
Aug 14 16:52:30 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:52:30 user nova-compute[73056]:   </features>
Aug 14 16:52:30 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:52:30 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:52:30 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:52:30 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:52:30 user nova-compute[73056]:   </clock>
Aug 14 16:52:30 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:52:30 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:52:30 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:52:30 user nova-compute[73056]:   </cpu>
Aug 14 16:52:30 user nova-compute[73056]:   <devices>
Aug 14 16:52:30 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:52:30 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:52:30 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk"/>
Aug 14 16:52:30 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:52:30 user nova-compute[73056]:     </disk>
Aug 14 16:52:30 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:52:30 user nova-compute[73056]:       <mac address="fa:16:3e:af:d2:e8"/>
Aug 14 16:52:30 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:52:30 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:52:30 user nova-compute[73056]:       <target dev="tapc9eb236b-5c"/>
Aug 14 16:52:30 user nova-compute[73056]:     </interface>
Aug 14 16:52:30 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:52:30 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/console.log" append="off"/>
Aug 14 16:52:30 user nova-compute[73056]:     </serial>
Aug 14 16:52:30 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:52:30 user nova-compute[73056]:     <video>
Aug 14 16:52:30 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:52:30 user nova-compute[73056]:     </video>
Aug 14 16:52:30 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:52:30 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:52:30 user nova-compute[73056]:     </rng>
Aug 14 16:52:30 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:52:30 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:52:30 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:52:30 user nova-compute[73056]:     </memballoon>
Aug 14 16:52:30 user nova-compute[73056]:   </devices>
Aug 14 16:52:30 user nova-compute[73056]: </domain>
Aug 14 16:52:30 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:52:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1952339710',display_name='tempest-ServerRescueNegativeTestJSON-server-1952339710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1952339710',id=37,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAp0LikYCQHNfSYD4UvT4Zxh43XbzRmqoiU2ZnOfp1CYD0BrAg4r5J/RAcQQuADIA2Ho1aSstdK7xXiTXNXXMeOhkn7JZ7x8dywIzuMsJtJLPFvrAuj2FTi45iY+XI0yxg==',key_name='tempest-keypair-1806914521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09b7b0f153a945ac9ce96fe462b17fd5',ramdisk_id='',reservation_id='r-7dv7kuyc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-201205905',owner_user_name='tempest-ServerRescueNegativeTestJSON-201205905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:52:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9f89462f2734ec48d78921ab3d654b2',uuid=5914b70b-665a-4ce0-ab4e-11db2b8bc057,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9eb236b-5c65-4108-9527-dbf9550cf01f", "address": "fa:16:3e:af:d2:e8", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9eb236b-5c", "ovs_interfaceid": "c9eb236b-5c65-4108-9527-dbf9550cf01f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Converting VIF {"id": "c9eb236b-5c65-4108-9527-dbf9550cf01f", "address": "fa:16:3e:af:d2:e8", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9eb236b-5c", "ovs_interfaceid": "c9eb236b-5c65-4108-9527-dbf9550cf01f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:d2:e8,bridge_name='br-int',has_traffic_filtering=True,id=c9eb236b-5c65-4108-9527-dbf9550cf01f,network=Network(9f4305e9-4b75-4f5d-b1b2-f1184c408739),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9eb236b-5c') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG os_vif [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:d2:e8,bridge_name='br-int',has_traffic_filtering=True,id=c9eb236b-5c65-4108-9527-dbf9550cf01f,network=Network(9f4305e9-4b75-4f5d-b1b2-f1184c408739),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9eb236b-5c') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9eb236b-5c, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc9eb236b-5c, col_values=(('external_ids', {'iface-id': 'c9eb236b-5c65-4108-9527-dbf9550cf01f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:d2:e8', 'vm-uuid': '5914b70b-665a-4ce0-ab4e-11db2b8bc057'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:52:30 user nova-compute[73056]: INFO os_vif [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:d2:e8,bridge_name='br-int',has_traffic_filtering=True,id=c9eb236b-5c65-4108-9527-dbf9550cf01f,network=Network(9f4305e9-4b75-4f5d-b1b2-f1184c408739),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9eb236b-5c')
Aug 14 16:52:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] No VIF found with MAC fa:16:3e:af:d2:e8, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG nova.network.neutron [req-bcc2365d-948a-407a-9f80-2d3e2f0bf91c req-39ab17cf-2766-4402-b1f5-eed8f0188f96 service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Updated VIF entry in instance network info cache for port c9eb236b-5c65-4108-9527-dbf9550cf01f. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG nova.network.neutron [req-bcc2365d-948a-407a-9f80-2d3e2f0bf91c req-39ab17cf-2766-4402-b1f5-eed8f0188f96 service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Updating instance_info_cache with network_info: [{"id": "c9eb236b-5c65-4108-9527-dbf9550cf01f", "address": "fa:16:3e:af:d2:e8", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9eb236b-5c", "ovs_interfaceid": "c9eb236b-5c65-4108-9527-dbf9550cf01f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:52:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-bcc2365d-948a-407a-9f80-2d3e2f0bf91c req-39ab17cf-2766-4402-b1f5-eed8f0188f96 service nova] Releasing lock "refresh_cache-5914b70b-665a-4ce0-ab4e-11db2b8bc057" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:52:31 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:31 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:31 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:31 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:32 user nova-compute[73056]: DEBUG nova.compute.manager [req-ef2d8827-1995-4831-956f-969d3a9c6b5d req-c9fb0583-0f97-4f69-9226-67277c7af827 service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Received event network-vif-plugged-c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:52:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ef2d8827-1995-4831-956f-969d3a9c6b5d req-c9fb0583-0f97-4f69-9226-67277c7af827 service nova] Acquiring lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:52:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ef2d8827-1995-4831-956f-969d3a9c6b5d req-c9fb0583-0f97-4f69-9226-67277c7af827 service nova] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:52:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ef2d8827-1995-4831-956f-969d3a9c6b5d req-c9fb0583-0f97-4f69-9226-67277c7af827 service nova] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:52:32 user nova-compute[73056]: DEBUG nova.compute.manager [req-ef2d8827-1995-4831-956f-969d3a9c6b5d req-c9fb0583-0f97-4f69-9226-67277c7af827 service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] No waiting events found dispatching network-vif-plugged-c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:52:32 user nova-compute[73056]: WARNING nova.compute.manager [req-ef2d8827-1995-4831-956f-969d3a9c6b5d req-c9fb0583-0f97-4f69-9226-67277c7af827 service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Received unexpected event network-vif-plugged-c9eb236b-5c65-4108-9527-dbf9550cf01f for instance with vm_state building and task_state spawning.
Aug 14 16:52:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:34 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031954.1054533, 5914b70b-665a-4ce0-ab4e-11db2b8bc057 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:52:34 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] VM Resumed (Lifecycle Event)
Aug 14 16:52:34 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:52:34 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:52:34 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Instance spawned successfully.
Aug 14 16:52:34 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:52:34 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:52:34 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:52:34 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:52:34 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:52:34 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:52:34 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:52:34 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:52:34 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:52:34 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:52:34 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031954.1105285, 5914b70b-665a-4ce0-ab4e-11db2b8bc057 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:52:34 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] VM Started (Lifecycle Event)
Aug 14 16:52:34 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:52:34 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:52:34 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:52:34 user nova-compute[73056]: INFO nova.compute.manager [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Took 5.94 seconds to spawn the instance on the hypervisor.
Aug 14 16:52:34 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:52:34 user nova-compute[73056]: DEBUG nova.compute.manager [req-e599f8b6-ef45-4307-b705-e4441021e31a req-e06ab450-55b6-4a59-bc78-0971758c8f3a service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Received event network-vif-plugged-c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:52:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e599f8b6-ef45-4307-b705-e4441021e31a req-e06ab450-55b6-4a59-bc78-0971758c8f3a service nova] Acquiring lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:52:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e599f8b6-ef45-4307-b705-e4441021e31a req-e06ab450-55b6-4a59-bc78-0971758c8f3a service nova] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:52:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e599f8b6-ef45-4307-b705-e4441021e31a req-e06ab450-55b6-4a59-bc78-0971758c8f3a service nova] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:52:34 user nova-compute[73056]: DEBUG nova.compute.manager [req-e599f8b6-ef45-4307-b705-e4441021e31a req-e06ab450-55b6-4a59-bc78-0971758c8f3a service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] No waiting events found dispatching network-vif-plugged-c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:52:34 user nova-compute[73056]: WARNING nova.compute.manager [req-e599f8b6-ef45-4307-b705-e4441021e31a req-e06ab450-55b6-4a59-bc78-0971758c8f3a service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Received unexpected event network-vif-plugged-c9eb236b-5c65-4108-9527-dbf9550cf01f for instance with vm_state building and task_state spawning.
Aug 14 16:52:34 user nova-compute[73056]: INFO nova.compute.manager [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Took 6.71 seconds to build instance.
Aug 14 16:52:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5cc24dfd-501d-467b-a229-9f5611734398 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.803s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:52:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:52:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:52:43 user nova-compute[73056]: DEBUG nova.compute.manager [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:52:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:52:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:52:43 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:52:43 user nova-compute[73056]: INFO nova.compute.claims [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Claim successful on node user
Aug 14 16:52:43 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Refreshing inventories for resource provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 16:52:43 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Updating ProviderTree inventory for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 16:52:43 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Updating inventory in ProviderTree for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 16:52:43 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Refreshing aggregate associations for resource provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b, aggregates: None {{(pid=73056) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 16:52:43 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Refreshing trait associations for resource provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=73056) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 16:52:43 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:52:43 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:52:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.511s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:52:43 user nova-compute[73056]: DEBUG nova.compute.manager [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:52:43 user nova-compute[73056]: DEBUG nova.compute.manager [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:52:43 user nova-compute[73056]: DEBUG nova.network.neutron [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:52:43 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:52:43 user nova-compute[73056]: DEBUG nova.compute.manager [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:52:44 user nova-compute[73056]: DEBUG nova.policy [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2be1b098ca9f4232bd198b515630f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffb5203b9284500b8add8a6586cad49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:52:44 user nova-compute[73056]: INFO nova.virt.block_device [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Booting with volume f6491f97-549b-46cc-9de0-96a2ad50a297 at /dev/vda
Aug 14 16:52:44 user nova-compute[73056]: DEBUG os_brick.utils [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:52:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:52:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:52:44 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee72798-c109-4851-84d1-a622ce33e85c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:52:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:52:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:52:44 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[6800f126-16e2-4e0b-9a0a-2bee546f59e4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:52:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:52:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:52:44 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab4dc06-6cd4-4a2c-909f-c2148a363d64]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:52:44 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d7b4e0-885e-4f46-953f-af29e03bd681]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:52:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:52:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:52:44 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:52:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:52:44 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:52:44 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:52:44 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[844436fc-6efb-4902-a54c-01cd797cf1d0]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:52:44 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:52:44 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:52:44 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:52:44 user nova-compute[73056]: DEBUG os_brick.utils [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:52:44 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Updating existing volume attachment record: 8f28a5b9-820a-43bc-af49-465127f79cb7 {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 16:52:44 user nova-compute[73056]: DEBUG nova.network.neutron [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Successfully created port: abfca352-6325-4073-9800-4fdb9f5a2e43 {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:52:45 user nova-compute[73056]: DEBUG nova.network.neutron [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Successfully updated port: abfca352-6325-4073-9800-4fdb9f5a2e43 {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:52:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "refresh_cache-4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:52:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquired lock "refresh_cache-4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:52:45 user nova-compute[73056]: DEBUG nova.network.neutron [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:52:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:45 user nova-compute[73056]: DEBUG nova.compute.manager [req-410b49d6-b598-49ce-825c-b81ca1c832d9 req-7db772b4-53ea-4756-b5fc-6bbe7b85c941 service nova] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Received event network-changed-abfca352-6325-4073-9800-4fdb9f5a2e43 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:52:45 user nova-compute[73056]: DEBUG nova.compute.manager [req-410b49d6-b598-49ce-825c-b81ca1c832d9 req-7db772b4-53ea-4756-b5fc-6bbe7b85c941 service nova] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Refreshing instance network info cache due to event network-changed-abfca352-6325-4073-9800-4fdb9f5a2e43. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:52:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-410b49d6-b598-49ce-825c-b81ca1c832d9 req-7db772b4-53ea-4756-b5fc-6bbe7b85c941 service nova] Acquiring lock "refresh_cache-4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:52:45 user nova-compute[73056]: DEBUG nova.network.neutron [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:52:45 user nova-compute[73056]: DEBUG nova.network.neutron [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Updating instance_info_cache with network_info: [{"id": "abfca352-6325-4073-9800-4fdb9f5a2e43", "address": "fa:16:3e:2d:c9:a4", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabfca352-63", "ovs_interfaceid": "abfca352-6325-4073-9800-4fdb9f5a2e43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:52:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Releasing lock "refresh_cache-4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:52:45 user nova-compute[73056]: DEBUG nova.compute.manager [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Instance network_info: |[{"id": "abfca352-6325-4073-9800-4fdb9f5a2e43", "address": "fa:16:3e:2d:c9:a4", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabfca352-63", "ovs_interfaceid": "abfca352-6325-4073-9800-4fdb9f5a2e43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:52:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-410b49d6-b598-49ce-825c-b81ca1c832d9 req-7db772b4-53ea-4756-b5fc-6bbe7b85c941 service nova] Acquired lock "refresh_cache-4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:52:45 user nova-compute[73056]: DEBUG nova.network.neutron [req-410b49d6-b598-49ce-825c-b81ca1c832d9 req-7db772b4-53ea-4756-b5fc-6bbe7b85c941 service nova] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Refreshing network info cache for port abfca352-6325-4073-9800-4fdb9f5a2e43 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:52:46 user nova-compute[73056]: DEBUG nova.network.neutron [req-410b49d6-b598-49ce-825c-b81ca1c832d9 req-7db772b4-53ea-4756-b5fc-6bbe7b85c941 service nova] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Updated VIF entry in instance network info cache for port abfca352-6325-4073-9800-4fdb9f5a2e43. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:52:46 user nova-compute[73056]: DEBUG nova.network.neutron [req-410b49d6-b598-49ce-825c-b81ca1c832d9 req-7db772b4-53ea-4756-b5fc-6bbe7b85c941 service nova] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Updating instance_info_cache with network_info: [{"id": "abfca352-6325-4073-9800-4fdb9f5a2e43", "address": "fa:16:3e:2d:c9:a4", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabfca352-63", "ovs_interfaceid": "abfca352-6325-4073-9800-4fdb9f5a2e43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:52:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-410b49d6-b598-49ce-825c-b81ca1c832d9 req-7db772b4-53ea-4756-b5fc-6bbe7b85c941 service nova] Releasing lock "refresh_cache-4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:52:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG nova.compute.manager [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:52:52 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Creating image(s)
Aug 14 16:52:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Did not create local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Ensure instance console log exists: /opt/stack/data/nova/instances/4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Start _get_guest_xml network_info=[{"id": "abfca352-6325-4073-9800-4fdb9f5a2e43", "address": "fa:16:3e:2d:c9:a4", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabfca352-63", "ovs_interfaceid": "abfca352-6325-4073-9800-4fdb9f5a2e43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbFahCRc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9', 'attached_at': '', 'detached_at': '', 'volume_id': 'f6491f97-549b-46cc-9de0-96a2ad50a297', 'serial': 'f6491f97-549b-46cc-9de0-96a2ad50a297'}, 'attachment_id': '8f28a5b9-820a-43bc-af49-465127f79cb7', 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:52:52 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:52:52 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:52:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbFahCRc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:52:52 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:52:52 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:52:52 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:52:52 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:52:52 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:52:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a769c7-bd43-41e7-9d00-35a2ff637619]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:52:52 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0809dde-680c-485b-b4d1-ba944c27a44d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297] added
Aug 14 16:52:52 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b57e5f-f1f1-4b4a-939e-0ae3ffdedfb4]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c8081e-c87c-46a3-a924-6f4dc92be559]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UbFahCRc {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UbFahCRc" returned: 0 in 0.123s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f4b8ac-dbb3-446c-85c9-290ef865af3c]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UbFahCRc'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d607892-27cc-4a93-a2cc-ad8d5bed8e1d]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f342dfe9-fcce-4da3-920d-f4bdf43e8e64]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:52:52 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:52:52 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:52:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:52:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:52:53 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[8613372c-982a-4d90-bfa2-e56f6126c563]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:52:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297, portal: 172.16.0.220,3260]
Aug 14 16:52:53 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297, portal: 172.16.0.220,3260] successful.
Aug 14 16:52:53 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:52:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:52:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:52:53 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[736fdab8-f3ae-4f1d-bdd4-ff332335a897]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:52:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:52:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:52:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:52:53 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf2fcd6-5cb4-4212-929a-3fe6cc5d8d4e]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:52:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:52:53 user nova-compute[73056]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:52:53 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:52:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:52:53 user nova-compute[73056]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:52:53 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:52:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:52:53 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:52:53 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:52:53 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:52:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:52:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:52:53 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae66f96f-f316-4bcd-aa0e-d57832d30242]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:52:53 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: None {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:52:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:54 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:52:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbFahCRc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:52:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:52:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '23031633939316662', 'path': '/dev/sdc'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:52:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031633939316662', 'path': '/dev/sdc'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:52:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1198926477',display_name='tempest-TestVolumeBootPattern-server-1198926477',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1198926477',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBF9UVFrNwhQEMB/CeZfBoQaAoJOYsqM67ncFaZmWIdIzJd1Na96dOaZXAGstQENK3pBtGzJ44fKFGGhrlwWzWMk9Hm8I+KfAGKsRBWs7QP0LhARS9gNshqYVaA6cOdig==',key_name='tempest-TestVolumeBootPattern-829376797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cffb5203b9284500b8add8a6586cad49',ramdisk_id='',reservation_id='r-q5ngzy0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1676214558',owner_user_name='tempest-TestVolumeBootPattern-1676214558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:52:44Z,user_data=None,user_id='2be1b098ca9f4232bd198b515630f6ad',uuid=4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abfca352-6325-4073-9800-4fdb9f5a2e43", "address": "fa:16:3e:2d:c9:a4", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabfca352-63", "ovs_interfaceid": "abfca352-6325-4073-9800-4fdb9f5a2e43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:52:54 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Converting VIF {"id": "abfca352-6325-4073-9800-4fdb9f5a2e43", "address": "fa:16:3e:2d:c9:a4", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabfca352-63", "ovs_interfaceid": "abfca352-6325-4073-9800-4fdb9f5a2e43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:52:54 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:c9:a4,bridge_name='br-int',has_traffic_filtering=True,id=abfca352-6325-4073-9800-4fdb9f5a2e43,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabfca352-63') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:52:54 user nova-compute[73056]: DEBUG nova.objects.instance [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lazy-loading 'pci_devices' on Instance uuid 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:52:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:52:54 user nova-compute[73056]:   <uuid>4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9</uuid>
Aug 14 16:52:54 user nova-compute[73056]:   <name>instance-00000026</name>
Aug 14 16:52:54 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:52:54 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:52:54 user nova-compute[73056]:   <metadata>
Aug 14 16:52:54 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:52:54 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:52:54 user nova-compute[73056]:       <nova:name>tempest-TestVolumeBootPattern-server-1198926477</nova:name>
Aug 14 16:52:54 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:52:52</nova:creationTime>
Aug 14 16:52:54 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:52:54 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:52:54 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:52:54 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:52:54 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:52:54 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:52:54 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:52:54 user nova-compute[73056]:       <nova:owner>
Aug 14 16:52:54 user nova-compute[73056]:         <nova:user uuid="2be1b098ca9f4232bd198b515630f6ad">tempest-TestVolumeBootPattern-1676214558-project-member</nova:user>
Aug 14 16:52:54 user nova-compute[73056]:         <nova:project uuid="cffb5203b9284500b8add8a6586cad49">tempest-TestVolumeBootPattern-1676214558</nova:project>
Aug 14 16:52:54 user nova-compute[73056]:       </nova:owner>
Aug 14 16:52:54 user nova-compute[73056]:       <nova:ports>
Aug 14 16:52:54 user nova-compute[73056]:         <nova:port uuid="abfca352-6325-4073-9800-4fdb9f5a2e43">
Aug 14 16:52:54 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 16:52:54 user nova-compute[73056]:         </nova:port>
Aug 14 16:52:54 user nova-compute[73056]:       </nova:ports>
Aug 14 16:52:54 user nova-compute[73056]:     </nova:instance>
Aug 14 16:52:54 user nova-compute[73056]:   </metadata>
Aug 14 16:52:54 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:52:54 user nova-compute[73056]:     <system>
Aug 14 16:52:54 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:52:54 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:52:54 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:52:54 user nova-compute[73056]:       <entry name="serial">4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9</entry>
Aug 14 16:52:54 user nova-compute[73056]:       <entry name="uuid">4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9</entry>
Aug 14 16:52:54 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:52:54 user nova-compute[73056]:     </system>
Aug 14 16:52:54 user nova-compute[73056]:   </sysinfo>
Aug 14 16:52:54 user nova-compute[73056]:   <os>
Aug 14 16:52:54 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:52:54 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:52:54 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:52:54 user nova-compute[73056]:   </os>
Aug 14 16:52:54 user nova-compute[73056]:   <features>
Aug 14 16:52:54 user nova-compute[73056]:     <acpi/>
Aug 14 16:52:54 user nova-compute[73056]:     <apic/>
Aug 14 16:52:54 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:52:54 user nova-compute[73056]:   </features>
Aug 14 16:52:54 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:52:54 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:52:54 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:52:54 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:52:54 user nova-compute[73056]:   </clock>
Aug 14 16:52:54 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:52:54 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:52:54 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:52:54 user nova-compute[73056]:   </cpu>
Aug 14 16:52:54 user nova-compute[73056]:   <devices>
Aug 14 16:52:54 user nova-compute[73056]:     <disk type="block" device="disk">
Aug 14 16:52:54 user nova-compute[73056]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:52:54 user nova-compute[73056]:       <source dev="/dev/sdc"/>
Aug 14 16:52:54 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:52:54 user nova-compute[73056]:       <serial>f6491f97-549b-46cc-9de0-96a2ad50a297</serial>
Aug 14 16:52:54 user nova-compute[73056]:     </disk>
Aug 14 16:52:54 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:52:54 user nova-compute[73056]:       <mac address="fa:16:3e:2d:c9:a4"/>
Aug 14 16:52:54 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:52:54 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:52:54 user nova-compute[73056]:       <target dev="tapabfca352-63"/>
Aug 14 16:52:54 user nova-compute[73056]:     </interface>
Aug 14 16:52:54 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:52:54 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9/console.log" append="off"/>
Aug 14 16:52:54 user nova-compute[73056]:     </serial>
Aug 14 16:52:54 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:52:54 user nova-compute[73056]:     <video>
Aug 14 16:52:54 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:52:54 user nova-compute[73056]:     </video>
Aug 14 16:52:54 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:52:54 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:52:54 user nova-compute[73056]:     </rng>
Aug 14 16:52:54 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:52:54 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:52:54 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:52:54 user nova-compute[73056]:     </memballoon>
Aug 14 16:52:54 user nova-compute[73056]:   </devices>
Aug 14 16:52:54 user nova-compute[73056]: </domain>
Aug 14 16:52:54 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:52:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1198926477',display_name='tempest-TestVolumeBootPattern-server-1198926477',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1198926477',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBF9UVFrNwhQEMB/CeZfBoQaAoJOYsqM67ncFaZmWIdIzJd1Na96dOaZXAGstQENK3pBtGzJ44fKFGGhrlwWzWMk9Hm8I+KfAGKsRBWs7QP0LhARS9gNshqYVaA6cOdig==',key_name='tempest-TestVolumeBootPattern-829376797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cffb5203b9284500b8add8a6586cad49',ramdisk_id='',reservation_id='r-q5ngzy0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1676214558',owner_user_name='tempest-TestVolumeBootPattern-1676214558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:52:44Z,user_data=None,user_id='2be1b098ca9f4232bd198b515630f6ad',uuid=4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abfca352-6325-4073-9800-4fdb9f5a2e43", "address": "fa:16:3e:2d:c9:a4", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabfca352-63", "ovs_interfaceid": "abfca352-6325-4073-9800-4fdb9f5a2e43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:52:54 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Converting VIF {"id": "abfca352-6325-4073-9800-4fdb9f5a2e43", "address": "fa:16:3e:2d:c9:a4", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabfca352-63", "ovs_interfaceid": "abfca352-6325-4073-9800-4fdb9f5a2e43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:52:54 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:c9:a4,bridge_name='br-int',has_traffic_filtering=True,id=abfca352-6325-4073-9800-4fdb9f5a2e43,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabfca352-63') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:52:54 user nova-compute[73056]: DEBUG os_vif [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:c9:a4,bridge_name='br-int',has_traffic_filtering=True,id=abfca352-6325-4073-9800-4fdb9f5a2e43,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabfca352-63') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:52:54 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:54 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:52:54 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:52:54 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:54 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapabfca352-63, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:52:54 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapabfca352-63, col_values=(('external_ids', {'iface-id': 'abfca352-6325-4073-9800-4fdb9f5a2e43', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:c9:a4', 'vm-uuid': '4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:52:54 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:54 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:52:54 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:54 user nova-compute[73056]: INFO os_vif [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:c9:a4,bridge_name='br-int',has_traffic_filtering=True,id=abfca352-6325-4073-9800-4fdb9f5a2e43,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabfca352-63')
Aug 14 16:52:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:52:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] No VIF found with MAC fa:16:3e:2d:c9:a4, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:52:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:55 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:52:55 user nova-compute[73056]: DEBUG nova.compute.manager [req-657e9648-a38b-4681-9fa7-af2ab8f047b8 req-fdb4e62a-e5b4-4291-a340-d16292e189dc service nova] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Received event network-vif-plugged-abfca352-6325-4073-9800-4fdb9f5a2e43 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:52:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-657e9648-a38b-4681-9fa7-af2ab8f047b8 req-fdb4e62a-e5b4-4291-a340-d16292e189dc service nova] Acquiring lock "4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:52:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-657e9648-a38b-4681-9fa7-af2ab8f047b8 req-fdb4e62a-e5b4-4291-a340-d16292e189dc service nova] Lock "4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:52:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-657e9648-a38b-4681-9fa7-af2ab8f047b8 req-fdb4e62a-e5b4-4291-a340-d16292e189dc service nova] Lock "4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:52:55 user nova-compute[73056]: DEBUG nova.compute.manager [req-657e9648-a38b-4681-9fa7-af2ab8f047b8 req-fdb4e62a-e5b4-4291-a340-d16292e189dc service nova] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] No waiting events found dispatching network-vif-plugged-abfca352-6325-4073-9800-4fdb9f5a2e43 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:52:55 user nova-compute[73056]: WARNING nova.compute.manager [req-657e9648-a38b-4681-9fa7-af2ab8f047b8 req-fdb4e62a-e5b4-4291-a340-d16292e189dc service nova] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Received unexpected event network-vif-plugged-abfca352-6325-4073-9800-4fdb9f5a2e43 for instance with vm_state building and task_state spawning.
Aug 14 16:52:55 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Triggering sync for uuid 9f3a7f8a-e3b9-4918-9663-968677fe5c90 {{(pid=73056) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 16:52:55 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Triggering sync for uuid b580e3d0-88b5-42a3-a953-84b94c088f41 {{(pid=73056) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 16:52:55 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Triggering sync for uuid 92c34cf0-fd39-49fc-9244-4da8ccae6eec {{(pid=73056) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 16:52:55 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Triggering sync for uuid d79c2f2c-0870-4d8e-b468-36e63496b769 {{(pid=73056) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 16:52:55 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Triggering sync for uuid 61357ac0-230f-4711-8954-0bb04bfcb2f6 {{(pid=73056) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 16:52:55 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Triggering sync for uuid c35f86ec-62d5-4c4d-a259-902e95aeb9d0 {{(pid=73056) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 16:52:55 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Triggering sync for uuid ee670695-1123-4d95-a7ad-ac79f9a4c16e {{(pid=73056) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 16:52:55 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Triggering sync for uuid 122c6152-2360-448b-b8e6-6d86bc736500 {{(pid=73056) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 16:52:55 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Triggering sync for uuid 5914b70b-665a-4ce0-ab4e-11db2b8bc057 {{(pid=73056) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 16:52:55 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Triggering sync for uuid 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9 {{(pid=73056) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 16:52:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "9f3a7f8a-e3b9-4918-9663-968677fe5c90" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:52:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "9f3a7f8a-e3b9-4918-9663-968677fe5c90" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:52:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "b580e3d0-88b5-42a3-a953-84b94c088f41" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:52:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "b580e3d0-88b5-42a3-a953-84b94c088f41" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:52:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:52:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:52:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "d79c2f2c-0870-4d8e-b468-36e63496b769" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:52:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "d79c2f2c-0870-4d8e-b468-36e63496b769" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:52:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "61357ac0-230f-4711-8954-0bb04bfcb2f6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:52:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "61357ac0-230f-4711-8954-0bb04bfcb2f6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:52:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "c35f86ec-62d5-4c4d-a259-902e95aeb9d0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:52:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "c35f86ec-62d5-4c4d-a259-902e95aeb9d0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:52:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "ee670695-1123-4d95-a7ad-ac79f9a4c16e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:52:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "ee670695-1123-4d95-a7ad-ac79f9a4c16e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:52:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "122c6152-2360-448b-b8e6-6d86bc736500" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:52:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "122c6152-2360-448b-b8e6-6d86bc736500" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:52:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:52:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:52:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:52:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "b580e3d0-88b5-42a3-a953-84b94c088f41" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:52:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:52:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "d79c2f2c-0870-4d8e-b468-36e63496b769" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:52:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "9f3a7f8a-e3b9-4918-9663-968677fe5c90" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:52:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "ee670695-1123-4d95-a7ad-ac79f9a4c16e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.098s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:52:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "c35f86ec-62d5-4c4d-a259-902e95aeb9d0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:52:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "61357ac0-230f-4711-8954-0bb04bfcb2f6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:52:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:52:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "122c6152-2360-448b-b8e6-6d86bc736500" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.114s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:52:56 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:56 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:56 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:56 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:57 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031977.6267927, 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:52:57 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] VM Resumed (Lifecycle Event)
Aug 14 16:52:57 user nova-compute[73056]: DEBUG nova.compute.manager [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:52:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:52:57 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Instance spawned successfully.
Aug 14 16:52:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:52:57 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:52:57 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:52:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:52:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:52:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:52:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:52:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:52:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:52:57 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:52:57 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692031977.6302924, 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:52:57 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] VM Started (Lifecycle Event)
Aug 14 16:52:57 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:52:57 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:52:57 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:52:57 user nova-compute[73056]: DEBUG nova.compute.manager [req-0af8a168-1049-4295-9c4d-3c1a4960c991 req-0674921f-713b-4162-8222-cd74102b524a service nova] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Received event network-vif-plugged-abfca352-6325-4073-9800-4fdb9f5a2e43 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:52:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0af8a168-1049-4295-9c4d-3c1a4960c991 req-0674921f-713b-4162-8222-cd74102b524a service nova] Acquiring lock "4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:52:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0af8a168-1049-4295-9c4d-3c1a4960c991 req-0674921f-713b-4162-8222-cd74102b524a service nova] Lock "4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:52:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0af8a168-1049-4295-9c4d-3c1a4960c991 req-0674921f-713b-4162-8222-cd74102b524a service nova] Lock "4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:52:57 user nova-compute[73056]: DEBUG nova.compute.manager [req-0af8a168-1049-4295-9c4d-3c1a4960c991 req-0674921f-713b-4162-8222-cd74102b524a service nova] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] No waiting events found dispatching network-vif-plugged-abfca352-6325-4073-9800-4fdb9f5a2e43 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:52:57 user nova-compute[73056]: WARNING nova.compute.manager [req-0af8a168-1049-4295-9c4d-3c1a4960c991 req-0674921f-713b-4162-8222-cd74102b524a service nova] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Received unexpected event network-vif-plugged-abfca352-6325-4073-9800-4fdb9f5a2e43 for instance with vm_state building and task_state spawning.
Aug 14 16:52:57 user nova-compute[73056]: INFO nova.compute.manager [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Took 5.12 seconds to spawn the instance on the hypervisor.
Aug 14 16:52:57 user nova-compute[73056]: DEBUG nova.compute.manager [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:52:57 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:52:57 user nova-compute[73056]: INFO nova.compute.manager [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Took 14.49 seconds to build instance.
Aug 14 16:52:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-57e6cf79-aa3b-4567-b8b1-a7ca45a01ddd tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.591s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:52:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.910s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:52:57 user nova-compute[73056]: INFO nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:52:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:52:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:52:58 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:52:58 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 16:52:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:00 user nova-compute[73056]: DEBUG nova.compute.manager [req-b5064c5d-68e0-4695-a1b9-dd622e9f265a req-add0172a-dc8a-4b0b-8994-9288fdd23677 service nova] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Received event network-changed-b83d80a5-3a19-412c-8d6b-89cb7f93c682 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:53:00 user nova-compute[73056]: DEBUG nova.compute.manager [req-b5064c5d-68e0-4695-a1b9-dd622e9f265a req-add0172a-dc8a-4b0b-8994-9288fdd23677 service nova] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Refreshing instance network info cache due to event network-changed-b83d80a5-3a19-412c-8d6b-89cb7f93c682. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:53:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-b5064c5d-68e0-4695-a1b9-dd622e9f265a req-add0172a-dc8a-4b0b-8994-9288fdd23677 service nova] Acquiring lock "refresh_cache-c35f86ec-62d5-4c4d-a259-902e95aeb9d0" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:53:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-b5064c5d-68e0-4695-a1b9-dd622e9f265a req-add0172a-dc8a-4b0b-8994-9288fdd23677 service nova] Acquired lock "refresh_cache-c35f86ec-62d5-4c4d-a259-902e95aeb9d0" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:53:00 user nova-compute[73056]: DEBUG nova.network.neutron [req-b5064c5d-68e0-4695-a1b9-dd622e9f265a req-add0172a-dc8a-4b0b-8994-9288fdd23677 service nova] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Refreshing network info cache for port b83d80a5-3a19-412c-8d6b-89cb7f93c682 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG nova.network.neutron [req-b5064c5d-68e0-4695-a1b9-dd622e9f265a req-add0172a-dc8a-4b0b-8994-9288fdd23677 service nova] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Updated VIF entry in instance network info cache for port b83d80a5-3a19-412c-8d6b-89cb7f93c682. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG nova.network.neutron [req-b5064c5d-68e0-4695-a1b9-dd622e9f265a req-add0172a-dc8a-4b0b-8994-9288fdd23677 service nova] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Updating instance_info_cache with network_info: [{"id": "b83d80a5-3a19-412c-8d6b-89cb7f93c682", "address": "fa:16:3e:d6:de:25", "network": {"id": "c2b49cd1-a248-4bd2-924f-bd8b560aed47", "bridge": "br-int", "label": "tempest-TestStampPattern-1795667966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d796c14bd3489883e161ea1b311ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb83d80a5-3a", "ovs_interfaceid": "b83d80a5-3a19-412c-8d6b-89cb7f93c682", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-b5064c5d-68e0-4695-a1b9-dd622e9f265a req-add0172a-dc8a-4b0b-8994-9288fdd23677 service nova] Releasing lock "refresh_cache-c35f86ec-62d5-4c4d-a259-902e95aeb9d0" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Acquiring lock "c35f86ec-62d5-4c4d-a259-902e95aeb9d0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "c35f86ec-62d5-4c4d-a259-902e95aeb9d0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG nova.objects.instance [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lazy-loading 'flavor' on Instance uuid c35f86ec-62d5-4c4d-a259-902e95aeb9d0 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "c35f86ec-62d5-4c4d-a259-902e95aeb9d0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.141s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "bcbe7449-6199-4e86-a8b6-c075e142aa34" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "bcbe7449-6199-4e86-a8b6-c075e142aa34" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:53:01 user nova-compute[73056]: INFO nova.compute.manager [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Unshelving
Aug 14 16:53:01 user nova-compute[73056]: INFO nova.virt.block_device [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Booting with volume c6708c0a-8faa-4315-a2eb-64c3898d5033 at /dev/vdc
Aug 14 16:53:01 user nova-compute[73056]: DEBUG os_brick.utils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Acquiring lock "c35f86ec-62d5-4c4d-a259-902e95aeb9d0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "c35f86ec-62d5-4c4d-a259-902e95aeb9d0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:53:01 user nova-compute[73056]: INFO nova.compute.manager [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Attaching volume 4a388400-9fec-4b74-883c-c0ccf7a32048 to /dev/vdb
Aug 14 16:53:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7076fd8-68d4-4baa-8cf1-b691b9d3a622]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b79d926-34d0-4e90-bbde-b9fa149f20be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[34aa8161-7ff1-4d28-a3cb-c3177c5e64bc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a6875d-685c-40a8-ac5a-b05ff8bde34a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG os_brick.utils [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[edea7fd6-c67a-4d9e-87d5-5a5a25493659]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:53:01 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:53:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3588ae-1b7a-47a3-8d10-740eb48722b4]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG os_brick.utils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Updating existing volume attachment record: da26c4a7-ca34-403c-81f4-d3e081697a0f {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[99286602-1a86-4208-bedf-1b90e9952d3a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49f1a5a-1b96-4f2d-8c43-dc53c6c1f48a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70b8e34-32f2-48d1-a4c5-4e8f6130ce53]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:53:01 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:53:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb05d9c-a2f3-4f5b-afd7-bca89baaa421]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG os_brick.utils [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:53:01 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Updating existing volume attachment record: 09ab9672-64be-4d11-80ce-dd517022d890 {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 16:53:02 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:53:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:53:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:53:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:53:02 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 16:53:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/122c6152-2360-448b-b8e6-6d86bc736500/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/122c6152-2360-448b-b8e6-6d86bc736500/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/122c6152-2360-448b-b8e6-6d86bc736500/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/122c6152-2360-448b-b8e6-6d86bc736500/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:53:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:03 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35f86ec-62d5-4c4d-a259-902e95aeb9d0/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35f86ec-62d5-4c4d-a259-902e95aeb9d0/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35f86ec-62d5-4c4d-a259-902e95aeb9d0/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35f86ec-62d5-4c4d-a259-902e95aeb9d0/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:53:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json" returned: 0 in 0.242s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json" returned: 0 in 0.232s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee670695-1123-4d95-a7ad-ac79f9a4c16e/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee670695-1123-4d95-a7ad-ac79f9a4c16e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee670695-1123-4d95-a7ad-ac79f9a4c16e/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee670695-1123-4d95-a7ad-ac79f9a4c16e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:07 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:53:07 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:53:07 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=7315MB free_disk=25.178482055664062GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 16:53:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:53:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:53:07 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 9f3a7f8a-e3b9-4918-9663-968677fe5c90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:53:07 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance b580e3d0-88b5-42a3-a953-84b94c088f41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:53:07 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 92c34cf0-fd39-49fc-9244-4da8ccae6eec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:53:07 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 61357ac0-230f-4711-8954-0bb04bfcb2f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:53:07 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance d79c2f2c-0870-4d8e-b468-36e63496b769 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:53:07 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance c35f86ec-62d5-4c4d-a259-902e95aeb9d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:53:07 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance ee670695-1123-4d95-a7ad-ac79f9a4c16e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:53:07 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 122c6152-2360-448b-b8e6-6d86bc736500 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:53:07 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 5914b70b-665a-4ce0-ab4e-11db2b8bc057 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:53:07 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:53:07 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance bcbe7449-6199-4e86-a8b6-c075e142aa34 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 14 16:53:07 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 16:53:07 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 16:53:07 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:53:07 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:53:07 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 16:53:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.476s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:53:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:08 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:53:08 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:53:08 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 16:53:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-b580e3d0-88b5-42a3-a953-84b94c088f41" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:53:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-b580e3d0-88b5-42a3-a953-84b94c088f41" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:53:08 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 16:53:08 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Updating instance_info_cache with network_info: [{"id": "b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0", "address": "fa:16:3e:f9:ca:00", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb006576a-8b", "ovs_interfaceid": "b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:53:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-b580e3d0-88b5-42a3-a953-84b94c088f41" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:53:08 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 16:53:08 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:53:08 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:53:08 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:53:08 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:53:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:53:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:53:13 user nova-compute[73056]: DEBUG nova.objects.instance [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lazy-loading 'pci_requests' on Instance uuid bcbe7449-6199-4e86-a8b6-c075e142aa34 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:53:13 user nova-compute[73056]: DEBUG nova.objects.instance [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lazy-loading 'numa_topology' on Instance uuid bcbe7449-6199-4e86-a8b6-c075e142aa34 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:53:13 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:53:13 user nova-compute[73056]: INFO nova.compute.claims [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Claim successful on node user
Aug 14 16:53:13 user nova-compute[73056]: DEBUG nova.compute.manager [req-ed2bce90-4b6a-4d13-80c1-63556eba4ec8 req-a8212637-9672-470c-a93f-a8e8967c8ee2 service nova] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Received event network-changed-5fd92a95-cd11-4828-9731-91e305ac7b26 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:53:13 user nova-compute[73056]: DEBUG nova.compute.manager [req-ed2bce90-4b6a-4d13-80c1-63556eba4ec8 req-a8212637-9672-470c-a93f-a8e8967c8ee2 service nova] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Refreshing instance network info cache due to event network-changed-5fd92a95-cd11-4828-9731-91e305ac7b26. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:53:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ed2bce90-4b6a-4d13-80c1-63556eba4ec8 req-a8212637-9672-470c-a93f-a8e8967c8ee2 service nova] Acquiring lock "refresh_cache-ee670695-1123-4d95-a7ad-ac79f9a4c16e" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:53:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ed2bce90-4b6a-4d13-80c1-63556eba4ec8 req-a8212637-9672-470c-a93f-a8e8967c8ee2 service nova] Acquired lock "refresh_cache-ee670695-1123-4d95-a7ad-ac79f9a4c16e" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:53:13 user nova-compute[73056]: DEBUG nova.network.neutron [req-ed2bce90-4b6a-4d13-80c1-63556eba4ec8 req-a8212637-9672-470c-a93f-a8e8967c8ee2 service nova] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Refreshing network info cache for port 5fd92a95-cd11-4828-9731-91e305ac7b26 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:53:13 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:53:13 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:53:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.490s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:53:13 user nova-compute[73056]: DEBUG nova.network.neutron [req-ed2bce90-4b6a-4d13-80c1-63556eba4ec8 req-a8212637-9672-470c-a93f-a8e8967c8ee2 service nova] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Updated VIF entry in instance network info cache for port 5fd92a95-cd11-4828-9731-91e305ac7b26. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:53:13 user nova-compute[73056]: DEBUG nova.network.neutron [req-ed2bce90-4b6a-4d13-80c1-63556eba4ec8 req-a8212637-9672-470c-a93f-a8e8967c8ee2 service nova] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Updating instance_info_cache with network_info: [{"id": "5fd92a95-cd11-4828-9731-91e305ac7b26", "address": "fa:16:3e:b4:d2:be", "network": {"id": "89b465ce-32d9-4246-ab29-eaca3017bf33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-295083994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bd5d01bac1242ec9897e6931102e1b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd92a95-cd", "ovs_interfaceid": "5fd92a95-cd11-4828-9731-91e305ac7b26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:53:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ed2bce90-4b6a-4d13-80c1-63556eba4ec8 req-a8212637-9672-470c-a93f-a8e8967c8ee2 service nova] Releasing lock "refresh_cache-ee670695-1123-4d95-a7ad-ac79f9a4c16e" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:53:13 user nova-compute[73056]: INFO nova.network.neutron [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Updating port cb018af9-f526-4333-9a2f-0cc2d91d22b2 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 14 16:53:14 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:14 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "refresh_cache-bcbe7449-6199-4e86-a8b6-c075e142aa34" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:53:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquired lock "refresh_cache-bcbe7449-6199-4e86-a8b6-c075e142aa34" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:53:14 user nova-compute[73056]: DEBUG nova.network.neutron [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:53:14 user nova-compute[73056]: DEBUG nova.compute.manager [req-fbd8c5f5-044d-439a-b98d-5aa7517454aa req-dfd8ead6-cbc3-4c63-8da1-6cc0ec340d16 service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Received event network-changed-cb018af9-f526-4333-9a2f-0cc2d91d22b2 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:53:14 user nova-compute[73056]: DEBUG nova.compute.manager [req-fbd8c5f5-044d-439a-b98d-5aa7517454aa req-dfd8ead6-cbc3-4c63-8da1-6cc0ec340d16 service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Refreshing instance network info cache due to event network-changed-cb018af9-f526-4333-9a2f-0cc2d91d22b2. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:53:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-fbd8c5f5-044d-439a-b98d-5aa7517454aa req-dfd8ead6-cbc3-4c63-8da1-6cc0ec340d16 service nova] Acquiring lock "refresh_cache-bcbe7449-6199-4e86-a8b6-c075e142aa34" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:53:15 user nova-compute[73056]: DEBUG nova.network.neutron [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Updating instance_info_cache with network_info: [{"id": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "address": "fa:16:3e:04:a3:9a", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb018af9-f5", "ovs_interfaceid": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:53:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Releasing lock "refresh_cache-bcbe7449-6199-4e86-a8b6-c075e142aa34" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:53:15 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:53:15 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Creating image(s)
Aug 14 16:53:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "/opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:53:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "/opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:53:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "/opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:53:15 user nova-compute[73056]: DEBUG nova.objects.instance [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lazy-loading 'trusted_certs' on Instance uuid bcbe7449-6199-4e86-a8b6-c075e142aa34 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:53:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-fbd8c5f5-044d-439a-b98d-5aa7517454aa req-dfd8ead6-cbc3-4c63-8da1-6cc0ec340d16 service nova] Acquired lock "refresh_cache-bcbe7449-6199-4e86-a8b6-c075e142aa34" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:53:15 user nova-compute[73056]: DEBUG nova.network.neutron [req-fbd8c5f5-044d-439a-b98d-5aa7517454aa req-dfd8ead6-cbc3-4c63-8da1-6cc0ec340d16 service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Refreshing network info cache for port cb018af9-f526-4333-9a2f-0cc2d91d22b2 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:53:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "0aa261a59f542845a73be8758304cdf32672f20a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:53:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "0aa261a59f542845a73be8758304cdf32672f20a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:53:16 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0aa261a59f542845a73be8758304cdf32672f20a.part --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:16 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0aa261a59f542845a73be8758304cdf32672f20a.part --force-share --output=json" returned: 0 in 0.177s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:16 user nova-compute[73056]: DEBUG nova.virt.images [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] 36d46849-dbe0-45d9-b1c4-81dbc21ac957 was qcow2, converting to raw {{(pid=73056) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 16:53:16 user nova-compute[73056]: DEBUG nova.privsep.utils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73056) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 16:53:16 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0aa261a59f542845a73be8758304cdf32672f20a.part /opt/stack/data/nova/instances/_base/0aa261a59f542845a73be8758304cdf32672f20a.converted {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:17 user nova-compute[73056]: DEBUG nova.network.neutron [req-fbd8c5f5-044d-439a-b98d-5aa7517454aa req-dfd8ead6-cbc3-4c63-8da1-6cc0ec340d16 service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Updated VIF entry in instance network info cache for port cb018af9-f526-4333-9a2f-0cc2d91d22b2. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:53:17 user nova-compute[73056]: DEBUG nova.network.neutron [req-fbd8c5f5-044d-439a-b98d-5aa7517454aa req-dfd8ead6-cbc3-4c63-8da1-6cc0ec340d16 service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Updating instance_info_cache with network_info: [{"id": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "address": "fa:16:3e:04:a3:9a", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb018af9-f5", "ovs_interfaceid": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:53:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-fbd8c5f5-044d-439a-b98d-5aa7517454aa req-dfd8ead6-cbc3-4c63-8da1-6cc0ec340d16 service nova] Releasing lock "refresh_cache-bcbe7449-6199-4e86-a8b6-c075e142aa34" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:53:17 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0aa261a59f542845a73be8758304cdf32672f20a.part /opt/stack/data/nova/instances/_base/0aa261a59f542845a73be8758304cdf32672f20a.converted" returned: 0 in 0.782s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:17 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0aa261a59f542845a73be8758304cdf32672f20a.converted --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:17 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0aa261a59f542845a73be8758304cdf32672f20a.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "0aa261a59f542845a73be8758304cdf32672f20a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.381s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:53:17 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0aa261a59f542845a73be8758304cdf32672f20a --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:17 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0aa261a59f542845a73be8758304cdf32672f20a --force-share --output=json" returned: 0 in 0.189s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "0aa261a59f542845a73be8758304cdf32672f20a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:53:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "0aa261a59f542845a73be8758304cdf32672f20a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:53:17 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0aa261a59f542845a73be8758304cdf32672f20a --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2f4b8a11-2fdf-4882-b767-760d602ac675 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Acquiring lock "ee670695-1123-4d95-a7ad-ac79f9a4c16e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:53:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2f4b8a11-2fdf-4882-b767-760d602ac675 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Lock "ee670695-1123-4d95-a7ad-ac79f9a4c16e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:53:18 user nova-compute[73056]: DEBUG nova.objects.instance [None req-2f4b8a11-2fdf-4882-b767-760d602ac675 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Lazy-loading 'flavor' on Instance uuid ee670695-1123-4d95-a7ad-ac79f9a4c16e {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:53:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0aa261a59f542845a73be8758304cdf32672f20a --force-share --output=json" returned: 0 in 0.186s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0aa261a59f542845a73be8758304cdf32672f20a,backing_fmt=raw /opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0aa261a59f542845a73be8758304cdf32672f20a,backing_fmt=raw /opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34/disk 1073741824" returned: 0 in 0.055s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "0aa261a59f542845a73be8758304cdf32672f20a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:53:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0aa261a59f542845a73be8758304cdf32672f20a --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2f4b8a11-2fdf-4882-b767-760d602ac675 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Lock "ee670695-1123-4d95-a7ad-ac79f9a4c16e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.142s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:53:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0aa261a59f542845a73be8758304cdf32672f20a --force-share --output=json" returned: 0 in 0.182s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:18 user nova-compute[73056]: DEBUG nova.objects.instance [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lazy-loading 'migration_context' on Instance uuid bcbe7449-6199-4e86-a8b6-c075e142aa34 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:53:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2f4b8a11-2fdf-4882-b767-760d602ac675 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Acquiring lock "ee670695-1123-4d95-a7ad-ac79f9a4c16e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:53:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2f4b8a11-2fdf-4882-b767-760d602ac675 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Lock "ee670695-1123-4d95-a7ad-ac79f9a4c16e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:53:18 user nova-compute[73056]: INFO nova.compute.manager [None req-2f4b8a11-2fdf-4882-b767-760d602ac675 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Attaching volume 4939f6c8-4a73-4d83-aac8-af186e2986e8 to /dev/vdb
Aug 14 16:53:18 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Rebasing disk image.
Aug 14 16:53:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:18 user nova-compute[73056]: DEBUG os_brick.utils [None req-2f4b8a11-2fdf-4882-b767-760d602ac675 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:53:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:18 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c7557f-b622-469a-863c-a6a17ddae663]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:18 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fb6e31-5bba-4faa-b703-dfd85eef6338]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:18 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[182f499a-de58-4f36-9d4c-0b941994b4dd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:18 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24253ad-767c-4ce5-9f46-270c68bb3cd6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-2f4b8a11-2fdf-4882-b767-760d602ac675 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-2f4b8a11-2fdf-4882-b767-760d602ac675 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:53:18 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2f4b8a11-2fdf-4882-b767-760d602ac675 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:53:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.218s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 -F raw /opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34/disk {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:53:18 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:53:18 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0de1c5-4d00-4ed6-a6f8-c17702cfd573]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:18 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-2f4b8a11-2fdf-4882-b767-760d602ac675 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:53:18 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-2f4b8a11-2fdf-4882-b767-760d602ac675 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:53:18 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-2f4b8a11-2fdf-4882-b767-760d602ac675 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:53:18 user nova-compute[73056]: DEBUG os_brick.utils [None req-2f4b8a11-2fdf-4882-b767-760d602ac675 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:53:18 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-2f4b8a11-2fdf-4882-b767-760d602ac675 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Updating existing volume attachment record: 666ecfd2-8593-4946-b396-581226e106d1 {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 16:53:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:19 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:53:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sAeOMapW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:53:19 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:53:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:53:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:53:19 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:53:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:53:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:53:19 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:53:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048 -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:19 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[56150fc5-d461-486d-99ec-86b9b97097c3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:53:19 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:53:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048 -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:19 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3344ad1-7a62-4e34-a577-ea308d186fb0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048] added
Aug 14 16:53:19 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:53:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:19 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b75cb0c-b81c-4cdb-8b77-c402d726f635]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:53:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.081s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:19 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29c4624-0dc9-4f9f-9746-6dd3d4a67501]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:53:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sAeOMapW {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sAeOMapW" returned: 0 in 0.138s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:19 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[094ae6c3-da85-4c4b-b5e4-dbb0edc303a2]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sAeOMapW'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:53:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:19 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[685144e4-8a5c-40dd-9260-aa66ed6f0842]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:53:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:19 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48bcbb1-e845-45d0-9fb1-59d96299bdc7]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:53:19 user nova-compute[73056]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:53:19 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:53:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:53:19 user nova-compute[73056]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:53:19 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:53:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048 -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048 -p 172.16.0.220:3260 --login" returned: 0 in 0.198s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:20 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d1dc3b-3770-4eb6-b783-450b4a73d71a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:20 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048, portal: 172.16.0.220,3260]
Aug 14 16:53:20 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048, portal: 172.16.0.220,3260] successful.
Aug 14 16:53:20 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:53:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.067s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:20 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bcb5f6-a11b-44d3-826d-81381293d41f]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:20 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:53:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:20 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19868eb-7303-415f-85a4-3c38d1f3158a]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:20 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:53:20 user nova-compute[73056]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:53:20 user nova-compute[73056]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048 (non-flash)
Aug 14 16:53:20 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:53:20 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:53:20 user nova-compute[73056]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:53:20 user nova-compute[73056]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048 (non-flash)
Aug 14 16:53:20 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:53:20 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.706s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:53:20 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:53:20 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:53:20 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:53:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:20 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7935d4-d499-40ec-abf3-398eef88de4d]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:20 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:53:20 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sAeOMapW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 -F raw /opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34/disk" returned: 0 in 2.837s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Ensure instance console log exists: /opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Start _get_guest_xml network_info=[{"id": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "address": "fa:16:3e:04:a3:9a", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb018af9-f5", "ovs_interfaceid": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='3f2cf82280175c38118a5001e42ada73',container_format='bare',created_at=2023-08-14T16:51:09Z,direct_url=<?>,disk_format='qcow2',id=36d46849-dbe0-45d9-b1c4-81dbc21ac957,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1786420487-shelved',owner='c67a1c8fcd97416e90f6b5a50a886a75',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-14T16:51:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmuXJdcF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'bcbe7449-6199-4e86-a8b6-c075e142aa34', 'attached_at': '', 'detached_at': '', 'volume_id': 'c6708c0a-8faa-4315-a2eb-64c3898d5033', 'serial': 'c6708c0a-8faa-4315-a2eb-64c3898d5033'}, 'attachment_id': 'da26c4a7-ca34-403c-81f4-d3e081697a0f', 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.939s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] <== connect_volume: return (1941ms) {'type': 'block', 'scsi_wwn': '23966636336303838', 'path': '/dev/sdd'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966636336303838', 'path': '/dev/sdd'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG nova.objects.instance [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lazy-loading 'flavor' on Instance uuid c35f86ec-62d5-4c4d-a259-902e95aeb9d0 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:53:21 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:53:21 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:53:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='3f2cf82280175c38118a5001e42ada73',container_format='bare',created_at=2023-08-14T16:51:09Z,direct_url=<?>,disk_format='qcow2',id=36d46849-dbe0-45d9-b1c4-81dbc21ac957,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1786420487-shelved',owner='c67a1c8fcd97416e90f6b5a50a886a75',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-14T16:51:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG nova.objects.instance [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lazy-loading 'vcpu_model' on Instance uuid bcbe7449-6199-4e86-a8b6-c075e142aa34 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 16:53:21 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:53:21 user nova-compute[73056]:   <source dev="/dev/sdd"/>
Aug 14 16:53:21 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:53:21 user nova-compute[73056]:   <serial>4a388400-9fec-4b74-883c-c0ccf7a32048</serial>
Aug 14 16:53:21 user nova-compute[73056]: </disk>
Aug 14 16:53:21 user nova-compute[73056]:  {{(pid=73056) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmuXJdcF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:53:21 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:53:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:53:21 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:53:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:53:21 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:53:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[3154d178-8bf6-4224-84cc-9b411720ba68]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:53:21 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d39499-6c43-4de6-b82c-16867f46312a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033] added
Aug 14 16:53:21 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f461aa-a848-4a2e-8e3d-b72aaf77c9a4]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10e0393-8679-4b87-b490-e9ee7f0ed3e9]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RmuXJdcF {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RmuXJdcF" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5712ccc9-f602-4dc3-984d-9744948045fe]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RmuXJdcF'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ec73e4-83dc-43b5-957f-c7578a8ce3d5]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fa37ef-239f-4108-9cad-dfb12eb4e70b]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:53:21 user nova-compute[73056]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:53:21 user nova-compute[73056]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048 (non-flash)
Aug 14 16:53:21 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:53:21 user nova-compute[73056]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:53:21 user nova-compute[73056]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048 (non-flash)
Aug 14 16:53:21 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 -p 172.16.0.220:3260 --login" returned: 0 in 0.156s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[59817c9a-134e-4efd-a814-5fe303f9f2d3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033, portal: 172.16.0.220,3260]
Aug 14 16:53:21 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033, portal: 172.16.0.220,3260] successful.
Aug 14 16:53:21 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b03f231-b99d-4a63-aaa0-79c4e31820d4]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[364e2bb9-070f-4186-8707-2088a2680c65]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:53:21 user nova-compute[73056]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:53:21 user nova-compute[73056]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048 (non-flash)
Aug 14 16:53:21 user nova-compute[73056]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 (non-flash)
Aug 14 16:53:21 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:53:21 user nova-compute[73056]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:53:21 user nova-compute[73056]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048 (non-flash)
Aug 14 16:53:21 user nova-compute[73056]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 (non-flash)
Aug 14 16:53:21 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.379s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] HCTL ('36', '-', '-', 0) found on session 41 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] No VIF found with MAC fa:16:3e:d6:de:25, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7bcfeb-a9c2-40e1-8b0c-09cc25da5205]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:53:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmuXJdcF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:53:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-8ca22c11-5686-401f-9e38-b272a8c93656 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "c35f86ec-62d5-4c4d-a259-902e95aeb9d0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.397s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:53:22 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.414s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:53:22 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] <== connect_volume: return (1415ms) {'type': 'block', 'scsi_wwn': '23034646239333236', 'path': '/dev/sde'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:53:22 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034646239333236', 'path': '/dev/sde'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:53:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T16:49:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1786420487',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1786420487',id=32,image_ref='36d46849-dbe0-45d9-b1c4-81dbc21ac957',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1929561178',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:49:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c67a1c8fcd97416e90f6b5a50a886a75',ramdisk_id='',reservation_id='r-c4car4yy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1935390723',owner_user_name='tempest-AttachVolumeShelveTestJSON-1935390723-project-member',shelved_at='2023-08-14T16:51:15.149934',shelved_host='user',shelved_image_id='36d46849-dbe0-45d9-b1c4-81dbc21ac957'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:53:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a20dd4c88984674996e26fdcfa4f126',uuid=bcbe7449-6199-4e86-a8b6-c075e142aa34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "address": "fa:16:3e:04:a3:9a", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb018af9-f5", "ovs_interfaceid": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:53:23 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Converting VIF {"id": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "address": "fa:16:3e:04:a3:9a", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb018af9-f5", "ovs_interfaceid": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:53:23 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:a3:9a,bridge_name='br-int',has_traffic_filtering=True,id=cb018af9-f526-4333-9a2f-0cc2d91d22b2,network=Network(20384d1d-92c0-4ac7-a993-956fa784cd87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb018af9-f5') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:53:23 user nova-compute[73056]: DEBUG nova.objects.instance [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lazy-loading 'pci_devices' on Instance uuid bcbe7449-6199-4e86-a8b6-c075e142aa34 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:53:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:53:23 user nova-compute[73056]:   <uuid>bcbe7449-6199-4e86-a8b6-c075e142aa34</uuid>
Aug 14 16:53:23 user nova-compute[73056]:   <name>instance-00000020</name>
Aug 14 16:53:23 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:53:23 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:53:23 user nova-compute[73056]:   <metadata>
Aug 14 16:53:23 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:53:23 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:53:23 user nova-compute[73056]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1786420487</nova:name>
Aug 14 16:53:23 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:53:21</nova:creationTime>
Aug 14 16:53:23 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:53:23 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:53:23 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:53:23 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:53:23 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:53:23 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:53:23 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:53:23 user nova-compute[73056]:       <nova:owner>
Aug 14 16:53:23 user nova-compute[73056]:         <nova:user uuid="9a20dd4c88984674996e26fdcfa4f126">tempest-AttachVolumeShelveTestJSON-1935390723-project-member</nova:user>
Aug 14 16:53:23 user nova-compute[73056]:         <nova:project uuid="c67a1c8fcd97416e90f6b5a50a886a75">tempest-AttachVolumeShelveTestJSON-1935390723</nova:project>
Aug 14 16:53:23 user nova-compute[73056]:       </nova:owner>
Aug 14 16:53:23 user nova-compute[73056]:       <nova:root type="image" uuid="36d46849-dbe0-45d9-b1c4-81dbc21ac957"/>
Aug 14 16:53:23 user nova-compute[73056]:       <nova:ports>
Aug 14 16:53:23 user nova-compute[73056]:         <nova:port uuid="cb018af9-f526-4333-9a2f-0cc2d91d22b2">
Aug 14 16:53:23 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 16:53:23 user nova-compute[73056]:         </nova:port>
Aug 14 16:53:23 user nova-compute[73056]:       </nova:ports>
Aug 14 16:53:23 user nova-compute[73056]:     </nova:instance>
Aug 14 16:53:23 user nova-compute[73056]:   </metadata>
Aug 14 16:53:23 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:53:23 user nova-compute[73056]:     <system>
Aug 14 16:53:23 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:53:23 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:53:23 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:53:23 user nova-compute[73056]:       <entry name="serial">bcbe7449-6199-4e86-a8b6-c075e142aa34</entry>
Aug 14 16:53:23 user nova-compute[73056]:       <entry name="uuid">bcbe7449-6199-4e86-a8b6-c075e142aa34</entry>
Aug 14 16:53:23 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:53:23 user nova-compute[73056]:     </system>
Aug 14 16:53:23 user nova-compute[73056]:   </sysinfo>
Aug 14 16:53:23 user nova-compute[73056]:   <os>
Aug 14 16:53:23 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:53:23 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:53:23 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:53:23 user nova-compute[73056]:   </os>
Aug 14 16:53:23 user nova-compute[73056]:   <features>
Aug 14 16:53:23 user nova-compute[73056]:     <acpi/>
Aug 14 16:53:23 user nova-compute[73056]:     <apic/>
Aug 14 16:53:23 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:53:23 user nova-compute[73056]:   </features>
Aug 14 16:53:23 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:53:23 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:53:23 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:53:23 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:53:23 user nova-compute[73056]:   </clock>
Aug 14 16:53:23 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:53:23 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:53:23 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:53:23 user nova-compute[73056]:   </cpu>
Aug 14 16:53:23 user nova-compute[73056]:   <devices>
Aug 14 16:53:23 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:53:23 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:53:23 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34/disk"/>
Aug 14 16:53:23 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:53:23 user nova-compute[73056]:     </disk>
Aug 14 16:53:23 user nova-compute[73056]:     <disk type="block" device="disk">
Aug 14 16:53:23 user nova-compute[73056]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:53:23 user nova-compute[73056]:       <source dev="/dev/sde"/>
Aug 14 16:53:23 user nova-compute[73056]:       <target dev="vdc" bus="virtio"/>
Aug 14 16:53:23 user nova-compute[73056]:       <serial>c6708c0a-8faa-4315-a2eb-64c3898d5033</serial>
Aug 14 16:53:23 user nova-compute[73056]:     </disk>
Aug 14 16:53:23 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:53:23 user nova-compute[73056]:       <mac address="fa:16:3e:04:a3:9a"/>
Aug 14 16:53:23 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:53:23 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:53:23 user nova-compute[73056]:       <target dev="tapcb018af9-f5"/>
Aug 14 16:53:23 user nova-compute[73056]:     </interface>
Aug 14 16:53:23 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:53:23 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34/console.log" append="off"/>
Aug 14 16:53:23 user nova-compute[73056]:     </serial>
Aug 14 16:53:23 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:53:23 user nova-compute[73056]:     <video>
Aug 14 16:53:23 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:53:23 user nova-compute[73056]:     </video>
Aug 14 16:53:23 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:53:23 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:53:23 user nova-compute[73056]:     </rng>
Aug 14 16:53:23 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:53:23 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:53:23 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:53:23 user nova-compute[73056]:     </memballoon>
Aug 14 16:53:23 user nova-compute[73056]:   </devices>
Aug 14 16:53:23 user nova-compute[73056]: </domain>
Aug 14 16:53:23 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:53:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T16:49:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1786420487',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1786420487',id=32,image_ref='36d46849-dbe0-45d9-b1c4-81dbc21ac957',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1929561178',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:49:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c67a1c8fcd97416e90f6b5a50a886a75',ramdisk_id='',reservation_id='r-c4car4yy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1935390723',owner_user_name='tempest-AttachVolumeShelveTestJSON-1935390723-project-member',shelved_at='2023-08-14T16:51:15.149934',shelved_host='user',shelved_image_id='36d46849-dbe0-45d9-b1c4-81dbc21ac957'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:53:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a20dd4c88984674996e26fdcfa4f126',uuid=bcbe7449-6199-4e86-a8b6-c075e142aa34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "address": "fa:16:3e:04:a3:9a", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb018af9-f5", "ovs_interfaceid": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:53:23 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Converting VIF {"id": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "address": "fa:16:3e:04:a3:9a", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb018af9-f5", "ovs_interfaceid": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:53:23 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:a3:9a,bridge_name='br-int',has_traffic_filtering=True,id=cb018af9-f526-4333-9a2f-0cc2d91d22b2,network=Network(20384d1d-92c0-4ac7-a993-956fa784cd87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb018af9-f5') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:53:23 user nova-compute[73056]: DEBUG os_vif [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:a3:9a,bridge_name='br-int',has_traffic_filtering=True,id=cb018af9-f526-4333-9a2f-0cc2d91d22b2,network=Network(20384d1d-92c0-4ac7-a993-956fa784cd87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb018af9-f5') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:53:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:53:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:53:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb018af9-f5, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:53:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcb018af9-f5, col_values=(('external_ids', {'iface-id': 'cb018af9-f526-4333-9a2f-0cc2d91d22b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:a3:9a', 'vm-uuid': 'bcbe7449-6199-4e86-a8b6-c075e142aa34'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:53:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:53:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:23 user nova-compute[73056]: INFO os_vif [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:a3:9a,bridge_name='br-int',has_traffic_filtering=True,id=cb018af9-f526-4333-9a2f-0cc2d91d22b2,network=Network(20384d1d-92c0-4ac7-a993-956fa784cd87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb018af9-f5')
Aug 14 16:53:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:53:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:53:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] No VIF found with MAC fa:16:3e:04:a3:9a, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:53:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-f1830f46-0b62-46ba-b049-afe094235097 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Acquiring lock "c35f86ec-62d5-4c4d-a259-902e95aeb9d0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:53:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-f1830f46-0b62-46ba-b049-afe094235097 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "c35f86ec-62d5-4c4d-a259-902e95aeb9d0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:53:24 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:24 user nova-compute[73056]: INFO nova.compute.manager [None req-f1830f46-0b62-46ba-b049-afe094235097 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Detaching volume 4a388400-9fec-4b74-883c-c0ccf7a32048
Aug 14 16:53:24 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:24 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:24 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:24 user nova-compute[73056]: INFO nova.virt.block_device [None req-f1830f46-0b62-46ba-b049-afe094235097 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Attempting to driver detach volume 4a388400-9fec-4b74-883c-c0ccf7a32048 from mountpoint /dev/vdb
Aug 14 16:53:24 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-f1830f46-0b62-46ba-b049-afe094235097 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Attempting to detach device vdb from instance c35f86ec-62d5-4c4d-a259-902e95aeb9d0 from the persistent domain config. {{(pid=73056) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 16:53:24 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-f1830f46-0b62-46ba-b049-afe094235097 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 16:53:24 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:53:24 user nova-compute[73056]:   <source dev="/dev/sdd"/>
Aug 14 16:53:24 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:53:24 user nova-compute[73056]:   <serial>4a388400-9fec-4b74-883c-c0ccf7a32048</serial>
Aug 14 16:53:24 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 16:53:24 user nova-compute[73056]: </disk>
Aug 14 16:53:24 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 16:53:24 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-f1830f46-0b62-46ba-b049-afe094235097 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Successfully detached device vdb from instance c35f86ec-62d5-4c4d-a259-902e95aeb9d0 from the persistent domain config.
Aug 14 16:53:24 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-f1830f46-0b62-46ba-b049-afe094235097 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c35f86ec-62d5-4c4d-a259-902e95aeb9d0 from the live domain config. {{(pid=73056) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 16:53:24 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-f1830f46-0b62-46ba-b049-afe094235097 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 16:53:24 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:53:24 user nova-compute[73056]:   <source dev="/dev/sdd"/>
Aug 14 16:53:24 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:53:24 user nova-compute[73056]:   <serial>4a388400-9fec-4b74-883c-c0ccf7a32048</serial>
Aug 14 16:53:24 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 16:53:24 user nova-compute[73056]: </disk>
Aug 14 16:53:24 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 16:53:24 user nova-compute[73056]: DEBUG nova.compute.manager [req-6452b00e-b8d7-49ff-b6c6-afe95dece75e req-98d3e09d-940d-4d70-b877-856872da77f6 service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Received event network-vif-plugged-cb018af9-f526-4333-9a2f-0cc2d91d22b2 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:53:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6452b00e-b8d7-49ff-b6c6-afe95dece75e req-98d3e09d-940d-4d70-b877-856872da77f6 service nova] Acquiring lock "bcbe7449-6199-4e86-a8b6-c075e142aa34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:53:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6452b00e-b8d7-49ff-b6c6-afe95dece75e req-98d3e09d-940d-4d70-b877-856872da77f6 service nova] Lock "bcbe7449-6199-4e86-a8b6-c075e142aa34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:53:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6452b00e-b8d7-49ff-b6c6-afe95dece75e req-98d3e09d-940d-4d70-b877-856872da77f6 service nova] Lock "bcbe7449-6199-4e86-a8b6-c075e142aa34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:53:24 user nova-compute[73056]: DEBUG nova.compute.manager [req-6452b00e-b8d7-49ff-b6c6-afe95dece75e req-98d3e09d-940d-4d70-b877-856872da77f6 service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] No waiting events found dispatching network-vif-plugged-cb018af9-f526-4333-9a2f-0cc2d91d22b2 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:53:24 user nova-compute[73056]: WARNING nova.compute.manager [req-6452b00e-b8d7-49ff-b6c6-afe95dece75e req-98d3e09d-940d-4d70-b877-856872da77f6 service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Received unexpected event network-vif-plugged-cb018af9-f526-4333-9a2f-0cc2d91d22b2 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 16:53:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Received event <DeviceRemovedEvent: 1692032005.0526707, c35f86ec-62d5-4c4d-a259-902e95aeb9d0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73056) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-f1830f46-0b62-46ba-b049-afe094235097 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c35f86ec-62d5-4c4d-a259-902e95aeb9d0 {{(pid=73056) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:25 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-f1830f46-0b62-46ba-b049-afe094235097 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Successfully detached device vdb from instance c35f86ec-62d5-4c4d-a259-902e95aeb9d0 from the live domain config.
Aug 14 16:53:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1830f46-0b62-46ba-b049-afe094235097 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1830f46-0b62-46ba-b049-afe094235097 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sAeOMapW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:53:25 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-f1830f46-0b62-46ba-b049-afe094235097 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:53:25 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-f1830f46-0b62-46ba-b049-afe094235097 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-f1830f46-0b62-46ba-b049-afe094235097 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1830f46-0b62-46ba-b049-afe094235097 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c5c9d9-dd09-42f3-a2ac-9dceea471ff8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fda494f-edbe-4bf3-a947-62e5ad87dd47]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1830f46-0b62-46ba-b049-afe094235097 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:53:25 user nova-compute[73056]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:53:25 user nova-compute[73056]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048 (non-flash)
Aug 14 16:53:25 user nova-compute[73056]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 (non-flash)
Aug 14 16:53:25 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1830f46-0b62-46ba-b049-afe094235097 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:53:25 user nova-compute[73056]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:53:25 user nova-compute[73056]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048 (non-flash)
Aug 14 16:53:25 user nova-compute[73056]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 (non-flash)
Aug 14 16:53:25 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1830f46-0b62-46ba-b049-afe094235097 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff30043bd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048'): ({'sdd'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-f1830f46-0b62-46ba-b049-afe094235097 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Removing single pathed devices sdd {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a388b98-6b7a-40bb-9ebd-57ef3bddbef5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.041s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf750e0-7264-4079-9194-685bca91e5bb]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-f1830f46-0b62-46ba-b049-afe094235097 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Flushing IO for device /dev/sdd {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a18d4a5-60d3-4716-ab35-2c03f2c0d168]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-f1830f46-0b62-46ba-b049-afe094235097 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac261db-0c45-4ad3-b820-1dfea5e71716]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-f1830f46-0b62-46ba-b049-afe094235097 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-f1830f46-0b62-46ba-b049-afe094235097 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] SCSI volumes sdd have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1830f46-0b62-46ba-b049-afe094235097 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcdb530-368a-4abb-9063-0c109f518fc8]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1830f46-0b62-46ba-b049-afe094235097 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048 -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f469b4f-537f-43af-874b-93b356c0af7a]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1830f46-0b62-46ba-b049-afe094235097 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048, portal: 172.16.0.220,3260]
Aug 14 16:53:25 user nova-compute[73056]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048, portal: 172.16.0.220,3260] successful.
Aug 14 16:53:25 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048 -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[297947c6-0d8f-4416-a96c-8ebfdb4a9d3e]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1830f46-0b62-46ba-b049-afe094235097 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-f1830f46-0b62-46ba-b049-afe094235097 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1830f46-0b62-46ba-b049-afe094235097 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] <== disconnect_volume: return (344ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:53:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1830f46-0b62-46ba-b049-afe094235097 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:53:26 user nova-compute[73056]: DEBUG nova.objects.instance [None req-f1830f46-0b62-46ba-b049-afe094235097 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lazy-loading 'flavor' on Instance uuid c35f86ec-62d5-4c4d-a259-902e95aeb9d0 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:53:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-f1830f46-0b62-46ba-b049-afe094235097 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "c35f86ec-62d5-4c4d-a259-902e95aeb9d0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.871s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:53:26 user nova-compute[73056]: ERROR nova.volume.cinder [None req-2f4b8a11-2fdf-4882-b767-760d602ac675 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Update attachment failed for attachment 666ecfd2-8593-4946-b396-581226e106d1. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:4939f6c8-4a73-4d83-aac8-af186e2986e8 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:4939f6c8-4a73-4d83-aac8-af186e2986e8/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048 was not found.).). (HTTP 500) (Request-ID: req-34e32ba6-b048-4e7e-a596-a20f22c19a47) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:4939f6c8-4a73-4d83-aac8-af186e2986e8 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:4939f6c8-4a73-4d83-aac8-af186e2986e8/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048 was not found.).). (HTTP 500) (Request-ID: req-34e32ba6-b048-4e7e-a596-a20f22c19a47)
Aug 14 16:53:26 user nova-compute[73056]: ERROR nova.compute.manager [None req-2f4b8a11-2fdf-4882-b767-760d602ac675 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Failed to attach 4939f6c8-4a73-4d83-aac8-af186e2986e8 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:4939f6c8-4a73-4d83-aac8-af186e2986e8 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:4939f6c8-4a73-4d83-aac8-af186e2986e8/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048 was not found.).). (HTTP 500) (Request-ID: req-34e32ba6-b048-4e7e-a596-a20f22c19a47)
Aug 14 16:53:26 user nova-compute[73056]: ERROR nova.compute.manager [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Traceback (most recent call last):
Aug 14 16:53:26 user nova-compute[73056]: ERROR nova.compute.manager [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e]   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 14 16:53:26 user nova-compute[73056]: ERROR nova.compute.manager [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e]     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 14 16:53:26 user nova-compute[73056]: ERROR nova.compute.manager [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 14 16:53:26 user nova-compute[73056]: ERROR nova.compute.manager [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e]     ret_val = method(obj, context, *args, **kwargs)
Aug 14 16:53:26 user nova-compute[73056]: ERROR nova.compute.manager [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 14 16:53:26 user nova-compute[73056]: ERROR nova.compute.manager [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e]     self._do_attach(context, instance, volume, volume_api,
Aug 14 16:53:26 user nova-compute[73056]: ERROR nova.compute.manager [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 14 16:53:26 user nova-compute[73056]: ERROR nova.compute.manager [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e]     self._volume_attach(context, volume, connector, instance,
Aug 14 16:53:26 user nova-compute[73056]: ERROR nova.compute.manager [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 14 16:53:26 user nova-compute[73056]: ERROR nova.compute.manager [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e]     connection_info = volume_api.attachment_update(
Aug 14 16:53:26 user nova-compute[73056]: ERROR nova.compute.manager [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 14 16:53:26 user nova-compute[73056]: ERROR nova.compute.manager [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e]     res = method(self, ctx, *args, **kwargs)
Aug 14 16:53:26 user nova-compute[73056]: ERROR nova.compute.manager [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 14 16:53:26 user nova-compute[73056]: ERROR nova.compute.manager [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 14 16:53:26 user nova-compute[73056]: ERROR nova.compute.manager [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 14 16:53:26 user nova-compute[73056]: ERROR nova.compute.manager [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e]     with excutils.save_and_reraise_exception():
Aug 14 16:53:26 user nova-compute[73056]: ERROR nova.compute.manager [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 16:53:26 user nova-compute[73056]: ERROR nova.compute.manager [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e]     self.force_reraise()
Aug 14 16:53:26 user nova-compute[73056]: ERROR nova.compute.manager [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 16:53:26 user nova-compute[73056]: ERROR nova.compute.manager [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e]     raise self.value
Aug 14 16:53:26 user nova-compute[73056]: ERROR nova.compute.manager [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 14 16:53:26 user nova-compute[73056]: ERROR nova.compute.manager [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e]     context, '3.44', skip_version_check=True).attachments.update(
Aug 14 16:53:26 user nova-compute[73056]: ERROR nova.compute.manager [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 14 16:53:26 user nova-compute[73056]: ERROR nova.compute.manager [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e]     return method.func(obj, *args, **kwargs)
Aug 14 16:53:26 user nova-compute[73056]: ERROR nova.compute.manager [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 14 16:53:26 user nova-compute[73056]: ERROR nova.compute.manager [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e]     resp = self._update('/attachments/%s' % id, body)
Aug 14 16:53:26 user nova-compute[73056]: ERROR nova.compute.manager [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 14 16:53:26 user nova-compute[73056]: ERROR nova.compute.manager [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 14 16:53:26 user nova-compute[73056]: ERROR nova.compute.manager [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 14 16:53:26 user nova-compute[73056]: ERROR nova.compute.manager [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e]     return self._cs_request(url, 'PUT', **kwargs)
Aug 14 16:53:26 user nova-compute[73056]: ERROR nova.compute.manager [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 16:53:26 user nova-compute[73056]: ERROR nova.compute.manager [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e]     return self.request(url, method, **kwargs)
Aug 14 16:53:26 user nova-compute[73056]: ERROR nova.compute.manager [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 16:53:26 user nova-compute[73056]: ERROR nova.compute.manager [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e]     raise exceptions.from_response(resp, body)
Aug 14 16:53:26 user nova-compute[73056]: ERROR nova.compute.manager [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:4939f6c8-4a73-4d83-aac8-af186e2986e8 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:4939f6c8-4a73-4d83-aac8-af186e2986e8/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048 was not found.).). (HTTP 500) (Request-ID: req-34e32ba6-b048-4e7e-a596-a20f22c19a47)
Aug 14 16:53:26 user nova-compute[73056]: ERROR nova.compute.manager [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] 
Aug 14 16:53:26 user nova-compute[73056]: DEBUG nova.compute.manager [req-25c72bf1-61fe-43ca-a75c-6fbc207ea06a req-60c5d1db-0b7f-490f-b570-8465072b2b45 service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Received event network-vif-plugged-cb018af9-f526-4333-9a2f-0cc2d91d22b2 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:53:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-25c72bf1-61fe-43ca-a75c-6fbc207ea06a req-60c5d1db-0b7f-490f-b570-8465072b2b45 service nova] Acquiring lock "bcbe7449-6199-4e86-a8b6-c075e142aa34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:53:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-25c72bf1-61fe-43ca-a75c-6fbc207ea06a req-60c5d1db-0b7f-490f-b570-8465072b2b45 service nova] Lock "bcbe7449-6199-4e86-a8b6-c075e142aa34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:53:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-25c72bf1-61fe-43ca-a75c-6fbc207ea06a req-60c5d1db-0b7f-490f-b570-8465072b2b45 service nova] Lock "bcbe7449-6199-4e86-a8b6-c075e142aa34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:53:26 user nova-compute[73056]: DEBUG nova.compute.manager [req-25c72bf1-61fe-43ca-a75c-6fbc207ea06a req-60c5d1db-0b7f-490f-b570-8465072b2b45 service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] No waiting events found dispatching network-vif-plugged-cb018af9-f526-4333-9a2f-0cc2d91d22b2 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:53:26 user nova-compute[73056]: WARNING nova.compute.manager [req-25c72bf1-61fe-43ca-a75c-6fbc207ea06a req-60c5d1db-0b7f-490f-b570-8465072b2b45 service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Received unexpected event network-vif-plugged-cb018af9-f526-4333-9a2f-0cc2d91d22b2 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 16:53:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2f4b8a11-2fdf-4882-b767-760d602ac675 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Lock "ee670695-1123-4d95-a7ad-ac79f9a4c16e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.331s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server [None req-2f4b8a11-2fdf-4882-b767-760d602ac675 tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:4939f6c8-4a73-4d83-aac8-af186e2986e8 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:4939f6c8-4a73-4d83-aac8-af186e2986e8/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048 was not found.).). (HTTP 500) (Request-ID: req-34e32ba6-b048-4e7e-a596-a20f22c19a47)
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7473, in attach_volume
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7470, in do_attach_volume
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7468, in do_attach_volume
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7490, in _attach_volume
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:4939f6c8-4a73-4d83-aac8-af186e2986e8 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:4939f6c8-4a73-4d83-aac8-af186e2986e8/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:4a388400-9fec-4b74-883c-c0ccf7a32048 was not found.).). (HTTP 500) (Request-ID: req-34e32ba6-b048-4e7e-a596-a20f22c19a47)
Aug 14 16:53:26 user nova-compute[73056]: ERROR oslo_messaging.rpc.server 
Aug 14 16:53:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "d79c2f2c-0870-4d8e-b468-36e63496b769" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:53:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "d79c2f2c-0870-4d8e-b468-36e63496b769" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:53:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "d79c2f2c-0870-4d8e-b468-36e63496b769-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:53:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "d79c2f2c-0870-4d8e-b468-36e63496b769-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:53:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "d79c2f2c-0870-4d8e-b468-36e63496b769-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:53:27 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692032007.0835428, bcbe7449-6199-4e86-a8b6-c075e142aa34 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:53:27 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] VM Resumed (Lifecycle Event)
Aug 14 16:53:27 user nova-compute[73056]: DEBUG nova.compute.manager [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:53:27 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:53:27 user nova-compute[73056]: INFO nova.compute.manager [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Terminating instance
Aug 14 16:53:27 user nova-compute[73056]: DEBUG nova.compute.manager [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 16:53:27 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Instance spawned successfully.
Aug 14 16:53:27 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:53:27 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:53:27 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:53:27 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692032007.0845983, bcbe7449-6199-4e86-a8b6-c075e142aa34 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:53:27 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] VM Started (Lifecycle Event)
Aug 14 16:53:27 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:53:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:27 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:53:27 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:53:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:27 user nova-compute[73056]: DEBUG nova.compute.manager [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:53:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-84ad745e-3796-4d0f-ad92-bd0586084cd8 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "bcbe7449-6199-4e86-a8b6-c075e142aa34" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 25.951s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:53:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:27 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Instance destroyed successfully.
Aug 14 16:53:27 user nova-compute[73056]: DEBUG nova.objects.instance [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lazy-loading 'resources' on Instance uuid d79c2f2c-0870-4d8e-b468-36e63496b769 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:53:27 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:46:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1030984807',display_name='tempest-ServerActionsTestOtherA-server-1030984807',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1030984807',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDU6ne8W7YSxsWIOL2ltT8/3A4Lay+Fa3EBjGBahsu1+va9jX8aVIvfUTXS/QOiNmJPitbbWTrcI3+h3fj8j4zOwrNCeF7Pt0QIdwz/ogo81jcw9PMYL2yia/QSf+KeHhA==',key_name='tempest-keypair-1415046919',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:49:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2dd5723fb8384aa985cf401d95aa7d08',ramdisk_id='',reservation_id='r-fwp2qpkf',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-380813086',owner_user_name='tempest-ServerActionsTestOtherA-380813086-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:50:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9404ed7386e14eed8d046e8c45942c75',uuid=d79c2f2c-0870-4d8e-b468-36e63496b769,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7a36ac9-68dc-462c-9e90-4eb844971548", "address": "fa:16:3e:44:b8:c2", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a36ac9-68", "ovs_interfaceid": "c7a36ac9-68dc-462c-9e90-4eb844971548", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:53:27 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Converting VIF {"id": "c7a36ac9-68dc-462c-9e90-4eb844971548", "address": "fa:16:3e:44:b8:c2", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a36ac9-68", "ovs_interfaceid": "c7a36ac9-68dc-462c-9e90-4eb844971548", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:53:27 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:b8:c2,bridge_name='br-int',has_traffic_filtering=True,id=c7a36ac9-68dc-462c-9e90-4eb844971548,network=Network(2c5f0d57-9485-4a0b-a847-49eea5cd17c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7a36ac9-68') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:53:27 user nova-compute[73056]: DEBUG os_vif [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:b8:c2,bridge_name='br-int',has_traffic_filtering=True,id=c7a36ac9-68dc-462c-9e90-4eb844971548,network=Network(2c5f0d57-9485-4a0b-a847-49eea5cd17c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7a36ac9-68') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:53:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7a36ac9-68, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:53:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:27 user nova-compute[73056]: INFO os_vif [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:b8:c2,bridge_name='br-int',has_traffic_filtering=True,id=c7a36ac9-68dc-462c-9e90-4eb844971548,network=Network(2c5f0d57-9485-4a0b-a847-49eea5cd17c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7a36ac9-68')
Aug 14 16:53:27 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:53:27 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qsfKthHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:53:27 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:53:27 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:53:27 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:53:27 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:53:27 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:27 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:27 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f6d2b8-8a36-4100-9226-c65837453c73]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:27 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:27 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:27 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[888fae0b-27ea-4a7d-b3bc-f641084ff978]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:27 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:53:27 user nova-compute[73056]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:53:27 user nova-compute[73056]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 (non-flash)
Aug 14 16:53:27 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:53:27 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 (non-flash)
Aug 14 16:53:27 user nova-compute[73056]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:53:27 user nova-compute[73056]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 (non-flash)
Aug 14 16:53:27 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:53:27 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff2dce47520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603'): ({'sdb'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:53:27 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Removing single pathed devices sdb {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:53:27 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1b9586-4e57-4e8c-b321-f2f282e2018e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90e8dd0-776e-41df-8663-9ddbe9a51a60]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Flushing IO for device /dev/sdb {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[373af1f9-56db-401d-bc93-7c856b545d26]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aca7445-95ed-480d-ae16-a52cf07c3ada]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] SCSI volumes sdb have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO225027d8-92e79fe243b4d1c0', '/dev/disk/by-id/scsi-23932653739666532', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_225027d8') {{(pid=83519) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25d6c74-3e1f-4093-ad4f-08a38acdf3a0]: (4, None) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4fab10-fa4f-42d1-8498-f18654998eb5]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade5887d-b0c6-4d7c-a3f4-d65d0358ada3]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603, portal: 172.16.0.220,3260]
Aug 14 16:53:28 user nova-compute[73056]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603, portal: 172.16.0.220,3260] successful.
Aug 14 16:53:28 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523a4349-d411-42d5-82c8-e6182588a603 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[18177d1c-2755-4044-948e-cb207955a553]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] <== disconnect_volume: return (300ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:53:28 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Deleting instance files /opt/stack/data/nova/instances/d79c2f2c-0870-4d8e-b468-36e63496b769_del
Aug 14 16:53:28 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Deletion of /opt/stack/data/nova/instances/d79c2f2c-0870-4d8e-b468-36e63496b769_del complete
Aug 14 16:53:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:28 user nova-compute[73056]: INFO nova.compute.manager [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 14 16:53:28 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG nova.compute.manager [req-2d6182ad-1012-4a06-9a2a-a48ded9740dc req-611e499a-c776-43bd-963d-e19a4f607eac service nova] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Received event network-vif-unplugged-c7a36ac9-68dc-462c-9e90-4eb844971548 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2d6182ad-1012-4a06-9a2a-a48ded9740dc req-611e499a-c776-43bd-963d-e19a4f607eac service nova] Acquiring lock "d79c2f2c-0870-4d8e-b468-36e63496b769-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2d6182ad-1012-4a06-9a2a-a48ded9740dc req-611e499a-c776-43bd-963d-e19a4f607eac service nova] Lock "d79c2f2c-0870-4d8e-b468-36e63496b769-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2d6182ad-1012-4a06-9a2a-a48ded9740dc req-611e499a-c776-43bd-963d-e19a4f607eac service nova] Lock "d79c2f2c-0870-4d8e-b468-36e63496b769-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG nova.compute.manager [req-2d6182ad-1012-4a06-9a2a-a48ded9740dc req-611e499a-c776-43bd-963d-e19a4f607eac service nova] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] No waiting events found dispatching network-vif-unplugged-c7a36ac9-68dc-462c-9e90-4eb844971548 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG nova.compute.manager [req-2d6182ad-1012-4a06-9a2a-a48ded9740dc req-611e499a-c776-43bd-963d-e19a4f607eac service nova] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Received event network-vif-unplugged-c7a36ac9-68dc-462c-9e90-4eb844971548 for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG nova.compute.manager [req-2d6182ad-1012-4a06-9a2a-a48ded9740dc req-611e499a-c776-43bd-963d-e19a4f607eac service nova] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Received event network-vif-plugged-c7a36ac9-68dc-462c-9e90-4eb844971548 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2d6182ad-1012-4a06-9a2a-a48ded9740dc req-611e499a-c776-43bd-963d-e19a4f607eac service nova] Acquiring lock "d79c2f2c-0870-4d8e-b468-36e63496b769-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2d6182ad-1012-4a06-9a2a-a48ded9740dc req-611e499a-c776-43bd-963d-e19a4f607eac service nova] Lock "d79c2f2c-0870-4d8e-b468-36e63496b769-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2d6182ad-1012-4a06-9a2a-a48ded9740dc req-611e499a-c776-43bd-963d-e19a4f607eac service nova] Lock "d79c2f2c-0870-4d8e-b468-36e63496b769-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:53:28 user nova-compute[73056]: DEBUG nova.compute.manager [req-2d6182ad-1012-4a06-9a2a-a48ded9740dc req-611e499a-c776-43bd-963d-e19a4f607eac service nova] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] No waiting events found dispatching network-vif-plugged-c7a36ac9-68dc-462c-9e90-4eb844971548 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:53:28 user nova-compute[73056]: WARNING nova.compute.manager [req-2d6182ad-1012-4a06-9a2a-a48ded9740dc req-611e499a-c776-43bd-963d-e19a4f607eac service nova] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Received unexpected event network-vif-plugged-c7a36ac9-68dc-462c-9e90-4eb844971548 for instance with vm_state active and task_state deleting.
Aug 14 16:53:29 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:53:29 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Took 1.08 seconds to deallocate network for instance.
Aug 14 16:53:29 user nova-compute[73056]: DEBUG nova.compute.manager [req-0c5048e2-c417-4e4e-9ef8-4edce6e68d0d req-39a40c7e-5c91-4c2b-ae50-524c75b10de3 service nova] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Received event network-vif-deleted-c7a36ac9-68dc-462c-9e90-4eb844971548 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:53:30 user nova-compute[73056]: INFO nova.compute.manager [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Took 0.81 seconds to detach 1 volumes for instance.
Aug 14 16:53:30 user nova-compute[73056]: DEBUG nova.compute.manager [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Deleting volume: 523a4349-d411-42d5-82c8-e6182588a603 {{(pid=73056) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 16:53:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:53:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:53:30 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:53:30 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:53:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.396s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:53:30 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Deleted allocations for instance d79c2f2c-0870-4d8e-b468-36e63496b769
Aug 14 16:53:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-85072333-2319-467b-b28f-bd367555a800 tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "d79c2f2c-0870-4d8e-b468-36e63496b769" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.760s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:53:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:37 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:42 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692032007.8710637, d79c2f2c-0870-4d8e-b468-36e63496b769 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:53:42 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] VM Stopped (Lifecycle Event)
Aug 14 16:53:42 user nova-compute[73056]: DEBUG nova.compute.manager [None req-6bce715a-83ac-48fe-8568-57cd828e9ad4 None None] [instance: d79c2f2c-0870-4d8e-b468-36e63496b769] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:53:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:53:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Acquiring lock "6910e1fe-8863-4a4b-b975-48c9ebb0b087" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:53:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lock "6910e1fe-8863-4a4b-b975-48c9ebb0b087" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:53:47 user nova-compute[73056]: INFO nova.compute.manager [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Unshelving
Aug 14 16:53:47 user nova-compute[73056]: INFO nova.virt.block_device [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Booting with volume 5ee0e8f1-8f40-460f-98df-7326372dac7d at /dev/vda
Aug 14 16:53:47 user nova-compute[73056]: DEBUG os_brick.utils [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:53:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:47 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d51932-60b1-4aeb-b8c1-7bfaceb8f454]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:47 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2306341-3f6c-47d7-9824-0555fa537f7d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:47 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1123cb6-390a-40be-8850-ce00d0733360]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:47 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5d2ea9-a8f1-4368-9e54-ece99ce7c0a4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:53:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:53:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:53:47 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:53:47 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[834d461b-dfbf-48c3-817a-1c904e4b1a08]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:53:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:53:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:53:47 user nova-compute[73056]: DEBUG os_brick.utils [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:53:47 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Updating existing volume attachment record: 1fd283e8-5d56-41d3-a12c-20e478179378 {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 16:53:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:53:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:53:56 user nova-compute[73056]: DEBUG nova.objects.instance [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lazy-loading 'pci_requests' on Instance uuid 6910e1fe-8863-4a4b-b975-48c9ebb0b087 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:53:56 user nova-compute[73056]: DEBUG nova.objects.instance [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lazy-loading 'numa_topology' on Instance uuid 6910e1fe-8863-4a4b-b975-48c9ebb0b087 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:53:56 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:53:56 user nova-compute[73056]: INFO nova.compute.claims [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Claim successful on node user
Aug 14 16:53:56 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:53:56 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:53:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.423s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:53:56 user nova-compute[73056]: INFO nova.network.neutron [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Updating port 9cdd486e-fc3e-4637-8958-eb7e065728fc with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 14 16:53:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Acquiring lock "refresh_cache-6910e1fe-8863-4a4b-b975-48c9ebb0b087" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:53:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Acquired lock "refresh_cache-6910e1fe-8863-4a4b-b975-48c9ebb0b087" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:53:57 user nova-compute[73056]: DEBUG nova.network.neutron [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:53:57 user nova-compute[73056]: DEBUG nova.compute.manager [req-8e70c850-590a-4502-9dc5-d5552674c615 req-a813a1ea-6df2-43e3-8073-12387cefc01e service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Received event network-changed-9cdd486e-fc3e-4637-8958-eb7e065728fc {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:53:57 user nova-compute[73056]: DEBUG nova.compute.manager [req-8e70c850-590a-4502-9dc5-d5552674c615 req-a813a1ea-6df2-43e3-8073-12387cefc01e service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Refreshing instance network info cache due to event network-changed-9cdd486e-fc3e-4637-8958-eb7e065728fc. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:53:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8e70c850-590a-4502-9dc5-d5552674c615 req-a813a1ea-6df2-43e3-8073-12387cefc01e service nova] Acquiring lock "refresh_cache-6910e1fe-8863-4a4b-b975-48c9ebb0b087" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:53:57 user nova-compute[73056]: DEBUG nova.network.neutron [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Updating instance_info_cache with network_info: [{"id": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "address": "fa:16:3e:ef:51:62", "network": {"id": "73253aa9-a146-4f82-b5bb-1cc2dc68755c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1632478330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd21ca04890479e82483a51d05ba69b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cdd486e-fc", "ovs_interfaceid": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:53:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Releasing lock "refresh_cache-6910e1fe-8863-4a4b-b975-48c9ebb0b087" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:53:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:53:57 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Creating image(s)
Aug 14 16:53:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Did not create local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 16:53:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Ensure instance console log exists: /opt/stack/data/nova/instances/6910e1fe-8863-4a4b-b975-48c9ebb0b087/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:53:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:53:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:53:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:53:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Start _get_guest_xml network_info=[{"id": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "address": "fa:16:3e:ef:51:62", "network": {"id": "73253aa9-a146-4f82-b5bb-1cc2dc68755c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1632478330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd21ca04890479e82483a51d05ba69b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cdd486e-fc", "ovs_interfaceid": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BinUXqAW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6910e1fe-8863-4a4b-b975-48c9ebb0b087', 'attached_at': '', 'detached_at': '', 'volume_id': '5ee0e8f1-8f40-460f-98df-7326372dac7d', 'serial': '5ee0e8f1-8f40-460f-98df-7326372dac7d'}, 'attachment_id': '1fd283e8-5d56-41d3-a12c-20e478179378', 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:53:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8e70c850-590a-4502-9dc5-d5552674c615 req-a813a1ea-6df2-43e3-8073-12387cefc01e service nova] Acquired lock "refresh_cache-6910e1fe-8863-4a4b-b975-48c9ebb0b087" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:53:57 user nova-compute[73056]: DEBUG nova.network.neutron [req-8e70c850-590a-4502-9dc5-d5552674c615 req-a813a1ea-6df2-43e3-8073-12387cefc01e service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Refreshing network info cache for port 9cdd486e-fc3e-4637-8958-eb7e065728fc {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:53:57 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:53:57 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:53:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:53:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:53:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:53:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:53:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:53:57 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:53:57 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:53:57 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:53:57 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:53:57 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:53:57 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:53:57 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:53:57 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:53:57 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:53:57 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:53:57 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:53:57 user nova-compute[73056]: DEBUG nova.objects.instance [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6910e1fe-8863-4a4b-b975-48c9ebb0b087 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:53:57 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:53:57 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BinUXqAW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:53:57 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:53:57 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:53:57 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:53:57 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:53:57 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:53:57 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:53:57 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:53:57 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9943ee4-0687-42c6-94c2-b86bc0854633]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:53:58 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b04d95d-3dd6-4510-a943-75c5126c9903]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d] added
Aug 14 16:53:58 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b7a1f9-8a74-49a3-9551-e6eed6affa38]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cba3df-5880-438b-b261-09ead1a37c71]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BinUXqAW {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BinUXqAW" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9af190-bb5f-4a26-a87d-c9c22e6d5503]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BinUXqAW'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbc47c8-36e8-4a49-98d3-0af5cd8e3009]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b411ef-829a-4240-ab45-0b231f6ea6b9]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:53:58 user nova-compute[73056]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 (non-flash)
Aug 14 16:53:58 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:53:58 user nova-compute[73056]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 (non-flash)
Aug 14 16:53:58 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef54826-da7d-4a6e-a1b7-322b964331ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d, portal: 172.16.0.220,3260]
Aug 14 16:53:58 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d, portal: 172.16.0.220,3260] successful.
Aug 14 16:53:58 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[16426723-c1d5-4497-881d-02a28e5d80db]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[57733dbb-ef76-45ce-a9c0-0d5f0bdf9605]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:53:58 user nova-compute[73056]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 (non-flash)
Aug 14 16:53:58 user nova-compute[73056]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)
Aug 14 16:53:58 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:53:58 user nova-compute[73056]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 (non-flash)
Aug 14 16:53:58 user nova-compute[73056]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)
Aug 14 16:53:58 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[39911340-f168-460f-9528-4cde3ac57839]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: None {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG nova.network.neutron [req-8e70c850-590a-4502-9dc5-d5552674c615 req-a813a1ea-6df2-43e3-8073-12387cefc01e service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Updated VIF entry in instance network info cache for port 9cdd486e-fc3e-4637-8958-eb7e065728fc. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG nova.network.neutron [req-8e70c850-590a-4502-9dc5-d5552674c615 req-a813a1ea-6df2-43e3-8073-12387cefc01e service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Updating instance_info_cache with network_info: [{"id": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "address": "fa:16:3e:ef:51:62", "network": {"id": "73253aa9-a146-4f82-b5bb-1cc2dc68755c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1632478330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd21ca04890479e82483a51d05ba69b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cdd486e-fc", "ovs_interfaceid": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:53:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8e70c850-590a-4502-9dc5-d5552674c615 req-a813a1ea-6df2-43e3-8073-12387cefc01e service nova] Releasing lock "refresh_cache-6910e1fe-8863-4a4b-b975-48c9ebb0b087" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:53:59 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:53:59 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BinUXqAW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:53:59 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:53:59 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23031353166663362', 'path': '/dev/sdb'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:53:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031353166663362', 'path': '/dev/sdb'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:53:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T16:50:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-717451743',display_name='tempest-TestShelveInstance-server-717451743',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-717451743',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1292582580',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:50:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='dcd21ca04890479e82483a51d05ba69b',ramdisk_id='',reservation_id='r-288qfle8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-559346633',owner_user_name='tempest-TestShelveInstance-559346633-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:53:47Z,user_data=None,user_id='d586451958914503bac9c1fb5dedea9e',uuid=6910e1fe-8863-4a4b-b975-48c9ebb0b087,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "address": "fa:16:3e:ef:51:62", "network": {"id": "73253aa9-a146-4f82-b5bb-1cc2dc68755c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1632478330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd21ca04890479e82483a51d05ba69b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cdd486e-fc", "ovs_interfaceid": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:53:59 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Converting VIF {"id": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "address": "fa:16:3e:ef:51:62", "network": {"id": "73253aa9-a146-4f82-b5bb-1cc2dc68755c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1632478330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd21ca04890479e82483a51d05ba69b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cdd486e-fc", "ovs_interfaceid": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:53:59 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:51:62,bridge_name='br-int',has_traffic_filtering=True,id=9cdd486e-fc3e-4637-8958-eb7e065728fc,network=Network(73253aa9-a146-4f82-b5bb-1cc2dc68755c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cdd486e-fc') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:53:59 user nova-compute[73056]: DEBUG nova.objects.instance [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lazy-loading 'pci_devices' on Instance uuid 6910e1fe-8863-4a4b-b975-48c9ebb0b087 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:53:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:53:59 user nova-compute[73056]:   <uuid>6910e1fe-8863-4a4b-b975-48c9ebb0b087</uuid>
Aug 14 16:53:59 user nova-compute[73056]:   <name>instance-00000021</name>
Aug 14 16:53:59 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:53:59 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:53:59 user nova-compute[73056]:   <metadata>
Aug 14 16:53:59 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:53:59 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:53:59 user nova-compute[73056]:       <nova:name>tempest-TestShelveInstance-server-717451743</nova:name>
Aug 14 16:53:59 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:53:57</nova:creationTime>
Aug 14 16:53:59 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:53:59 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:53:59 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:53:59 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:53:59 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:53:59 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:53:59 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:53:59 user nova-compute[73056]:       <nova:owner>
Aug 14 16:53:59 user nova-compute[73056]:         <nova:user uuid="d586451958914503bac9c1fb5dedea9e">tempest-TestShelveInstance-559346633-project-member</nova:user>
Aug 14 16:53:59 user nova-compute[73056]:         <nova:project uuid="dcd21ca04890479e82483a51d05ba69b">tempest-TestShelveInstance-559346633</nova:project>
Aug 14 16:53:59 user nova-compute[73056]:       </nova:owner>
Aug 14 16:53:59 user nova-compute[73056]:       <nova:ports>
Aug 14 16:53:59 user nova-compute[73056]:         <nova:port uuid="9cdd486e-fc3e-4637-8958-eb7e065728fc">
Aug 14 16:53:59 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 16:53:59 user nova-compute[73056]:         </nova:port>
Aug 14 16:53:59 user nova-compute[73056]:       </nova:ports>
Aug 14 16:53:59 user nova-compute[73056]:     </nova:instance>
Aug 14 16:53:59 user nova-compute[73056]:   </metadata>
Aug 14 16:53:59 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:53:59 user nova-compute[73056]:     <system>
Aug 14 16:53:59 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:53:59 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:53:59 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:53:59 user nova-compute[73056]:       <entry name="serial">6910e1fe-8863-4a4b-b975-48c9ebb0b087</entry>
Aug 14 16:53:59 user nova-compute[73056]:       <entry name="uuid">6910e1fe-8863-4a4b-b975-48c9ebb0b087</entry>
Aug 14 16:53:59 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:53:59 user nova-compute[73056]:     </system>
Aug 14 16:53:59 user nova-compute[73056]:   </sysinfo>
Aug 14 16:53:59 user nova-compute[73056]:   <os>
Aug 14 16:53:59 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:53:59 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:53:59 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:53:59 user nova-compute[73056]:   </os>
Aug 14 16:53:59 user nova-compute[73056]:   <features>
Aug 14 16:53:59 user nova-compute[73056]:     <acpi/>
Aug 14 16:53:59 user nova-compute[73056]:     <apic/>
Aug 14 16:53:59 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:53:59 user nova-compute[73056]:   </features>
Aug 14 16:53:59 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:53:59 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:53:59 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:53:59 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:53:59 user nova-compute[73056]:   </clock>
Aug 14 16:53:59 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:53:59 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:53:59 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:53:59 user nova-compute[73056]:   </cpu>
Aug 14 16:53:59 user nova-compute[73056]:   <devices>
Aug 14 16:53:59 user nova-compute[73056]:     <disk type="block" device="disk">
Aug 14 16:53:59 user nova-compute[73056]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:53:59 user nova-compute[73056]:       <source dev="/dev/sdb"/>
Aug 14 16:53:59 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:53:59 user nova-compute[73056]:       <serial>5ee0e8f1-8f40-460f-98df-7326372dac7d</serial>
Aug 14 16:53:59 user nova-compute[73056]:     </disk>
Aug 14 16:53:59 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:53:59 user nova-compute[73056]:       <mac address="fa:16:3e:ef:51:62"/>
Aug 14 16:53:59 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:53:59 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:53:59 user nova-compute[73056]:       <target dev="tap9cdd486e-fc"/>
Aug 14 16:53:59 user nova-compute[73056]:     </interface>
Aug 14 16:53:59 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:53:59 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/6910e1fe-8863-4a4b-b975-48c9ebb0b087/console.log" append="off"/>
Aug 14 16:53:59 user nova-compute[73056]:     </serial>
Aug 14 16:53:59 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:53:59 user nova-compute[73056]:     <video>
Aug 14 16:53:59 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:53:59 user nova-compute[73056]:     </video>
Aug 14 16:53:59 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:53:59 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:53:59 user nova-compute[73056]:     </rng>
Aug 14 16:53:59 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:53:59 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:53:59 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:53:59 user nova-compute[73056]:     </memballoon>
Aug 14 16:53:59 user nova-compute[73056]:   </devices>
Aug 14 16:53:59 user nova-compute[73056]: </domain>
Aug 14 16:53:59 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:53:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T16:50:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-717451743',display_name='tempest-TestShelveInstance-server-717451743',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-717451743',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1292582580',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:50:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='dcd21ca04890479e82483a51d05ba69b',ramdisk_id='',reservation_id='r-288qfle8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-559346633',owner_user_name='tempest-TestShelveInstance-559346633-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:53:47Z,user_data=None,user_id='d586451958914503bac9c1fb5dedea9e',uuid=6910e1fe-8863-4a4b-b975-48c9ebb0b087,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "address": "fa:16:3e:ef:51:62", "network": {"id": "73253aa9-a146-4f82-b5bb-1cc2dc68755c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1632478330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd21ca04890479e82483a51d05ba69b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cdd486e-fc", "ovs_interfaceid": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:53:59 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Converting VIF {"id": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "address": "fa:16:3e:ef:51:62", "network": {"id": "73253aa9-a146-4f82-b5bb-1cc2dc68755c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1632478330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd21ca04890479e82483a51d05ba69b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cdd486e-fc", "ovs_interfaceid": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:53:59 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:51:62,bridge_name='br-int',has_traffic_filtering=True,id=9cdd486e-fc3e-4637-8958-eb7e065728fc,network=Network(73253aa9-a146-4f82-b5bb-1cc2dc68755c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cdd486e-fc') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:53:59 user nova-compute[73056]: DEBUG os_vif [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:51:62,bridge_name='br-int',has_traffic_filtering=True,id=9cdd486e-fc3e-4637-8958-eb7e065728fc,network=Network(73253aa9-a146-4f82-b5bb-1cc2dc68755c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cdd486e-fc') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:53:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:53:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:53:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9cdd486e-fc, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:53:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9cdd486e-fc, col_values=(('external_ids', {'iface-id': '9cdd486e-fc3e-4637-8958-eb7e065728fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:51:62', 'vm-uuid': '6910e1fe-8863-4a4b-b975-48c9ebb0b087'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:53:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:53:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:53:59 user nova-compute[73056]: INFO os_vif [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:51:62,bridge_name='br-int',has_traffic_filtering=True,id=9cdd486e-fc3e-4637-8958-eb7e065728fc,network=Network(73253aa9-a146-4f82-b5bb-1cc2dc68755c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cdd486e-fc')
Aug 14 16:53:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:53:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] No VIF found with MAC fa:16:3e:ef:51:62, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:54:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:00 user nova-compute[73056]: DEBUG nova.compute.manager [req-495c9516-a966-4e17-9f6b-a29e7c32b7c5 req-fbc28325-4183-47dc-9378-04f801209b21 service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Received event network-vif-plugged-9cdd486e-fc3e-4637-8958-eb7e065728fc {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:54:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-495c9516-a966-4e17-9f6b-a29e7c32b7c5 req-fbc28325-4183-47dc-9378-04f801209b21 service nova] Acquiring lock "6910e1fe-8863-4a4b-b975-48c9ebb0b087-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:54:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-495c9516-a966-4e17-9f6b-a29e7c32b7c5 req-fbc28325-4183-47dc-9378-04f801209b21 service nova] Lock "6910e1fe-8863-4a4b-b975-48c9ebb0b087-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:54:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-495c9516-a966-4e17-9f6b-a29e7c32b7c5 req-fbc28325-4183-47dc-9378-04f801209b21 service nova] Lock "6910e1fe-8863-4a4b-b975-48c9ebb0b087-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:54:00 user nova-compute[73056]: DEBUG nova.compute.manager [req-495c9516-a966-4e17-9f6b-a29e7c32b7c5 req-fbc28325-4183-47dc-9378-04f801209b21 service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] No waiting events found dispatching network-vif-plugged-9cdd486e-fc3e-4637-8958-eb7e065728fc {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:54:00 user nova-compute[73056]: WARNING nova.compute.manager [req-495c9516-a966-4e17-9f6b-a29e7c32b7c5 req-fbc28325-4183-47dc-9378-04f801209b21 service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Received unexpected event network-vif-plugged-9cdd486e-fc3e-4637-8958-eb7e065728fc for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 16:54:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:02 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692032042.822814, 6910e1fe-8863-4a4b-b975-48c9ebb0b087 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:54:02 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] VM Resumed (Lifecycle Event)
Aug 14 16:54:02 user nova-compute[73056]: DEBUG nova.compute.manager [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:54:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:54:02 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Instance spawned successfully.
Aug 14 16:54:02 user nova-compute[73056]: DEBUG nova.compute.manager [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:54:02 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:54:02 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:54:02 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:54:02 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692032042.823973, 6910e1fe-8863-4a4b-b975-48c9ebb0b087 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:54:02 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] VM Started (Lifecycle Event)
Aug 14 16:54:02 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:54:02 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:54:02 user nova-compute[73056]: DEBUG nova.compute.manager [req-991e3940-7775-476a-9ede-11f438f34530 req-41f90e06-d20d-4906-98ec-3f170e7f2cc8 service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Received event network-vif-plugged-9cdd486e-fc3e-4637-8958-eb7e065728fc {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:54:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-991e3940-7775-476a-9ede-11f438f34530 req-41f90e06-d20d-4906-98ec-3f170e7f2cc8 service nova] Acquiring lock "6910e1fe-8863-4a4b-b975-48c9ebb0b087-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:54:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-991e3940-7775-476a-9ede-11f438f34530 req-41f90e06-d20d-4906-98ec-3f170e7f2cc8 service nova] Lock "6910e1fe-8863-4a4b-b975-48c9ebb0b087-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:54:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-991e3940-7775-476a-9ede-11f438f34530 req-41f90e06-d20d-4906-98ec-3f170e7f2cc8 service nova] Lock "6910e1fe-8863-4a4b-b975-48c9ebb0b087-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:54:02 user nova-compute[73056]: DEBUG nova.compute.manager [req-991e3940-7775-476a-9ede-11f438f34530 req-41f90e06-d20d-4906-98ec-3f170e7f2cc8 service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] No waiting events found dispatching network-vif-plugged-9cdd486e-fc3e-4637-8958-eb7e065728fc {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:54:02 user nova-compute[73056]: WARNING nova.compute.manager [req-991e3940-7775-476a-9ede-11f438f34530 req-41f90e06-d20d-4906-98ec-3f170e7f2cc8 service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Received unexpected event network-vif-plugged-9cdd486e-fc3e-4637-8958-eb7e065728fc for instance with vm_state active and task_state None.
Aug 14 16:54:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fda05bf5-709b-4917-a555-689ef2e2f5f0 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lock "6910e1fe-8863-4a4b-b975-48c9ebb0b087" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.818s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:54:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:03 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:54:04 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:54:04 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:54:04 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 16:54:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-92c34cf0-fd39-49fc-9244-4da8ccae6eec" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:54:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-92c34cf0-fd39-49fc-9244-4da8ccae6eec" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:54:04 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 16:54:05 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Updating instance_info_cache with network_info: [{"id": "2a57f016-2b33-46f4-a885-51c4ac8658bb", "address": "fa:16:3e:11:b2:3a", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a57f016-2b", "ovs_interfaceid": "2a57f016-2b33-46f4-a885-51c4ac8658bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:54:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-92c34cf0-fd39-49fc-9244-4da8ccae6eec" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:54:05 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 16:54:05 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:54:05 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:54:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:54:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:54:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:54:05 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 16:54:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/122c6152-2360-448b-b8e6-6d86bc736500/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/122c6152-2360-448b-b8e6-6d86bc736500/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/122c6152-2360-448b-b8e6-6d86bc736500/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/122c6152-2360-448b-b8e6-6d86bc736500/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:06 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:54:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:07 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:54:07 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:54:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:08 user nova-compute[73056]: DEBUG nova.compute.manager [req-0148bc27-32fd-4aa7-bc5f-94b6d5e64f83 req-89abeedc-8be2-40e9-94d7-4996963d0d77 service nova] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Received event network-changed-94165c29-4578-453b-aa55-f9440d4ae07c {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:54:08 user nova-compute[73056]: DEBUG nova.compute.manager [req-0148bc27-32fd-4aa7-bc5f-94b6d5e64f83 req-89abeedc-8be2-40e9-94d7-4996963d0d77 service nova] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Refreshing instance network info cache due to event network-changed-94165c29-4578-453b-aa55-f9440d4ae07c. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:54:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0148bc27-32fd-4aa7-bc5f-94b6d5e64f83 req-89abeedc-8be2-40e9-94d7-4996963d0d77 service nova] Acquiring lock "refresh_cache-122c6152-2360-448b-b8e6-6d86bc736500" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:54:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0148bc27-32fd-4aa7-bc5f-94b6d5e64f83 req-89abeedc-8be2-40e9-94d7-4996963d0d77 service nova] Acquired lock "refresh_cache-122c6152-2360-448b-b8e6-6d86bc736500" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:54:08 user nova-compute[73056]: DEBUG nova.network.neutron [req-0148bc27-32fd-4aa7-bc5f-94b6d5e64f83 req-89abeedc-8be2-40e9-94d7-4996963d0d77 service nova] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Refreshing network info cache for port 94165c29-4578-453b-aa55-f9440d4ae07c {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:54:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35f86ec-62d5-4c4d-a259-902e95aeb9d0/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35f86ec-62d5-4c4d-a259-902e95aeb9d0/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35f86ec-62d5-4c4d-a259-902e95aeb9d0/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c35f86ec-62d5-4c4d-a259-902e95aeb9d0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:08 user nova-compute[73056]: DEBUG nova.network.neutron [req-0148bc27-32fd-4aa7-bc5f-94b6d5e64f83 req-89abeedc-8be2-40e9-94d7-4996963d0d77 service nova] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Updated VIF entry in instance network info cache for port 94165c29-4578-453b-aa55-f9440d4ae07c. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:54:08 user nova-compute[73056]: DEBUG nova.network.neutron [req-0148bc27-32fd-4aa7-bc5f-94b6d5e64f83 req-89abeedc-8be2-40e9-94d7-4996963d0d77 service nova] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Updating instance_info_cache with network_info: [{"id": "94165c29-4578-453b-aa55-f9440d4ae07c", "address": "fa:16:3e:88:c9:e1", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94165c29-45", "ovs_interfaceid": "94165c29-4578-453b-aa55-f9440d4ae07c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:54:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json" returned: 0 in 0.275s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0148bc27-32fd-4aa7-bc5f-94b6d5e64f83 req-89abeedc-8be2-40e9-94d7-4996963d0d77 service nova] Releasing lock "refresh_cache-122c6152-2360-448b-b8e6-6d86bc736500" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:54:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee670695-1123-4d95-a7ad-ac79f9a4c16e/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee670695-1123-4d95-a7ad-ac79f9a4c16e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee670695-1123-4d95-a7ad-ac79f9a4c16e/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee670695-1123-4d95-a7ad-ac79f9a4c16e/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:10 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:54:10 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:54:10 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=7222MB free_disk=25.141963958740234GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 16:54:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:54:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:54:10 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 9f3a7f8a-e3b9-4918-9663-968677fe5c90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:54:10 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance b580e3d0-88b5-42a3-a953-84b94c088f41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:54:10 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 92c34cf0-fd39-49fc-9244-4da8ccae6eec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:54:10 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 61357ac0-230f-4711-8954-0bb04bfcb2f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:54:10 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance c35f86ec-62d5-4c4d-a259-902e95aeb9d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:54:10 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance ee670695-1123-4d95-a7ad-ac79f9a4c16e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:54:10 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 122c6152-2360-448b-b8e6-6d86bc736500 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:54:10 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 5914b70b-665a-4ce0-ab4e-11db2b8bc057 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:54:10 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:54:10 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance bcbe7449-6199-4e86-a8b6-c075e142aa34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:54:10 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 6910e1fe-8863-4a4b-b975-48c9ebb0b087 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:54:10 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 16:54:10 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 16:54:10 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:54:10 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:54:11 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 16:54:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.477s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:54:11 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:54:11 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:54:11 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:54:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "122c6152-2360-448b-b8e6-6d86bc736500" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:54:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "122c6152-2360-448b-b8e6-6d86bc736500" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:54:11 user nova-compute[73056]: DEBUG nova.objects.instance [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lazy-loading 'flavor' on Instance uuid 122c6152-2360-448b-b8e6-6d86bc736500 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:54:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "122c6152-2360-448b-b8e6-6d86bc736500" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:54:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "122c6152-2360-448b-b8e6-6d86bc736500" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:54:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "122c6152-2360-448b-b8e6-6d86bc736500" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:54:11 user nova-compute[73056]: INFO nova.compute.manager [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Attaching volume 49058ecf-c907-4b1e-b490-b60a4a789035 to /dev/vdb
Aug 14 16:54:11 user nova-compute[73056]: DEBUG os_brick.utils [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:54:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:12 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4adb5e3-b5f5-4ecb-95e5-8e22c83c43e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:12 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd18c7a0-3ac0-4d75-8086-6fae2bbabd3a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:12 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd22bd6a-e2d4-407b-b2d3-694a3557d1e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:12 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae3677e-c517-4b4f-abdc-b888843004b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:54:12 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:54:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:54:12 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:54:12 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[819ea678-32d3-409a-b7cc-f588c404d697]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:12 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:54:12 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:54:12 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:54:12 user nova-compute[73056]: DEBUG os_brick.utils [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:54:12 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Updating existing volume attachment record: 3b0baf4b-0760-42ca-97df-78c57fae65a1 {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 16:54:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:14 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:15 user nova-compute[73056]: DEBUG nova.compute.manager [req-9b655642-12e4-46b7-b2e5-ddc2fdb8209a req-2f49bc42-e61c-4755-8d54-acd872dbebf1 service nova] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Received event network-changed-b83d80a5-3a19-412c-8d6b-89cb7f93c682 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:54:15 user nova-compute[73056]: DEBUG nova.compute.manager [req-9b655642-12e4-46b7-b2e5-ddc2fdb8209a req-2f49bc42-e61c-4755-8d54-acd872dbebf1 service nova] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Refreshing instance network info cache due to event network-changed-b83d80a5-3a19-412c-8d6b-89cb7f93c682. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:54:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9b655642-12e4-46b7-b2e5-ddc2fdb8209a req-2f49bc42-e61c-4755-8d54-acd872dbebf1 service nova] Acquiring lock "refresh_cache-c35f86ec-62d5-4c4d-a259-902e95aeb9d0" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:54:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9b655642-12e4-46b7-b2e5-ddc2fdb8209a req-2f49bc42-e61c-4755-8d54-acd872dbebf1 service nova] Acquired lock "refresh_cache-c35f86ec-62d5-4c4d-a259-902e95aeb9d0" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:54:15 user nova-compute[73056]: DEBUG nova.network.neutron [req-9b655642-12e4-46b7-b2e5-ddc2fdb8209a req-2f49bc42-e61c-4755-8d54-acd872dbebf1 service nova] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Refreshing network info cache for port b83d80a5-3a19-412c-8d6b-89cb7f93c682 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:54:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b5bd69bc-82fe-49bd-be3b-7b81be8d5881 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Acquiring lock "c35f86ec-62d5-4c4d-a259-902e95aeb9d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:54:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b5bd69bc-82fe-49bd-be3b-7b81be8d5881 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "c35f86ec-62d5-4c4d-a259-902e95aeb9d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:54:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b5bd69bc-82fe-49bd-be3b-7b81be8d5881 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Acquiring lock "c35f86ec-62d5-4c4d-a259-902e95aeb9d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:54:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b5bd69bc-82fe-49bd-be3b-7b81be8d5881 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "c35f86ec-62d5-4c4d-a259-902e95aeb9d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:54:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b5bd69bc-82fe-49bd-be3b-7b81be8d5881 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "c35f86ec-62d5-4c4d-a259-902e95aeb9d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:54:15 user nova-compute[73056]: INFO nova.compute.manager [None req-b5bd69bc-82fe-49bd-be3b-7b81be8d5881 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Terminating instance
Aug 14 16:54:15 user nova-compute[73056]: DEBUG nova.compute.manager [None req-b5bd69bc-82fe-49bd-be3b-7b81be8d5881 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 16:54:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:15 user nova-compute[73056]: DEBUG nova.compute.manager [req-57918f51-b563-4c7f-ab78-0ade98d44dc6 req-f5a87f31-cfd2-4d30-a4f4-652c5d7adaa4 service nova] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Received event network-vif-unplugged-b83d80a5-3a19-412c-8d6b-89cb7f93c682 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:54:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-57918f51-b563-4c7f-ab78-0ade98d44dc6 req-f5a87f31-cfd2-4d30-a4f4-652c5d7adaa4 service nova] Acquiring lock "c35f86ec-62d5-4c4d-a259-902e95aeb9d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:54:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-57918f51-b563-4c7f-ab78-0ade98d44dc6 req-f5a87f31-cfd2-4d30-a4f4-652c5d7adaa4 service nova] Lock "c35f86ec-62d5-4c4d-a259-902e95aeb9d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:54:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-57918f51-b563-4c7f-ab78-0ade98d44dc6 req-f5a87f31-cfd2-4d30-a4f4-652c5d7adaa4 service nova] Lock "c35f86ec-62d5-4c4d-a259-902e95aeb9d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:54:15 user nova-compute[73056]: DEBUG nova.compute.manager [req-57918f51-b563-4c7f-ab78-0ade98d44dc6 req-f5a87f31-cfd2-4d30-a4f4-652c5d7adaa4 service nova] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] No waiting events found dispatching network-vif-unplugged-b83d80a5-3a19-412c-8d6b-89cb7f93c682 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:54:15 user nova-compute[73056]: DEBUG nova.compute.manager [req-57918f51-b563-4c7f-ab78-0ade98d44dc6 req-f5a87f31-cfd2-4d30-a4f4-652c5d7adaa4 service nova] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Received event network-vif-unplugged-b83d80a5-3a19-412c-8d6b-89cb7f93c682 for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:54:16 user nova-compute[73056]: DEBUG nova.network.neutron [req-9b655642-12e4-46b7-b2e5-ddc2fdb8209a req-2f49bc42-e61c-4755-8d54-acd872dbebf1 service nova] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Updated VIF entry in instance network info cache for port b83d80a5-3a19-412c-8d6b-89cb7f93c682. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:54:16 user nova-compute[73056]: DEBUG nova.network.neutron [req-9b655642-12e4-46b7-b2e5-ddc2fdb8209a req-2f49bc42-e61c-4755-8d54-acd872dbebf1 service nova] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Updating instance_info_cache with network_info: [{"id": "b83d80a5-3a19-412c-8d6b-89cb7f93c682", "address": "fa:16:3e:d6:de:25", "network": {"id": "c2b49cd1-a248-4bd2-924f-bd8b560aed47", "bridge": "br-int", "label": "tempest-TestStampPattern-1795667966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d796c14bd3489883e161ea1b311ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb83d80a5-3a", "ovs_interfaceid": "b83d80a5-3a19-412c-8d6b-89cb7f93c682", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:54:16 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Instance destroyed successfully.
Aug 14 16:54:16 user nova-compute[73056]: DEBUG nova.objects.instance [None req-b5bd69bc-82fe-49bd-be3b-7b81be8d5881 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lazy-loading 'resources' on Instance uuid c35f86ec-62d5-4c4d-a259-902e95aeb9d0 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:54:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9b655642-12e4-46b7-b2e5-ddc2fdb8209a req-2f49bc42-e61c-4755-8d54-acd872dbebf1 service nova] Releasing lock "refresh_cache-c35f86ec-62d5-4c4d-a259-902e95aeb9d0" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:54:16 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-b5bd69bc-82fe-49bd-be3b-7b81be8d5881 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:51:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1316551467',display_name='tempest-TestStampPattern-server-1316551467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1316551467',id=34,image_ref='445ac98e-6c98-4e6f-81b3-13b66d4c31a2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1L8q/UE/lP/2VxMJW4uvrcAleicidYPp3XEOqORx+N0k8ZiuhpRRdaAVC38mPfWQU7Ahb0+HsQ9477x/V7V9afEg8xu6rOrZVCKgLaCY5Gqr1Mn3uZleqqMyDV507BJw==',key_name='tempest-TestStampPattern-2127629561',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:51:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2d796c14bd3489883e161ea1b311ca5',ramdisk_id='',reservation_id='r-2fgyvgrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='61357ac0-230f-4711-8954-0bb04bfcb2f6',image_min_disk='1',image_min_ram='0',image_owner_id='d2d796c14bd3489883e161ea1b311ca5',image_owner_project_name='tempest-TestStampPattern-1217754811',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1217754811-project-member',image_user_id='18edcf10dda041c8a2bde2fb231b4fde',owner_project_name='tempest-TestStampPattern-1217754811',owner_user_name='tempest-TestStampPattern-1217754811-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:51:17Z,user_data=None,user_id='18edcf10dda041c8a2bde2fb231b4fde',uuid=c35f86ec-62d5-4c4d-a259-902e95aeb9d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b83d80a5-3a19-412c-8d6b-89cb7f93c682", "address": "fa:16:3e:d6:de:25", "network": {"id": "c2b49cd1-a248-4bd2-924f-bd8b560aed47", "bridge": "br-int", "label": "tempest-TestStampPattern-1795667966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d796c14bd3489883e161ea1b311ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb83d80a5-3a", "ovs_interfaceid": "b83d80a5-3a19-412c-8d6b-89cb7f93c682", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:54:16 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-b5bd69bc-82fe-49bd-be3b-7b81be8d5881 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Converting VIF {"id": "b83d80a5-3a19-412c-8d6b-89cb7f93c682", "address": "fa:16:3e:d6:de:25", "network": {"id": "c2b49cd1-a248-4bd2-924f-bd8b560aed47", "bridge": "br-int", "label": "tempest-TestStampPattern-1795667966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d796c14bd3489883e161ea1b311ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb83d80a5-3a", "ovs_interfaceid": "b83d80a5-3a19-412c-8d6b-89cb7f93c682", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:54:16 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-b5bd69bc-82fe-49bd-be3b-7b81be8d5881 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:de:25,bridge_name='br-int',has_traffic_filtering=True,id=b83d80a5-3a19-412c-8d6b-89cb7f93c682,network=Network(c2b49cd1-a248-4bd2-924f-bd8b560aed47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb83d80a5-3a') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:54:16 user nova-compute[73056]: DEBUG os_vif [None req-b5bd69bc-82fe-49bd-be3b-7b81be8d5881 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:de:25,bridge_name='br-int',has_traffic_filtering=True,id=b83d80a5-3a19-412c-8d6b-89cb7f93c682,network=Network(c2b49cd1-a248-4bd2-924f-bd8b560aed47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb83d80a5-3a') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:54:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb83d80a5-3a, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:54:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:54:16 user nova-compute[73056]: INFO os_vif [None req-b5bd69bc-82fe-49bd-be3b-7b81be8d5881 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:de:25,bridge_name='br-int',has_traffic_filtering=True,id=b83d80a5-3a19-412c-8d6b-89cb7f93c682,network=Network(c2b49cd1-a248-4bd2-924f-bd8b560aed47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb83d80a5-3a')
Aug 14 16:54:16 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-b5bd69bc-82fe-49bd-be3b-7b81be8d5881 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Deleting instance files /opt/stack/data/nova/instances/c35f86ec-62d5-4c4d-a259-902e95aeb9d0_del
Aug 14 16:54:16 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-b5bd69bc-82fe-49bd-be3b-7b81be8d5881 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Deletion of /opt/stack/data/nova/instances/c35f86ec-62d5-4c4d-a259-902e95aeb9d0_del complete
Aug 14 16:54:16 user nova-compute[73056]: INFO nova.compute.manager [None req-b5bd69bc-82fe-49bd-be3b-7b81be8d5881 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 14 16:54:16 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-b5bd69bc-82fe-49bd-be3b-7b81be8d5881 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 16:54:16 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 16:54:16 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 16:54:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:16 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:54:16 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Took 0.69 seconds to deallocate network for instance.
Aug 14 16:54:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b5bd69bc-82fe-49bd-be3b-7b81be8d5881 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:54:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b5bd69bc-82fe-49bd-be3b-7b81be8d5881 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:54:17 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-b5bd69bc-82fe-49bd-be3b-7b81be8d5881 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:54:17 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-b5bd69bc-82fe-49bd-be3b-7b81be8d5881 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:54:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b5bd69bc-82fe-49bd-be3b-7b81be8d5881 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:54:17 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-b5bd69bc-82fe-49bd-be3b-7b81be8d5881 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Deleted allocations for instance c35f86ec-62d5-4c4d-a259-902e95aeb9d0
Aug 14 16:54:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-b5bd69bc-82fe-49bd-be3b-7b81be8d5881 tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "c35f86ec-62d5-4c4d-a259-902e95aeb9d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.127s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:54:18 user nova-compute[73056]: DEBUG nova.compute.manager [req-3ed75571-da67-4f54-8e16-62efaede0455 req-7af3b149-3a3a-45a0-8860-b71cd1183e8b service nova] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Received event network-vif-plugged-b83d80a5-3a19-412c-8d6b-89cb7f93c682 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:54:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3ed75571-da67-4f54-8e16-62efaede0455 req-7af3b149-3a3a-45a0-8860-b71cd1183e8b service nova] Acquiring lock "c35f86ec-62d5-4c4d-a259-902e95aeb9d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:54:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3ed75571-da67-4f54-8e16-62efaede0455 req-7af3b149-3a3a-45a0-8860-b71cd1183e8b service nova] Lock "c35f86ec-62d5-4c4d-a259-902e95aeb9d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:54:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3ed75571-da67-4f54-8e16-62efaede0455 req-7af3b149-3a3a-45a0-8860-b71cd1183e8b service nova] Lock "c35f86ec-62d5-4c4d-a259-902e95aeb9d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:54:18 user nova-compute[73056]: DEBUG nova.compute.manager [req-3ed75571-da67-4f54-8e16-62efaede0455 req-7af3b149-3a3a-45a0-8860-b71cd1183e8b service nova] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] No waiting events found dispatching network-vif-plugged-b83d80a5-3a19-412c-8d6b-89cb7f93c682 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:54:18 user nova-compute[73056]: WARNING nova.compute.manager [req-3ed75571-da67-4f54-8e16-62efaede0455 req-7af3b149-3a3a-45a0-8860-b71cd1183e8b service nova] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Received unexpected event network-vif-plugged-b83d80a5-3a19-412c-8d6b-89cb7f93c682 for instance with vm_state deleted and task_state None.
Aug 14 16:54:18 user nova-compute[73056]: DEBUG nova.compute.manager [req-3ed75571-da67-4f54-8e16-62efaede0455 req-7af3b149-3a3a-45a0-8860-b71cd1183e8b service nova] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Received event network-vif-deleted-b83d80a5-3a19-412c-8d6b-89cb7f93c682 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:54:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:19 user nova-compute[73056]: DEBUG nova.compute.manager [req-4c3d21c9-0c45-4d00-849b-6e83e491a21e req-48efecad-f4a5-4c95-8c9a-29119deba7b8 service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Received event network-changed-c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:54:19 user nova-compute[73056]: DEBUG nova.compute.manager [req-4c3d21c9-0c45-4d00-849b-6e83e491a21e req-48efecad-f4a5-4c95-8c9a-29119deba7b8 service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Refreshing instance network info cache due to event network-changed-c9eb236b-5c65-4108-9527-dbf9550cf01f. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:54:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4c3d21c9-0c45-4d00-849b-6e83e491a21e req-48efecad-f4a5-4c95-8c9a-29119deba7b8 service nova] Acquiring lock "refresh_cache-5914b70b-665a-4ce0-ab4e-11db2b8bc057" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:54:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4c3d21c9-0c45-4d00-849b-6e83e491a21e req-48efecad-f4a5-4c95-8c9a-29119deba7b8 service nova] Acquired lock "refresh_cache-5914b70b-665a-4ce0-ab4e-11db2b8bc057" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:54:19 user nova-compute[73056]: DEBUG nova.network.neutron [req-4c3d21c9-0c45-4d00-849b-6e83e491a21e req-48efecad-f4a5-4c95-8c9a-29119deba7b8 service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Refreshing network info cache for port c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:54:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:54:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:54:19 user nova-compute[73056]: DEBUG nova.objects.instance [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lazy-loading 'flavor' on Instance uuid 5914b70b-665a-4ce0-ab4e-11db2b8bc057 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:54:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:54:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:54:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:54:19 user nova-compute[73056]: INFO nova.compute.manager [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Attaching volume 82d8a96b-6b13-4960-8883-d6b8e274cd3f to /dev/vdb
Aug 14 16:54:19 user nova-compute[73056]: DEBUG os_brick.utils [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:54:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:19 user nova-compute[73056]: DEBUG nova.network.neutron [req-4c3d21c9-0c45-4d00-849b-6e83e491a21e req-48efecad-f4a5-4c95-8c9a-29119deba7b8 service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Updated VIF entry in instance network info cache for port c9eb236b-5c65-4108-9527-dbf9550cf01f. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:54:19 user nova-compute[73056]: DEBUG nova.network.neutron [req-4c3d21c9-0c45-4d00-849b-6e83e491a21e req-48efecad-f4a5-4c95-8c9a-29119deba7b8 service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Updating instance_info_cache with network_info: [{"id": "c9eb236b-5c65-4108-9527-dbf9550cf01f", "address": "fa:16:3e:af:d2:e8", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9eb236b-5c", "ovs_interfaceid": "c9eb236b-5c65-4108-9527-dbf9550cf01f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:54:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:19 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc703fb-0756-45f1-9f34-fc89dcb2eb1c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4c3d21c9-0c45-4d00-849b-6e83e491a21e req-48efecad-f4a5-4c95-8c9a-29119deba7b8 service nova] Releasing lock "refresh_cache-5914b70b-665a-4ce0-ab4e-11db2b8bc057" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:54:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:19 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[225207c5-514a-45ac-968b-874c59783ad8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:19 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aef62b3-51e9-4a20-af0b-f112c0c95d0a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:19 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[23512258-ea30-41fb-9d62-8b5bc7e338eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:54:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:54:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:54:19 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:54:19 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[581580a8-22bd-4dd5-ac03-cd20b98f211c]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:54:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:54:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:54:19 user nova-compute[73056]: DEBUG os_brick.utils [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:54:19 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Updating existing volume attachment record: 3ffcea1a-2f8b-41a8-98d3-a51a0e9f5706 {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hRdKAjFi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:54:21 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:54:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:54:21 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:54:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:54:21 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:54:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035 -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b53c659-c567-4986-9804-2b463c5474b0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:54:21 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035 -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b6a8ea-29da-4cd6-98a4-5b9f9689cbf0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035] added
Aug 14 16:54:21 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddc3273-5ef6-4ae6-a872-2cd3179b6e60]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca39cc3d-bed1-4a8e-a2c4-11636fb8b2d0]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hRdKAjFi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hRdKAjFi" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8fec30-f65f-48b9-b4f3-e7c1e6786486]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hRdKAjFi'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ede7972-b053-4b6f-a90e-856a0caf7ac3]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff3b78c-a9ca-42d5-bdad-338ced8bc531]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:54:21 user nova-compute[73056]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 (non-flash)
Aug 14 16:54:21 user nova-compute[73056]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)
Aug 14 16:54:21 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:54:21 user nova-compute[73056]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 (non-flash)
Aug 14 16:54:21 user nova-compute[73056]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)
Aug 14 16:54:21 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035 -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9675f89-4198-45c3-a5c7-a6c5233b527c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035, portal: 172.16.0.220,3260]
Aug 14 16:54:21 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035, portal: 172.16.0.220,3260] successful.
Aug 14 16:54:21 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f69b799-5221-46d5-ac1e-c4655e6cfb1c]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f06ef8-e07c-466f-9827-b58013e25041]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:54:21 user nova-compute[73056]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 (non-flash)
Aug 14 16:54:21 user nova-compute[73056]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)
Aug 14 16:54:21 user nova-compute[73056]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035 (non-flash)
Aug 14 16:54:21 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:54:21 user nova-compute[73056]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 (non-flash)
Aug 14 16:54:21 user nova-compute[73056]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)
Aug 14 16:54:21 user nova-compute[73056]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035 (non-flash)
Aug 14 16:54:21 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[370ebfd8-d400-4a70-8823-f879943eec2d]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:54:21 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hRdKAjFi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:54:22 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:54:22 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '23935333838333362', 'path': '/dev/sdd'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:54:22 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935333838333362', 'path': '/dev/sdd'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:54:22 user nova-compute[73056]: DEBUG nova.objects.instance [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lazy-loading 'flavor' on Instance uuid 122c6152-2360-448b-b8e6-6d86bc736500 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:54:22 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 16:54:22 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:54:22 user nova-compute[73056]:   <source dev="/dev/sdd"/>
Aug 14 16:54:22 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:54:22 user nova-compute[73056]:   <serial>49058ecf-c907-4b1e-b490-b60a4a789035</serial>
Aug 14 16:54:22 user nova-compute[73056]: </disk>
Aug 14 16:54:22 user nova-compute[73056]:  {{(pid=73056) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 16:54:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c905e39d-705a-45de-9578-e1dbeaaeef4e tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "9f3a7f8a-e3b9-4918-9663-968677fe5c90" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:54:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c905e39d-705a-45de-9578-e1dbeaaeef4e tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "9f3a7f8a-e3b9-4918-9663-968677fe5c90" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:54:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c905e39d-705a-45de-9578-e1dbeaaeef4e tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "9f3a7f8a-e3b9-4918-9663-968677fe5c90-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:54:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c905e39d-705a-45de-9578-e1dbeaaeef4e tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "9f3a7f8a-e3b9-4918-9663-968677fe5c90-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:54:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c905e39d-705a-45de-9578-e1dbeaaeef4e tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "9f3a7f8a-e3b9-4918-9663-968677fe5c90-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:54:23 user nova-compute[73056]: INFO nova.compute.manager [None req-c905e39d-705a-45de-9578-e1dbeaaeef4e tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Terminating instance
Aug 14 16:54:23 user nova-compute[73056]: DEBUG nova.compute.manager [None req-c905e39d-705a-45de-9578-e1dbeaaeef4e tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 16:54:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:54:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:54:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] No VIF found with MAC fa:16:3e:88:c9:e1, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:54:23 user nova-compute[73056]: DEBUG nova.compute.manager [req-cb78f95f-3c96-47c3-a022-bc70f6d1f00e req-7a3d27b5-e4ec-4fec-8699-967ab0742739 service nova] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Received event network-vif-unplugged-312bec25-d19f-423b-aca3-a4117119fc1f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:54:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cb78f95f-3c96-47c3-a022-bc70f6d1f00e req-7a3d27b5-e4ec-4fec-8699-967ab0742739 service nova] Acquiring lock "9f3a7f8a-e3b9-4918-9663-968677fe5c90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:54:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cb78f95f-3c96-47c3-a022-bc70f6d1f00e req-7a3d27b5-e4ec-4fec-8699-967ab0742739 service nova] Lock "9f3a7f8a-e3b9-4918-9663-968677fe5c90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:54:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cb78f95f-3c96-47c3-a022-bc70f6d1f00e req-7a3d27b5-e4ec-4fec-8699-967ab0742739 service nova] Lock "9f3a7f8a-e3b9-4918-9663-968677fe5c90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:54:23 user nova-compute[73056]: DEBUG nova.compute.manager [req-cb78f95f-3c96-47c3-a022-bc70f6d1f00e req-7a3d27b5-e4ec-4fec-8699-967ab0742739 service nova] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] No waiting events found dispatching network-vif-unplugged-312bec25-d19f-423b-aca3-a4117119fc1f {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:54:23 user nova-compute[73056]: DEBUG nova.compute.manager [req-cb78f95f-3c96-47c3-a022-bc70f6d1f00e req-7a3d27b5-e4ec-4fec-8699-967ab0742739 service nova] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Received event network-vif-unplugged-312bec25-d19f-423b-aca3-a4117119fc1f for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:54:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-98256004-a53f-4e89-bcc1-5dd3c4d55036 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "122c6152-2360-448b-b8e6-6d86bc736500" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.602s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:54:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:23 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Instance destroyed successfully.
Aug 14 16:54:23 user nova-compute[73056]: DEBUG nova.objects.instance [None req-c905e39d-705a-45de-9578-e1dbeaaeef4e tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lazy-loading 'resources' on Instance uuid 9f3a7f8a-e3b9-4918-9663-968677fe5c90 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:54:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-c905e39d-705a-45de-9578-e1dbeaaeef4e tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:35:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1036814563',display_name='tempest-ServerActionsTestOtherA-server-1036814563',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1036814563',id=2,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDU6ne8W7YSxsWIOL2ltT8/3A4Lay+Fa3EBjGBahsu1+va9jX8aVIvfUTXS/QOiNmJPitbbWTrcI3+h3fj8j4zOwrNCeF7Pt0QIdwz/ogo81jcw9PMYL2yia/QSf+KeHhA==',key_name='tempest-keypair-1415046919',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:36:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2dd5723fb8384aa985cf401d95aa7d08',ramdisk_id='',reservation_id='r-aw7pyz1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-380813086',owner_user_name='tempest-ServerActionsTestOtherA-380813086-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:36:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9404ed7386e14eed8d046e8c45942c75',uuid=9f3a7f8a-e3b9-4918-9663-968677fe5c90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "312bec25-d19f-423b-aca3-a4117119fc1f", "address": "fa:16:3e:03:ce:11", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312bec25-d1", "ovs_interfaceid": "312bec25-d19f-423b-aca3-a4117119fc1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:54:23 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-c905e39d-705a-45de-9578-e1dbeaaeef4e tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Converting VIF {"id": "312bec25-d19f-423b-aca3-a4117119fc1f", "address": "fa:16:3e:03:ce:11", "network": {"id": "2c5f0d57-9485-4a0b-a847-49eea5cd17c1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-51574813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2dd5723fb8384aa985cf401d95aa7d08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312bec25-d1", "ovs_interfaceid": "312bec25-d19f-423b-aca3-a4117119fc1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:54:23 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-c905e39d-705a-45de-9578-e1dbeaaeef4e tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:ce:11,bridge_name='br-int',has_traffic_filtering=True,id=312bec25-d19f-423b-aca3-a4117119fc1f,network=Network(2c5f0d57-9485-4a0b-a847-49eea5cd17c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312bec25-d1') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:54:23 user nova-compute[73056]: DEBUG os_vif [None req-c905e39d-705a-45de-9578-e1dbeaaeef4e tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:ce:11,bridge_name='br-int',has_traffic_filtering=True,id=312bec25-d19f-423b-aca3-a4117119fc1f,network=Network(2c5f0d57-9485-4a0b-a847-49eea5cd17c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312bec25-d1') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:54:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap312bec25-d1, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:54:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:54:23 user nova-compute[73056]: INFO os_vif [None req-c905e39d-705a-45de-9578-e1dbeaaeef4e tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:ce:11,bridge_name='br-int',has_traffic_filtering=True,id=312bec25-d19f-423b-aca3-a4117119fc1f,network=Network(2c5f0d57-9485-4a0b-a847-49eea5cd17c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312bec25-d1')
Aug 14 16:54:23 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-c905e39d-705a-45de-9578-e1dbeaaeef4e tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Deleting instance files /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90_del
Aug 14 16:54:23 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-c905e39d-705a-45de-9578-e1dbeaaeef4e tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Deletion of /opt/stack/data/nova/instances/9f3a7f8a-e3b9-4918-9663-968677fe5c90_del complete
Aug 14 16:54:23 user nova-compute[73056]: INFO nova.compute.manager [None req-c905e39d-705a-45de-9578-e1dbeaaeef4e tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Took 0.72 seconds to destroy the instance on the hypervisor.
Aug 14 16:54:23 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-c905e39d-705a-45de-9578-e1dbeaaeef4e tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 16:54:23 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 16:54:23 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-e31243a9-2796-4905-865e-27dcaef8eaae tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "122c6152-2360-448b-b8e6-6d86bc736500" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-e31243a9-2796-4905-865e-27dcaef8eaae tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "122c6152-2360-448b-b8e6-6d86bc736500" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:54:24 user nova-compute[73056]: INFO nova.compute.manager [None req-e31243a9-2796-4905-865e-27dcaef8eaae tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Detaching volume 49058ecf-c907-4b1e-b490-b60a4a789035
Aug 14 16:54:24 user nova-compute[73056]: INFO nova.virt.block_device [None req-e31243a9-2796-4905-865e-27dcaef8eaae tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Attempting to driver detach volume 49058ecf-c907-4b1e-b490-b60a4a789035 from mountpoint /dev/vdb
Aug 14 16:54:24 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-e31243a9-2796-4905-865e-27dcaef8eaae tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Attempting to detach device vdb from instance 122c6152-2360-448b-b8e6-6d86bc736500 from the persistent domain config. {{(pid=73056) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-e31243a9-2796-4905-865e-27dcaef8eaae tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 16:54:24 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:54:24 user nova-compute[73056]:   <source dev="/dev/sdd"/>
Aug 14 16:54:24 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:54:24 user nova-compute[73056]:   <serial>49058ecf-c907-4b1e-b490-b60a4a789035</serial>
Aug 14 16:54:24 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 16:54:24 user nova-compute[73056]: </disk>
Aug 14 16:54:24 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 16:54:24 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-e31243a9-2796-4905-865e-27dcaef8eaae tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Successfully detached device vdb from instance 122c6152-2360-448b-b8e6-6d86bc736500 from the persistent domain config.
Aug 14 16:54:24 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-e31243a9-2796-4905-865e-27dcaef8eaae tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 122c6152-2360-448b-b8e6-6d86bc736500 from the live domain config. {{(pid=73056) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-e31243a9-2796-4905-865e-27dcaef8eaae tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 16:54:24 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:54:24 user nova-compute[73056]:   <source dev="/dev/sdd"/>
Aug 14 16:54:24 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:54:24 user nova-compute[73056]:   <serial>49058ecf-c907-4b1e-b490-b60a4a789035</serial>
Aug 14 16:54:24 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 16:54:24 user nova-compute[73056]: </disk>
Aug 14 16:54:24 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG nova.compute.manager [req-c561c45f-b586-4b8d-afef-97466a663a51 req-ba918870-5e15-4b05-b55c-31ab463d98cf service nova] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Received event network-vif-deleted-312bec25-d19f-423b-aca3-a4117119fc1f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:54:24 user nova-compute[73056]: INFO nova.compute.manager [req-c561c45f-b586-4b8d-afef-97466a663a51 req-ba918870-5e15-4b05-b55c-31ab463d98cf service nova] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Neutron deleted interface 312bec25-d19f-423b-aca3-a4117119fc1f; detaching it from the instance and deleting it from the info cache
Aug 14 16:54:24 user nova-compute[73056]: DEBUG nova.network.neutron [req-c561c45f-b586-4b8d-afef-97466a663a51 req-ba918870-5e15-4b05-b55c-31ab463d98cf service nova] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:54:24 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Took 0.78 seconds to deallocate network for instance.
Aug 14 16:54:24 user nova-compute[73056]: DEBUG nova.compute.manager [req-c561c45f-b586-4b8d-afef-97466a663a51 req-ba918870-5e15-4b05-b55c-31ab463d98cf service nova] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Detach interface failed, port_id=312bec25-d19f-423b-aca3-a4117119fc1f, reason: Instance 9f3a7f8a-e3b9-4918-9663-968677fe5c90 could not be found. {{(pid=73056) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c905e39d-705a-45de-9578-e1dbeaaeef4e tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c905e39d-705a-45de-9578-e1dbeaaeef4e tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Received event <DeviceRemovedEvent: 1692032064.7308197, 122c6152-2360-448b-b8e6-6d86bc736500 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73056) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-e31243a9-2796-4905-865e-27dcaef8eaae tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 122c6152-2360-448b-b8e6-6d86bc736500 {{(pid=73056) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 16:54:24 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-e31243a9-2796-4905-865e-27dcaef8eaae tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Successfully detached device vdb from instance 122c6152-2360-448b-b8e6-6d86bc736500 from the live domain config.
Aug 14 16:54:24 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e31243a9-2796-4905-865e-27dcaef8eaae tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-e31243a9-2796-4905-865e-27dcaef8eaae tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hRdKAjFi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:54:24 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-e31243a9-2796-4905-865e-27dcaef8eaae tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:54:24 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-e31243a9-2796-4905-865e-27dcaef8eaae tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-e31243a9-2796-4905-865e-27dcaef8eaae tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-e31243a9-2796-4905-865e-27dcaef8eaae tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[436a76e4-7d2b-4c9c-ba4a-c51d1aae35cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a6a124-b29d-4bfb-a308-e0dc05998945]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-e31243a9-2796-4905-865e-27dcaef8eaae tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:54:24 user nova-compute[73056]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 (non-flash)
Aug 14 16:54:24 user nova-compute[73056]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)
Aug 14 16:54:24 user nova-compute[73056]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035 (non-flash)
Aug 14 16:54:24 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-e31243a9-2796-4905-865e-27dcaef8eaae tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:54:24 user nova-compute[73056]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 (non-flash)
Aug 14 16:54:24 user nova-compute[73056]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)
Aug 14 16:54:24 user nova-compute[73056]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035 (non-flash)
Aug 14 16:54:24 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-e31243a9-2796-4905-865e-27dcaef8eaae tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff2dce449d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035'): ({'sdd'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-e31243a9-2796-4905-865e-27dcaef8eaae tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Removing single pathed devices sdd {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ceb501-c5bc-4000-8ae7-5084dcf74f65]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[81363362-9ab6-4e36-88f6-9a6214792bde]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-e31243a9-2796-4905-865e-27dcaef8eaae tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Flushing IO for device /dev/sdd {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce747784-85b9-4750-98f8-40a29b47851c]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-e31243a9-2796-4905-865e-27dcaef8eaae tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72db6b7-49f5-40e3-b60a-a678a9717ba7]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-e31243a9-2796-4905-865e-27dcaef8eaae tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-e31243a9-2796-4905-865e-27dcaef8eaae tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] SCSI volumes sdd have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-e31243a9-2796-4905-865e-27dcaef8eaae tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22fbcec-2b2e-4eb6-8856-573736068f4f]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-e31243a9-2796-4905-865e-27dcaef8eaae tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:54:24 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035 -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:25 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5a39b8-bb33-4dc7-bc20-22a924d2fcf5]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:25 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-e31243a9-2796-4905-865e-27dcaef8eaae tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035, portal: 172.16.0.220,3260]
Aug 14 16:54:25 user nova-compute[73056]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035, portal: 172.16.0.220,3260] successful.
Aug 14 16:54:25 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:54:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035 -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:25 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-c905e39d-705a-45de-9578-e1dbeaaeef4e tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:54:25 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-c905e39d-705a-45de-9578-e1dbeaaeef4e tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:54:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49058ecf-c907-4b1e-b490-b60a4a789035 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:25 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8e98ab-b1e7-4352-9348-c909742aabba]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:25 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-e31243a9-2796-4905-865e-27dcaef8eaae tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:54:25 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-e31243a9-2796-4905-865e-27dcaef8eaae tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:54:25 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-e31243a9-2796-4905-865e-27dcaef8eaae tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] <== disconnect_volume: return (306ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:54:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e31243a9-2796-4905-865e-27dcaef8eaae tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:54:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c905e39d-705a-45de-9578-e1dbeaaeef4e tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:54:25 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-c905e39d-705a-45de-9578-e1dbeaaeef4e tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Deleted allocations for instance 9f3a7f8a-e3b9-4918-9663-968677fe5c90
Aug 14 16:54:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c905e39d-705a-45de-9578-e1dbeaaeef4e tempest-ServerActionsTestOtherA-380813086 tempest-ServerActionsTestOtherA-380813086-project-member] Lock "9f3a7f8a-e3b9-4918-9663-968677fe5c90" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.052s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:54:25 user nova-compute[73056]: DEBUG nova.compute.manager [req-204709f8-9862-4bb7-b591-8fb790a7df28 req-07988805-226b-4e68-b4a5-5d4ceeea84b4 service nova] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Received event network-vif-plugged-312bec25-d19f-423b-aca3-a4117119fc1f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:54:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-204709f8-9862-4bb7-b591-8fb790a7df28 req-07988805-226b-4e68-b4a5-5d4ceeea84b4 service nova] Acquiring lock "9f3a7f8a-e3b9-4918-9663-968677fe5c90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:54:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-204709f8-9862-4bb7-b591-8fb790a7df28 req-07988805-226b-4e68-b4a5-5d4ceeea84b4 service nova] Lock "9f3a7f8a-e3b9-4918-9663-968677fe5c90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:54:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-204709f8-9862-4bb7-b591-8fb790a7df28 req-07988805-226b-4e68-b4a5-5d4ceeea84b4 service nova] Lock "9f3a7f8a-e3b9-4918-9663-968677fe5c90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:54:25 user nova-compute[73056]: DEBUG nova.compute.manager [req-204709f8-9862-4bb7-b591-8fb790a7df28 req-07988805-226b-4e68-b4a5-5d4ceeea84b4 service nova] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] No waiting events found dispatching network-vif-plugged-312bec25-d19f-423b-aca3-a4117119fc1f {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:54:25 user nova-compute[73056]: WARNING nova.compute.manager [req-204709f8-9862-4bb7-b591-8fb790a7df28 req-07988805-226b-4e68-b4a5-5d4ceeea84b4 service nova] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Received unexpected event network-vif-plugged-312bec25-d19f-423b-aca3-a4117119fc1f for instance with vm_state deleted and task_state None.
Aug 14 16:54:25 user nova-compute[73056]: DEBUG nova.objects.instance [None req-e31243a9-2796-4905-865e-27dcaef8eaae tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lazy-loading 'flavor' on Instance uuid 122c6152-2360-448b-b8e6-6d86bc736500 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:54:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-e31243a9-2796-4905-865e-27dcaef8eaae tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "122c6152-2360-448b-b8e6-6d86bc736500" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.689s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:54:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:54:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SVTXHDay', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:54:28 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:54:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:54:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:54:28 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:54:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:54:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:54:28 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:54:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc9445c-e843-439e-98f8-d3f24129880d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:54:28 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:54:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2100d7c3-832e-444b-a668-b38e151fd670]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f] added
Aug 14 16:54:28 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:54:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bf971f-e547-4878-933c-249b5f22f1c5]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:54:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:29 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a6d59a-e8f1-4e4f-ac4f-bea76804e60a]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:29 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:54:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SVTXHDay {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SVTXHDay" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:29 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b1077b-296f-47e2-be9a-4a95c3a255bd]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:29 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SVTXHDay'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:54:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:29 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[219f4fad-1e01-4f69-98f7-6d1a510866cc]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:29 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:54:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:29 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[9687aaf6-8422-4ee2-9c68-aefacf2c6a7b]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:29 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:54:29 user nova-compute[73056]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 (non-flash)
Aug 14 16:54:29 user nova-compute[73056]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)
Aug 14 16:54:29 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:54:29 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:54:29 user nova-compute[73056]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 (non-flash)
Aug 14 16:54:29 user nova-compute[73056]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)
Aug 14 16:54:29 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:54:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:29 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2281cfc4-6974-4c50-961c-d0a6fe14685b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:29 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f, portal: 172.16.0.220,3260]
Aug 14 16:54:29 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f, portal: 172.16.0.220,3260] successful.
Aug 14 16:54:29 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:54:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:29 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4566c0-b55d-4643-920e-ae97be3440e5]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:29 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:54:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:29 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b65b0f4-9ba8-4313-8837-f0416b059393]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:29 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:54:29 user nova-compute[73056]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 (non-flash)
Aug 14 16:54:29 user nova-compute[73056]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)
Aug 14 16:54:29 user nova-compute[73056]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f (non-flash)
Aug 14 16:54:29 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:54:29 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:54:29 user nova-compute[73056]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 (non-flash)
Aug 14 16:54:29 user nova-compute[73056]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)
Aug 14 16:54:29 user nova-compute[73056]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f (non-flash)
Aug 14 16:54:29 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:54:29 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:54:29 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:54:29 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:54:29 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:54:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:29 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f19dc2-8a35-41f8-b7bf-7eb2b3b39838]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:29 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: None {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:54:30 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:54:30 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SVTXHDay', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:54:30 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:54:30 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23830613734336663', 'path': '/dev/sdd'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:54:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830613734336663', 'path': '/dev/sdd'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:54:30 user nova-compute[73056]: DEBUG nova.objects.instance [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lazy-loading 'flavor' on Instance uuid 5914b70b-665a-4ce0-ab4e-11db2b8bc057 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:54:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 16:54:30 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:54:30 user nova-compute[73056]:   <source dev="/dev/sdd"/>
Aug 14 16:54:30 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:54:30 user nova-compute[73056]:   <serial>82d8a96b-6b13-4960-8883-d6b8e274cd3f</serial>
Aug 14 16:54:30 user nova-compute[73056]: </disk>
Aug 14 16:54:30 user nova-compute[73056]:  {{(pid=73056) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 16:54:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:54:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:54:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] No VIF found with MAC fa:16:3e:af:d2:e8, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:54:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-11dfe04b-0c6d-4e7d-9a01-593018e5178b tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.285s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:54:31 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692032056.0889597, c35f86ec-62d5-4c4d-a259-902e95aeb9d0 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:54:31 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] VM Stopped (Lifecycle Event)
Aug 14 16:54:31 user nova-compute[73056]: DEBUG nova.compute.manager [None req-8b636d93-3b8b-4caa-8eca-f69d182aefe6 None None] [instance: c35f86ec-62d5-4c4d-a259-902e95aeb9d0] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:54:31 user nova-compute[73056]: INFO nova.compute.manager [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Rescuing
Aug 14 16:54:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "refresh_cache-5914b70b-665a-4ce0-ab4e-11db2b8bc057" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:54:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquired lock "refresh_cache-5914b70b-665a-4ce0-ab4e-11db2b8bc057" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:54:31 user nova-compute[73056]: DEBUG nova.network.neutron [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:54:32 user nova-compute[73056]: DEBUG nova.network.neutron [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Updating instance_info_cache with network_info: [{"id": "c9eb236b-5c65-4108-9527-dbf9550cf01f", "address": "fa:16:3e:af:d2:e8", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9eb236b-5c", "ovs_interfaceid": "c9eb236b-5c65-4108-9527-dbf9550cf01f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:54:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Releasing lock "refresh_cache-5914b70b-665a-4ce0-ab4e-11db2b8bc057" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:54:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:32 user nova-compute[73056]: DEBUG nova.compute.manager [req-4b64581f-4717-43d0-9481-a18b0de72c64 req-958de875-33ac-4efc-b3d1-9947fe7944d3 service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Received event network-vif-unplugged-c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:54:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4b64581f-4717-43d0-9481-a18b0de72c64 req-958de875-33ac-4efc-b3d1-9947fe7944d3 service nova] Acquiring lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:54:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4b64581f-4717-43d0-9481-a18b0de72c64 req-958de875-33ac-4efc-b3d1-9947fe7944d3 service nova] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:54:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4b64581f-4717-43d0-9481-a18b0de72c64 req-958de875-33ac-4efc-b3d1-9947fe7944d3 service nova] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:54:32 user nova-compute[73056]: DEBUG nova.compute.manager [req-4b64581f-4717-43d0-9481-a18b0de72c64 req-958de875-33ac-4efc-b3d1-9947fe7944d3 service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] No waiting events found dispatching network-vif-unplugged-c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:54:32 user nova-compute[73056]: WARNING nova.compute.manager [req-4b64581f-4717-43d0-9481-a18b0de72c64 req-958de875-33ac-4efc-b3d1-9947fe7944d3 service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Received unexpected event network-vif-unplugged-c9eb236b-5c65-4108-9527-dbf9550cf01f for instance with vm_state active and task_state rescuing.
Aug 14 16:54:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:32 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Instance destroyed successfully.
Aug 14 16:54:33 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Attempting rescue
Aug 14 16:54:33 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73056) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Instance directory exists: not creating {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 16:54:33 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Creating image(s)
Aug 14 16:54:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "/opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "/opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "/opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG nova.objects.instance [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5914b70b-665a-4ce0-ab4e-11db2b8bc057 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "c889592ab94cd0b0ce896f27a2af0323771db234" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.170s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk.rescue {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk.rescue" returned: 0 in 0.046s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG nova.objects.instance [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lazy-loading 'migration_context' on Instance uuid 5914b70b-665a-4ce0-ab4e-11db2b8bc057 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Start _get_guest_xml network_info=[{"id": "c9eb236b-5c65-4108-9527-dbf9550cf01f", "address": "fa:16:3e:af:d2:e8", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "vif_mac": "fa:16:3e:af:d2:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9eb236b-5c", "ovs_interfaceid": "c9eb236b-5c65-4108-9527-dbf9550cf01f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG nova.objects.instance [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lazy-loading 'resources' on Instance uuid 5914b70b-665a-4ce0-ab4e-11db2b8bc057 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG nova.objects.instance [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lazy-loading 'numa_topology' on Instance uuid 5914b70b-665a-4ce0-ab4e-11db2b8bc057 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:54:33 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:54:33 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:54:33 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG nova.objects.instance [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5914b70b-665a-4ce0-ab4e-11db2b8bc057 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:52:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1952339710',display_name='tempest-ServerRescueNegativeTestJSON-server-1952339710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1952339710',id=37,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAp0LikYCQHNfSYD4UvT4Zxh43XbzRmqoiU2ZnOfp1CYD0BrAg4r5J/RAcQQuADIA2Ho1aSstdK7xXiTXNXXMeOhkn7JZ7x8dywIzuMsJtJLPFvrAuj2FTi45iY+XI0yxg==',key_name='tempest-keypair-1806914521',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:52:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09b7b0f153a945ac9ce96fe462b17fd5',ramdisk_id='',reservation_id='r-7dv7kuyc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-201205905',owner_user_name='tempest-ServerRescueNegativeTestJSON-201205905-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:52:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9f89462f2734ec48d78921ab3d654b2',uuid=5914b70b-665a-4ce0-ab4e-11db2b8bc057,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9eb236b-5c65-4108-9527-dbf9550cf01f", "address": "fa:16:3e:af:d2:e8", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "vif_mac": "fa:16:3e:af:d2:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9eb236b-5c", "ovs_interfaceid": "c9eb236b-5c65-4108-9527-dbf9550cf01f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Converting VIF {"id": "c9eb236b-5c65-4108-9527-dbf9550cf01f", "address": "fa:16:3e:af:d2:e8", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "vif_mac": "fa:16:3e:af:d2:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9eb236b-5c", "ovs_interfaceid": "c9eb236b-5c65-4108-9527-dbf9550cf01f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:d2:e8,bridge_name='br-int',has_traffic_filtering=True,id=c9eb236b-5c65-4108-9527-dbf9550cf01f,network=Network(9f4305e9-4b75-4f5d-b1b2-f1184c408739),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9eb236b-5c') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG nova.objects.instance [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lazy-loading 'pci_devices' on Instance uuid 5914b70b-665a-4ce0-ab4e-11db2b8bc057 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:54:33 user nova-compute[73056]:   <uuid>5914b70b-665a-4ce0-ab4e-11db2b8bc057</uuid>
Aug 14 16:54:33 user nova-compute[73056]:   <name>instance-00000025</name>
Aug 14 16:54:33 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:54:33 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:54:33 user nova-compute[73056]:   <metadata>
Aug 14 16:54:33 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:54:33 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:54:33 user nova-compute[73056]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1952339710</nova:name>
Aug 14 16:54:33 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:54:33</nova:creationTime>
Aug 14 16:54:33 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:54:33 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:54:33 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:54:33 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:54:33 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:54:33 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:54:33 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:54:33 user nova-compute[73056]:       <nova:owner>
Aug 14 16:54:33 user nova-compute[73056]:         <nova:user uuid="e9f89462f2734ec48d78921ab3d654b2">tempest-ServerRescueNegativeTestJSON-201205905-project-member</nova:user>
Aug 14 16:54:33 user nova-compute[73056]:         <nova:project uuid="09b7b0f153a945ac9ce96fe462b17fd5">tempest-ServerRescueNegativeTestJSON-201205905</nova:project>
Aug 14 16:54:33 user nova-compute[73056]:       </nova:owner>
Aug 14 16:54:33 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:54:33 user nova-compute[73056]:       <nova:ports>
Aug 14 16:54:33 user nova-compute[73056]:         <nova:port uuid="c9eb236b-5c65-4108-9527-dbf9550cf01f">
Aug 14 16:54:33 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 16:54:33 user nova-compute[73056]:         </nova:port>
Aug 14 16:54:33 user nova-compute[73056]:       </nova:ports>
Aug 14 16:54:33 user nova-compute[73056]:     </nova:instance>
Aug 14 16:54:33 user nova-compute[73056]:   </metadata>
Aug 14 16:54:33 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:54:33 user nova-compute[73056]:     <system>
Aug 14 16:54:33 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:54:33 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:54:33 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:54:33 user nova-compute[73056]:       <entry name="serial">5914b70b-665a-4ce0-ab4e-11db2b8bc057</entry>
Aug 14 16:54:33 user nova-compute[73056]:       <entry name="uuid">5914b70b-665a-4ce0-ab4e-11db2b8bc057</entry>
Aug 14 16:54:33 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:54:33 user nova-compute[73056]:     </system>
Aug 14 16:54:33 user nova-compute[73056]:   </sysinfo>
Aug 14 16:54:33 user nova-compute[73056]:   <os>
Aug 14 16:54:33 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:54:33 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:54:33 user nova-compute[73056]:   </os>
Aug 14 16:54:33 user nova-compute[73056]:   <features>
Aug 14 16:54:33 user nova-compute[73056]:     <acpi/>
Aug 14 16:54:33 user nova-compute[73056]:     <apic/>
Aug 14 16:54:33 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:54:33 user nova-compute[73056]:   </features>
Aug 14 16:54:33 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:54:33 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:54:33 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:54:33 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:54:33 user nova-compute[73056]:   </clock>
Aug 14 16:54:33 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:54:33 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:54:33 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:54:33 user nova-compute[73056]:   </cpu>
Aug 14 16:54:33 user nova-compute[73056]:   <devices>
Aug 14 16:54:33 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:54:33 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:54:33 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk.rescue"/>
Aug 14 16:54:33 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:54:33 user nova-compute[73056]:     </disk>
Aug 14 16:54:33 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:54:33 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:54:33 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk"/>
Aug 14 16:54:33 user nova-compute[73056]:       <target dev="vdb" bus="virtio"/>
Aug 14 16:54:33 user nova-compute[73056]:     </disk>
Aug 14 16:54:33 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:54:33 user nova-compute[73056]:       <mac address="fa:16:3e:af:d2:e8"/>
Aug 14 16:54:33 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:54:33 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:54:33 user nova-compute[73056]:       <target dev="tapc9eb236b-5c"/>
Aug 14 16:54:33 user nova-compute[73056]:     </interface>
Aug 14 16:54:33 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:54:33 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/console.log" append="off"/>
Aug 14 16:54:33 user nova-compute[73056]:     </serial>
Aug 14 16:54:33 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:54:33 user nova-compute[73056]:     <video>
Aug 14 16:54:33 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:54:33 user nova-compute[73056]:     </video>
Aug 14 16:54:33 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:54:33 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:54:33 user nova-compute[73056]:     </rng>
Aug 14 16:54:33 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:54:33 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:54:33 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:54:33 user nova-compute[73056]:     </memballoon>
Aug 14 16:54:33 user nova-compute[73056]:   </devices>
Aug 14 16:54:33 user nova-compute[73056]: </domain>
Aug 14 16:54:33 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:54:33 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Instance destroyed successfully.
Aug 14 16:54:33 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] No VIF found with MAC fa:16:3e:af:d2:e8, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:54:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:34 user nova-compute[73056]: DEBUG nova.compute.manager [req-8e10387d-9f6c-4386-9816-1c6b37a3ef3c req-8960e4c4-8f35-430b-a16c-205956bbca36 service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Received event network-vif-plugged-c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:54:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8e10387d-9f6c-4386-9816-1c6b37a3ef3c req-8960e4c4-8f35-430b-a16c-205956bbca36 service nova] Acquiring lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:54:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8e10387d-9f6c-4386-9816-1c6b37a3ef3c req-8960e4c4-8f35-430b-a16c-205956bbca36 service nova] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:54:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8e10387d-9f6c-4386-9816-1c6b37a3ef3c req-8960e4c4-8f35-430b-a16c-205956bbca36 service nova] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:54:34 user nova-compute[73056]: DEBUG nova.compute.manager [req-8e10387d-9f6c-4386-9816-1c6b37a3ef3c req-8960e4c4-8f35-430b-a16c-205956bbca36 service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] No waiting events found dispatching network-vif-plugged-c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:54:34 user nova-compute[73056]: WARNING nova.compute.manager [req-8e10387d-9f6c-4386-9816-1c6b37a3ef3c req-8960e4c4-8f35-430b-a16c-205956bbca36 service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Received unexpected event network-vif-plugged-c9eb236b-5c65-4108-9527-dbf9550cf01f for instance with vm_state active and task_state rescuing.
Aug 14 16:54:34 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:34 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:34 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:34 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:34 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:36 user nova-compute[73056]: DEBUG nova.compute.manager [req-1d5245f9-6db6-4303-bb49-99c7a877e95a req-cf917563-d5fc-4eaa-8740-3e259bd0e538 service nova] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Received event network-changed-abfca352-6325-4073-9800-4fdb9f5a2e43 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:54:36 user nova-compute[73056]: DEBUG nova.compute.manager [req-1d5245f9-6db6-4303-bb49-99c7a877e95a req-cf917563-d5fc-4eaa-8740-3e259bd0e538 service nova] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Refreshing instance network info cache due to event network-changed-abfca352-6325-4073-9800-4fdb9f5a2e43. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:54:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1d5245f9-6db6-4303-bb49-99c7a877e95a req-cf917563-d5fc-4eaa-8740-3e259bd0e538 service nova] Acquiring lock "refresh_cache-4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:54:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1d5245f9-6db6-4303-bb49-99c7a877e95a req-cf917563-d5fc-4eaa-8740-3e259bd0e538 service nova] Acquired lock "refresh_cache-4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:54:36 user nova-compute[73056]: DEBUG nova.network.neutron [req-1d5245f9-6db6-4303-bb49-99c7a877e95a req-cf917563-d5fc-4eaa-8740-3e259bd0e538 service nova] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Refreshing network info cache for port abfca352-6325-4073-9800-4fdb9f5a2e43 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:54:36 user nova-compute[73056]: DEBUG nova.network.neutron [req-1d5245f9-6db6-4303-bb49-99c7a877e95a req-cf917563-d5fc-4eaa-8740-3e259bd0e538 service nova] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Updated VIF entry in instance network info cache for port abfca352-6325-4073-9800-4fdb9f5a2e43. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:54:36 user nova-compute[73056]: DEBUG nova.network.neutron [req-1d5245f9-6db6-4303-bb49-99c7a877e95a req-cf917563-d5fc-4eaa-8740-3e259bd0e538 service nova] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Updating instance_info_cache with network_info: [{"id": "abfca352-6325-4073-9800-4fdb9f5a2e43", "address": "fa:16:3e:2d:c9:a4", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabfca352-63", "ovs_interfaceid": "abfca352-6325-4073-9800-4fdb9f5a2e43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:54:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:54:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:54:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:54:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:54:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:54:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1d5245f9-6db6-4303-bb49-99c7a877e95a req-cf917563-d5fc-4eaa-8740-3e259bd0e538 service nova] Releasing lock "refresh_cache-4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:54:36 user nova-compute[73056]: INFO nova.compute.manager [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Terminating instance
Aug 14 16:54:36 user nova-compute[73056]: DEBUG nova.compute.manager [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 16:54:36 user nova-compute[73056]: DEBUG nova.compute.manager [req-59f6d0a7-0062-4f4b-b92e-6cd3ce14386f req-3a08de1d-760b-4ad8-83ad-b9439730f0bb service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Received event network-vif-plugged-c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:54:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-59f6d0a7-0062-4f4b-b92e-6cd3ce14386f req-3a08de1d-760b-4ad8-83ad-b9439730f0bb service nova] Acquiring lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:54:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-59f6d0a7-0062-4f4b-b92e-6cd3ce14386f req-3a08de1d-760b-4ad8-83ad-b9439730f0bb service nova] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:54:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-59f6d0a7-0062-4f4b-b92e-6cd3ce14386f req-3a08de1d-760b-4ad8-83ad-b9439730f0bb service nova] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:54:36 user nova-compute[73056]: DEBUG nova.compute.manager [req-59f6d0a7-0062-4f4b-b92e-6cd3ce14386f req-3a08de1d-760b-4ad8-83ad-b9439730f0bb service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] No waiting events found dispatching network-vif-plugged-c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:54:36 user nova-compute[73056]: WARNING nova.compute.manager [req-59f6d0a7-0062-4f4b-b92e-6cd3ce14386f req-3a08de1d-760b-4ad8-83ad-b9439730f0bb service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Received unexpected event network-vif-plugged-c9eb236b-5c65-4108-9527-dbf9550cf01f for instance with vm_state active and task_state rescuing.
Aug 14 16:54:36 user nova-compute[73056]: DEBUG nova.compute.manager [req-59f6d0a7-0062-4f4b-b92e-6cd3ce14386f req-3a08de1d-760b-4ad8-83ad-b9439730f0bb service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Received event network-vif-plugged-c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:54:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-59f6d0a7-0062-4f4b-b92e-6cd3ce14386f req-3a08de1d-760b-4ad8-83ad-b9439730f0bb service nova] Acquiring lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:54:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-59f6d0a7-0062-4f4b-b92e-6cd3ce14386f req-3a08de1d-760b-4ad8-83ad-b9439730f0bb service nova] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:54:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-59f6d0a7-0062-4f4b-b92e-6cd3ce14386f req-3a08de1d-760b-4ad8-83ad-b9439730f0bb service nova] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:54:36 user nova-compute[73056]: DEBUG nova.compute.manager [req-59f6d0a7-0062-4f4b-b92e-6cd3ce14386f req-3a08de1d-760b-4ad8-83ad-b9439730f0bb service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] No waiting events found dispatching network-vif-plugged-c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:54:36 user nova-compute[73056]: WARNING nova.compute.manager [req-59f6d0a7-0062-4f4b-b92e-6cd3ce14386f req-3a08de1d-760b-4ad8-83ad-b9439730f0bb service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Received unexpected event network-vif-plugged-c9eb236b-5c65-4108-9527-dbf9550cf01f for instance with vm_state active and task_state rescuing.
Aug 14 16:54:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Removed pending event for 5914b70b-665a-4ce0-ab4e-11db2b8bc057 due to event {{(pid=73056) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692032077.003956, 5914b70b-665a-4ce0-ab4e-11db2b8bc057 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:54:37 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] VM Resumed (Lifecycle Event)
Aug 14 16:54:37 user nova-compute[73056]: DEBUG nova.compute.manager [None req-a362073d-ac4c-4f2d-b4b8-404b6e038e7e tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:54:37 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 16:54:37 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692032077.008056, 5914b70b-665a-4ce0-ab4e-11db2b8bc057 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:54:37 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] VM Started (Lifecycle Event)
Aug 14 16:54:37 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:54:37 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Instance destroyed successfully.
Aug 14 16:54:37 user nova-compute[73056]: DEBUG nova.objects.instance [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lazy-loading 'resources' on Instance uuid 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1198926477',display_name='tempest-TestVolumeBootPattern-server-1198926477',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1198926477',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBF9UVFrNwhQEMB/CeZfBoQaAoJOYsqM67ncFaZmWIdIzJd1Na96dOaZXAGstQENK3pBtGzJ44fKFGGhrlwWzWMk9Hm8I+KfAGKsRBWs7QP0LhARS9gNshqYVaA6cOdig==',key_name='tempest-TestVolumeBootPattern-829376797',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:52:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cffb5203b9284500b8add8a6586cad49',ramdisk_id='',reservation_id='r-q5ngzy0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1676214558',owner_user_name='tempest-TestVolumeBootPattern-1676214558-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:52:58Z,user_data=None,user_id='2be1b098ca9f4232bd198b515630f6ad',uuid=4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "abfca352-6325-4073-9800-4fdb9f5a2e43", "address": "fa:16:3e:2d:c9:a4", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabfca352-63", "ovs_interfaceid": "abfca352-6325-4073-9800-4fdb9f5a2e43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Converting VIF {"id": "abfca352-6325-4073-9800-4fdb9f5a2e43", "address": "fa:16:3e:2d:c9:a4", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabfca352-63", "ovs_interfaceid": "abfca352-6325-4073-9800-4fdb9f5a2e43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:c9:a4,bridge_name='br-int',has_traffic_filtering=True,id=abfca352-6325-4073-9800-4fdb9f5a2e43,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabfca352-63') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG os_vif [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:c9:a4,bridge_name='br-int',has_traffic_filtering=True,id=abfca352-6325-4073-9800-4fdb9f5a2e43,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabfca352-63') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapabfca352-63, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:54:37 user nova-compute[73056]: INFO os_vif [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:c9:a4,bridge_name='br-int',has_traffic_filtering=True,id=abfca352-6325-4073-9800-4fdb9f5a2e43,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabfca352-63')
Aug 14 16:54:37 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbFahCRc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:54:37 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:54:37 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b118c39-cb7f-495d-b234-73b3eac77095]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[19128810-5120-4714-8101-b50b4c2df220]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:54:37 user nova-compute[73056]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 (non-flash)
Aug 14 16:54:37 user nova-compute[73056]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)
Aug 14 16:54:37 user nova-compute[73056]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f (non-flash)
Aug 14 16:54:37 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:54:37 user nova-compute[73056]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 (non-flash)
Aug 14 16:54:37 user nova-compute[73056]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)
Aug 14 16:54:37 user nova-compute[73056]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f (non-flash)
Aug 14 16:54:37 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff32fc57a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297'): ({'sdc'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Removing single pathed devices sdc {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[1406f199-d312-437a-9ae5-0d53813760a2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[04cef332-e7e0-4ceb-8245-7b708821d88a]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Flushing IO for device /dev/sdc {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[081116af-a5ae-414c-a990-c2e439220aa0]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.065s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[751943e5-e91f-40a0-b0f9-3a3357503b61]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] SCSI volumes sdc have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4108bf-65d0-4e3a-9868-28f3973eeb27]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6482e43-3a08-4337-a26f-b50b0ef832d0]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297, portal: 172.16.0.220,3260]
Aug 14 16:54:37 user nova-compute[73056]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297, portal: 172.16.0.220,3260] successful.
Aug 14 16:54:37 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[90420308-0659-4924-a100-79a24f8cd3e2]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] <== disconnect_volume: return (346ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:54:37 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Deleting instance files /opt/stack/data/nova/instances/4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9_del
Aug 14 16:54:37 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Deletion of /opt/stack/data/nova/instances/4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9_del complete
Aug 14 16:54:37 user nova-compute[73056]: INFO nova.compute.manager [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Took 1.22 seconds to destroy the instance on the hypervisor.
Aug 14 16:54:37 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 16:54:37 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 16:54:38 user nova-compute[73056]: DEBUG nova.compute.manager [req-60c6b60a-f9a2-40c9-9775-614aefe6c969 req-7e3d1abc-862a-4680-8286-67b2ec7aa990 service nova] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Received event network-vif-unplugged-abfca352-6325-4073-9800-4fdb9f5a2e43 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:54:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-60c6b60a-f9a2-40c9-9775-614aefe6c969 req-7e3d1abc-862a-4680-8286-67b2ec7aa990 service nova] Acquiring lock "4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:54:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-60c6b60a-f9a2-40c9-9775-614aefe6c969 req-7e3d1abc-862a-4680-8286-67b2ec7aa990 service nova] Lock "4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:54:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-60c6b60a-f9a2-40c9-9775-614aefe6c969 req-7e3d1abc-862a-4680-8286-67b2ec7aa990 service nova] Lock "4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:54:38 user nova-compute[73056]: DEBUG nova.compute.manager [req-60c6b60a-f9a2-40c9-9775-614aefe6c969 req-7e3d1abc-862a-4680-8286-67b2ec7aa990 service nova] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] No waiting events found dispatching network-vif-unplugged-abfca352-6325-4073-9800-4fdb9f5a2e43 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:54:38 user nova-compute[73056]: DEBUG nova.compute.manager [req-60c6b60a-f9a2-40c9-9775-614aefe6c969 req-7e3d1abc-862a-4680-8286-67b2ec7aa990 service nova] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Received event network-vif-unplugged-abfca352-6325-4073-9800-4fdb9f5a2e43 for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:54:38 user nova-compute[73056]: DEBUG nova.compute.manager [req-60c6b60a-f9a2-40c9-9775-614aefe6c969 req-7e3d1abc-862a-4680-8286-67b2ec7aa990 service nova] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Received event network-vif-plugged-abfca352-6325-4073-9800-4fdb9f5a2e43 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:54:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-60c6b60a-f9a2-40c9-9775-614aefe6c969 req-7e3d1abc-862a-4680-8286-67b2ec7aa990 service nova] Acquiring lock "4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:54:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-60c6b60a-f9a2-40c9-9775-614aefe6c969 req-7e3d1abc-862a-4680-8286-67b2ec7aa990 service nova] Lock "4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:54:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-60c6b60a-f9a2-40c9-9775-614aefe6c969 req-7e3d1abc-862a-4680-8286-67b2ec7aa990 service nova] Lock "4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:54:38 user nova-compute[73056]: DEBUG nova.compute.manager [req-60c6b60a-f9a2-40c9-9775-614aefe6c969 req-7e3d1abc-862a-4680-8286-67b2ec7aa990 service nova] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] No waiting events found dispatching network-vif-plugged-abfca352-6325-4073-9800-4fdb9f5a2e43 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:54:38 user nova-compute[73056]: WARNING nova.compute.manager [req-60c6b60a-f9a2-40c9-9775-614aefe6c969 req-7e3d1abc-862a-4680-8286-67b2ec7aa990 service nova] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Received unexpected event network-vif-plugged-abfca352-6325-4073-9800-4fdb9f5a2e43 for instance with vm_state active and task_state deleting.
Aug 14 16:54:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:38 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692032063.7360203, 9f3a7f8a-e3b9-4918-9663-968677fe5c90 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:54:38 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] VM Stopped (Lifecycle Event)
Aug 14 16:54:38 user nova-compute[73056]: DEBUG nova.compute.manager [None req-c0d2f955-5809-4232-b094-acd147e17044 None None] [instance: 9f3a7f8a-e3b9-4918-9663-968677fe5c90] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:54:38 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:54:38 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Took 1.01 seconds to deallocate network for instance.
Aug 14 16:54:39 user nova-compute[73056]: INFO nova.compute.manager [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Took 0.78 seconds to detach 1 volumes for instance.
Aug 14 16:54:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:54:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:54:39 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:54:39 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:54:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:54:40 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Deleted allocations for instance 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9
Aug 14 16:54:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-d4e5a1b2-4028-46d9-a77d-0d6b1a651e5e tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.519s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:54:40 user nova-compute[73056]: DEBUG nova.compute.manager [req-e3098d48-46f7-411a-bdbe-de7fad674faf req-bdfec2ee-27ec-43e9-86ee-70d90396988a service nova] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Received event network-vif-deleted-abfca352-6325-4073-9800-4fdb9f5a2e43 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:54:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-f2e0c5a8-8e86-47fb-8f01-29e5ce88feb2 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "bcbe7449-6199-4e86-a8b6-c075e142aa34" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:54:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-f2e0c5a8-8e86-47fb-8f01-29e5ce88feb2 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "bcbe7449-6199-4e86-a8b6-c075e142aa34" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:54:51 user nova-compute[73056]: INFO nova.compute.manager [None req-f2e0c5a8-8e86-47fb-8f01-29e5ce88feb2 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Detaching volume c6708c0a-8faa-4315-a2eb-64c3898d5033
Aug 14 16:54:52 user nova-compute[73056]: INFO nova.virt.block_device [None req-f2e0c5a8-8e86-47fb-8f01-29e5ce88feb2 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Attempting to driver detach volume c6708c0a-8faa-4315-a2eb-64c3898d5033 from mountpoint /dev/vdc
Aug 14 16:54:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-f2e0c5a8-8e86-47fb-8f01-29e5ce88feb2 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Attempting to detach device vdc from instance bcbe7449-6199-4e86-a8b6-c075e142aa34 from the persistent domain config. {{(pid=73056) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-f2e0c5a8-8e86-47fb-8f01-29e5ce88feb2 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 16:54:52 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:54:52 user nova-compute[73056]:   <source dev="/dev/sde"/>
Aug 14 16:54:52 user nova-compute[73056]:   <target dev="vdc" bus="virtio"/>
Aug 14 16:54:52 user nova-compute[73056]:   <serial>c6708c0a-8faa-4315-a2eb-64c3898d5033</serial>
Aug 14 16:54:52 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 16:54:52 user nova-compute[73056]: </disk>
Aug 14 16:54:52 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 16:54:52 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-f2e0c5a8-8e86-47fb-8f01-29e5ce88feb2 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Successfully detached device vdc from instance bcbe7449-6199-4e86-a8b6-c075e142aa34 from the persistent domain config.
Aug 14 16:54:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-f2e0c5a8-8e86-47fb-8f01-29e5ce88feb2 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance bcbe7449-6199-4e86-a8b6-c075e142aa34 from the live domain config. {{(pid=73056) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-f2e0c5a8-8e86-47fb-8f01-29e5ce88feb2 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 16:54:52 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:54:52 user nova-compute[73056]:   <source dev="/dev/sde"/>
Aug 14 16:54:52 user nova-compute[73056]:   <target dev="vdc" bus="virtio"/>
Aug 14 16:54:52 user nova-compute[73056]:   <serial>c6708c0a-8faa-4315-a2eb-64c3898d5033</serial>
Aug 14 16:54:52 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 16:54:52 user nova-compute[73056]: </disk>
Aug 14 16:54:52 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692032077.3555825, 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:54:52 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] VM Stopped (Lifecycle Event)
Aug 14 16:54:52 user nova-compute[73056]: DEBUG nova.compute.manager [None req-08383393-028d-4a29-a97b-5d6cd420cbb5 None None] [instance: 4faff5be-c1a6-4e3f-8b0e-4f1c424ac3d9] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Received event <DeviceRemovedEvent: 1692032092.493075, bcbe7449-6199-4e86-a8b6-c075e142aa34 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73056) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-f2e0c5a8-8e86-47fb-8f01-29e5ce88feb2 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance bcbe7449-6199-4e86-a8b6-c075e142aa34 {{(pid=73056) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 16:54:52 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-f2e0c5a8-8e86-47fb-8f01-29e5ce88feb2 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Successfully detached device vdc from instance bcbe7449-6199-4e86-a8b6-c075e142aa34 from the live domain config.
Aug 14 16:54:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2e0c5a8-8e86-47fb-8f01-29e5ce88feb2 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e0c5a8-8e86-47fb-8f01-29e5ce88feb2 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmuXJdcF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:54:52 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-f2e0c5a8-8e86-47fb-8f01-29e5ce88feb2 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:54:52 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-f2e0c5a8-8e86-47fb-8f01-29e5ce88feb2 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-f2e0c5a8-8e86-47fb-8f01-29e5ce88feb2 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e0c5a8-8e86-47fb-8f01-29e5ce88feb2 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e322816-3ad2-41c3-b596-26b98f8ca4de]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f652b4bc-71e5-427d-a920-b72a0c13726f]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e0c5a8-8e86-47fb-8f01-29e5ce88feb2 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 (non-flash)
Aug 14 16:54:52 user nova-compute[73056]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)
Aug 14 16:54:52 user nova-compute[73056]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f (non-flash)
Aug 14 16:54:52 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e0c5a8-8e86-47fb-8f01-29e5ce88feb2 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 (non-flash)
Aug 14 16:54:52 user nova-compute[73056]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)
Aug 14 16:54:52 user nova-compute[73056]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f (non-flash)
Aug 14 16:54:52 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e0c5a8-8e86-47fb-8f01-29e5ce88feb2 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff2dcb10af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033'): ({'sde'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-f2e0c5a8-8e86-47fb-8f01-29e5ce88feb2 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Removing single pathed devices sde {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[84de4bad-7995-4fdd-8a06-3302ac32c7d7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57ded3a-50e5-4a09-81be-6cb174a03c24]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-f2e0c5a8-8e86-47fb-8f01-29e5ce88feb2 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Flushing IO for device /dev/sde {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf48d9e-46e5-45e7-8041-1ae3fcb325b9]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-f2e0c5a8-8e86-47fb-8f01-29e5ce88feb2 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[736a7842-f04e-449f-9043-e1d28d5bf5dc]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-f2e0c5a8-8e86-47fb-8f01-29e5ce88feb2 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-f2e0c5a8-8e86-47fb-8f01-29e5ce88feb2 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] SCSI volumes sde have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e0c5a8-8e86-47fb-8f01-29e5ce88feb2 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b2a099-8a51-4d01-8c20-b60bbfb03118]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e0c5a8-8e86-47fb-8f01-29e5ce88feb2 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f196bc0-b450-4683-bbf1-234cd31f39f2]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e0c5a8-8e86-47fb-8f01-29e5ce88feb2 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033, portal: 172.16.0.220,3260]
Aug 14 16:54:52 user nova-compute[73056]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033, portal: 172.16.0.220,3260] successful.
Aug 14 16:54:52 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6708c0a-8faa-4315-a2eb-64c3898d5033 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e124f62c-5a60-4c23-a66e-4404b0ae284f]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e0c5a8-8e86-47fb-8f01-29e5ce88feb2 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-f2e0c5a8-8e86-47fb-8f01-29e5ce88feb2 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e0c5a8-8e86-47fb-8f01-29e5ce88feb2 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] <== disconnect_volume: return (283ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:54:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2e0c5a8-8e86-47fb-8f01-29e5ce88feb2 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:54:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:53 user nova-compute[73056]: DEBUG nova.objects.instance [None req-f2e0c5a8-8e86-47fb-8f01-29e5ce88feb2 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lazy-loading 'flavor' on Instance uuid bcbe7449-6199-4e86-a8b6-c075e142aa34 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:54:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-f2e0c5a8-8e86-47fb-8f01-29e5ce88feb2 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "bcbe7449-6199-4e86-a8b6-c075e142aa34" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.588s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:54:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:54:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:00 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:55:00 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:55:00 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 16:55:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:05 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:55:05 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:55:05 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 16:55:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-61357ac0-230f-4711-8954-0bb04bfcb2f6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:55:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-61357ac0-230f-4711-8954-0bb04bfcb2f6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:55:05 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 16:55:06 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Updating instance_info_cache with network_info: [{"id": "8301812a-2a56-49e5-8747-f50c95c3de26", "address": "fa:16:3e:77:f0:bf", "network": {"id": "c2b49cd1-a248-4bd2-924f-bd8b560aed47", "bridge": "br-int", "label": "tempest-TestStampPattern-1795667966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d796c14bd3489883e161ea1b311ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8301812a-2a", "ovs_interfaceid": "8301812a-2a56-49e5-8747-f50c95c3de26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:55:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-61357ac0-230f-4711-8954-0bb04bfcb2f6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:55:06 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 16:55:06 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:55:06 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:55:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:55:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:55:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:55:06 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 16:55:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/122c6152-2360-448b-b8e6-6d86bc736500/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/122c6152-2360-448b-b8e6-6d86bc736500/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/122c6152-2360-448b-b8e6-6d86bc736500/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/122c6152-2360-448b-b8e6-6d86bc736500/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:06 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:55:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:06 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk (vdb) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:55:06 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee670695-1123-4d95-a7ad-ac79f9a4c16e/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee670695-1123-4d95-a7ad-ac79f9a4c16e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee670695-1123-4d95-a7ad-ac79f9a4c16e/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee670695-1123-4d95-a7ad-ac79f9a4c16e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:09 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:55:09 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:55:09 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=7575MB free_disk=25.167526245117188GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 16:55:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:55:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:55:09 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance b580e3d0-88b5-42a3-a953-84b94c088f41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:55:09 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 92c34cf0-fd39-49fc-9244-4da8ccae6eec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:55:09 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 61357ac0-230f-4711-8954-0bb04bfcb2f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:55:09 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance ee670695-1123-4d95-a7ad-ac79f9a4c16e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:55:09 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 122c6152-2360-448b-b8e6-6d86bc736500 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:55:09 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 5914b70b-665a-4ce0-ab4e-11db2b8bc057 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:55:09 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance bcbe7449-6199-4e86-a8b6-c075e142aa34 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:55:09 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 6910e1fe-8863-4a4b-b975-48c9ebb0b087 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:55:09 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 16:55:09 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 16:55:09 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:55:10 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:55:10 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 16:55:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.417s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:55:10 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:55:10 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:55:10 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:55:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5e24ca89-452c-4ed0-b584-adad9fd73545 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "122c6152-2360-448b-b8e6-6d86bc736500" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:55:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5e24ca89-452c-4ed0-b584-adad9fd73545 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "122c6152-2360-448b-b8e6-6d86bc736500" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:55:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5e24ca89-452c-4ed0-b584-adad9fd73545 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "122c6152-2360-448b-b8e6-6d86bc736500-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:55:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5e24ca89-452c-4ed0-b584-adad9fd73545 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "122c6152-2360-448b-b8e6-6d86bc736500-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:55:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5e24ca89-452c-4ed0-b584-adad9fd73545 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "122c6152-2360-448b-b8e6-6d86bc736500-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:55:14 user nova-compute[73056]: INFO nova.compute.manager [None req-5e24ca89-452c-4ed0-b584-adad9fd73545 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Terminating instance
Aug 14 16:55:14 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5e24ca89-452c-4ed0-b584-adad9fd73545 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 16:55:14 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:14 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:14 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:14 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:14 user nova-compute[73056]: DEBUG nova.compute.manager [req-165af2f2-b511-4acf-8afa-0c9905dc30cd req-cd75228c-369f-4442-bb81-6a9c36ce3ed1 service nova] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Received event network-vif-unplugged-94165c29-4578-453b-aa55-f9440d4ae07c {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:55:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-165af2f2-b511-4acf-8afa-0c9905dc30cd req-cd75228c-369f-4442-bb81-6a9c36ce3ed1 service nova] Acquiring lock "122c6152-2360-448b-b8e6-6d86bc736500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:55:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-165af2f2-b511-4acf-8afa-0c9905dc30cd req-cd75228c-369f-4442-bb81-6a9c36ce3ed1 service nova] Lock "122c6152-2360-448b-b8e6-6d86bc736500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:55:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-165af2f2-b511-4acf-8afa-0c9905dc30cd req-cd75228c-369f-4442-bb81-6a9c36ce3ed1 service nova] Lock "122c6152-2360-448b-b8e6-6d86bc736500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:55:14 user nova-compute[73056]: DEBUG nova.compute.manager [req-165af2f2-b511-4acf-8afa-0c9905dc30cd req-cd75228c-369f-4442-bb81-6a9c36ce3ed1 service nova] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] No waiting events found dispatching network-vif-unplugged-94165c29-4578-453b-aa55-f9440d4ae07c {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:55:14 user nova-compute[73056]: DEBUG nova.compute.manager [req-165af2f2-b511-4acf-8afa-0c9905dc30cd req-cd75228c-369f-4442-bb81-6a9c36ce3ed1 service nova] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Received event network-vif-unplugged-94165c29-4578-453b-aa55-f9440d4ae07c for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:55:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:15 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Instance destroyed successfully.
Aug 14 16:55:15 user nova-compute[73056]: DEBUG nova.objects.instance [None req-5e24ca89-452c-4ed0-b584-adad9fd73545 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lazy-loading 'resources' on Instance uuid 122c6152-2360-448b-b8e6-6d86bc736500 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:55:15 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-5e24ca89-452c-4ed0-b584-adad9fd73545 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:52:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1587330365',display_name='tempest-AttachVolumeNegativeTest-server-1587330365',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1587330365',id=36,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/vyJHY4k/x5v76yhBD61wZ8W7EeilfJSD6Uj8zftQOcs5z3AcwtOXgSDNC/bP7lsqI56m9X2DMIi8A3RxbrLrWUPAsLf61qfy3EOIybMzx/eml54ZFYBKVLpR7xYoNCg==',key_name='tempest-keypair-1294610267',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:52:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d5a8e599b3141339ed0ae6729031b36',ramdisk_id='',reservation_id='r-2px6s0tn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-860464885',owner_user_name='tempest-AttachVolumeNegativeTest-860464885-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:52:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dad45adee1047bda7350d8a3f8a2f54',uuid=122c6152-2360-448b-b8e6-6d86bc736500,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94165c29-4578-453b-aa55-f9440d4ae07c", "address": "fa:16:3e:88:c9:e1", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94165c29-45", "ovs_interfaceid": "94165c29-4578-453b-aa55-f9440d4ae07c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:55:15 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-5e24ca89-452c-4ed0-b584-adad9fd73545 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Converting VIF {"id": "94165c29-4578-453b-aa55-f9440d4ae07c", "address": "fa:16:3e:88:c9:e1", "network": {"id": "ad323a8d-7318-46f5-8af4-cbc61ae589b5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-225328088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5a8e599b3141339ed0ae6729031b36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94165c29-45", "ovs_interfaceid": "94165c29-4578-453b-aa55-f9440d4ae07c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:55:15 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-5e24ca89-452c-4ed0-b584-adad9fd73545 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:c9:e1,bridge_name='br-int',has_traffic_filtering=True,id=94165c29-4578-453b-aa55-f9440d4ae07c,network=Network(ad323a8d-7318-46f5-8af4-cbc61ae589b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94165c29-45') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:55:15 user nova-compute[73056]: DEBUG os_vif [None req-5e24ca89-452c-4ed0-b584-adad9fd73545 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:c9:e1,bridge_name='br-int',has_traffic_filtering=True,id=94165c29-4578-453b-aa55-f9440d4ae07c,network=Network(ad323a8d-7318-46f5-8af4-cbc61ae589b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94165c29-45') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:55:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94165c29-45, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:55:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:55:15 user nova-compute[73056]: INFO os_vif [None req-5e24ca89-452c-4ed0-b584-adad9fd73545 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:c9:e1,bridge_name='br-int',has_traffic_filtering=True,id=94165c29-4578-453b-aa55-f9440d4ae07c,network=Network(ad323a8d-7318-46f5-8af4-cbc61ae589b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94165c29-45')
Aug 14 16:55:15 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-5e24ca89-452c-4ed0-b584-adad9fd73545 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Deleting instance files /opt/stack/data/nova/instances/122c6152-2360-448b-b8e6-6d86bc736500_del
Aug 14 16:55:15 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-5e24ca89-452c-4ed0-b584-adad9fd73545 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Deletion of /opt/stack/data/nova/instances/122c6152-2360-448b-b8e6-6d86bc736500_del complete
Aug 14 16:55:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:15 user nova-compute[73056]: INFO nova.compute.manager [None req-5e24ca89-452c-4ed0-b584-adad9fd73545 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 14 16:55:15 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-5e24ca89-452c-4ed0-b584-adad9fd73545 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 16:55:15 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 16:55:15 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 16:55:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:16 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:55:16 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Took 1.40 seconds to deallocate network for instance.
Aug 14 16:55:16 user nova-compute[73056]: DEBUG nova.compute.manager [req-d690e7f1-8c52-469f-8307-9361a9d702f3 req-2eccfade-f78a-4631-ac82-cd9e56cbf272 service nova] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Received event network-vif-deleted-94165c29-4578-453b-aa55-f9440d4ae07c {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:55:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5e24ca89-452c-4ed0-b584-adad9fd73545 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:55:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5e24ca89-452c-4ed0-b584-adad9fd73545 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:55:17 user nova-compute[73056]: DEBUG nova.compute.manager [req-13fdecbc-cd69-4169-98ce-543ab8da5114 req-ab7d19cb-4c14-4ec2-95a4-6dad977493ab service nova] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Received event network-vif-plugged-94165c29-4578-453b-aa55-f9440d4ae07c {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:55:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-13fdecbc-cd69-4169-98ce-543ab8da5114 req-ab7d19cb-4c14-4ec2-95a4-6dad977493ab service nova] Acquiring lock "122c6152-2360-448b-b8e6-6d86bc736500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:55:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-13fdecbc-cd69-4169-98ce-543ab8da5114 req-ab7d19cb-4c14-4ec2-95a4-6dad977493ab service nova] Lock "122c6152-2360-448b-b8e6-6d86bc736500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:55:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-13fdecbc-cd69-4169-98ce-543ab8da5114 req-ab7d19cb-4c14-4ec2-95a4-6dad977493ab service nova] Lock "122c6152-2360-448b-b8e6-6d86bc736500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:55:17 user nova-compute[73056]: DEBUG nova.compute.manager [req-13fdecbc-cd69-4169-98ce-543ab8da5114 req-ab7d19cb-4c14-4ec2-95a4-6dad977493ab service nova] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] No waiting events found dispatching network-vif-plugged-94165c29-4578-453b-aa55-f9440d4ae07c {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:55:17 user nova-compute[73056]: WARNING nova.compute.manager [req-13fdecbc-cd69-4169-98ce-543ab8da5114 req-ab7d19cb-4c14-4ec2-95a4-6dad977493ab service nova] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Received unexpected event network-vif-plugged-94165c29-4578-453b-aa55-f9440d4ae07c for instance with vm_state deleted and task_state None.
Aug 14 16:55:17 user nova-compute[73056]: DEBUG nova.compute.manager [req-13fdecbc-cd69-4169-98ce-543ab8da5114 req-ab7d19cb-4c14-4ec2-95a4-6dad977493ab service nova] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Received event network-vif-plugged-94165c29-4578-453b-aa55-f9440d4ae07c {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:55:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-13fdecbc-cd69-4169-98ce-543ab8da5114 req-ab7d19cb-4c14-4ec2-95a4-6dad977493ab service nova] Acquiring lock "122c6152-2360-448b-b8e6-6d86bc736500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:55:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-13fdecbc-cd69-4169-98ce-543ab8da5114 req-ab7d19cb-4c14-4ec2-95a4-6dad977493ab service nova] Lock "122c6152-2360-448b-b8e6-6d86bc736500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:55:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-13fdecbc-cd69-4169-98ce-543ab8da5114 req-ab7d19cb-4c14-4ec2-95a4-6dad977493ab service nova] Lock "122c6152-2360-448b-b8e6-6d86bc736500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:55:17 user nova-compute[73056]: DEBUG nova.compute.manager [req-13fdecbc-cd69-4169-98ce-543ab8da5114 req-ab7d19cb-4c14-4ec2-95a4-6dad977493ab service nova] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] No waiting events found dispatching network-vif-plugged-94165c29-4578-453b-aa55-f9440d4ae07c {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:55:17 user nova-compute[73056]: WARNING nova.compute.manager [req-13fdecbc-cd69-4169-98ce-543ab8da5114 req-ab7d19cb-4c14-4ec2-95a4-6dad977493ab service nova] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Received unexpected event network-vif-plugged-94165c29-4578-453b-aa55-f9440d4ae07c for instance with vm_state deleted and task_state None.
Aug 14 16:55:17 user nova-compute[73056]: DEBUG nova.compute.manager [req-13fdecbc-cd69-4169-98ce-543ab8da5114 req-ab7d19cb-4c14-4ec2-95a4-6dad977493ab service nova] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Received event network-vif-plugged-94165c29-4578-453b-aa55-f9440d4ae07c {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:55:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-13fdecbc-cd69-4169-98ce-543ab8da5114 req-ab7d19cb-4c14-4ec2-95a4-6dad977493ab service nova] Acquiring lock "122c6152-2360-448b-b8e6-6d86bc736500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:55:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-13fdecbc-cd69-4169-98ce-543ab8da5114 req-ab7d19cb-4c14-4ec2-95a4-6dad977493ab service nova] Lock "122c6152-2360-448b-b8e6-6d86bc736500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:55:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-13fdecbc-cd69-4169-98ce-543ab8da5114 req-ab7d19cb-4c14-4ec2-95a4-6dad977493ab service nova] Lock "122c6152-2360-448b-b8e6-6d86bc736500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:55:17 user nova-compute[73056]: DEBUG nova.compute.manager [req-13fdecbc-cd69-4169-98ce-543ab8da5114 req-ab7d19cb-4c14-4ec2-95a4-6dad977493ab service nova] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] No waiting events found dispatching network-vif-plugged-94165c29-4578-453b-aa55-f9440d4ae07c {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:55:17 user nova-compute[73056]: WARNING nova.compute.manager [req-13fdecbc-cd69-4169-98ce-543ab8da5114 req-ab7d19cb-4c14-4ec2-95a4-6dad977493ab service nova] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Received unexpected event network-vif-plugged-94165c29-4578-453b-aa55-f9440d4ae07c for instance with vm_state deleted and task_state None.
Aug 14 16:55:17 user nova-compute[73056]: DEBUG nova.compute.manager [req-13fdecbc-cd69-4169-98ce-543ab8da5114 req-ab7d19cb-4c14-4ec2-95a4-6dad977493ab service nova] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Received event network-vif-plugged-94165c29-4578-453b-aa55-f9440d4ae07c {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:55:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-13fdecbc-cd69-4169-98ce-543ab8da5114 req-ab7d19cb-4c14-4ec2-95a4-6dad977493ab service nova] Acquiring lock "122c6152-2360-448b-b8e6-6d86bc736500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:55:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-13fdecbc-cd69-4169-98ce-543ab8da5114 req-ab7d19cb-4c14-4ec2-95a4-6dad977493ab service nova] Lock "122c6152-2360-448b-b8e6-6d86bc736500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:55:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-13fdecbc-cd69-4169-98ce-543ab8da5114 req-ab7d19cb-4c14-4ec2-95a4-6dad977493ab service nova] Lock "122c6152-2360-448b-b8e6-6d86bc736500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:55:17 user nova-compute[73056]: DEBUG nova.compute.manager [req-13fdecbc-cd69-4169-98ce-543ab8da5114 req-ab7d19cb-4c14-4ec2-95a4-6dad977493ab service nova] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] No waiting events found dispatching network-vif-plugged-94165c29-4578-453b-aa55-f9440d4ae07c {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:55:17 user nova-compute[73056]: WARNING nova.compute.manager [req-13fdecbc-cd69-4169-98ce-543ab8da5114 req-ab7d19cb-4c14-4ec2-95a4-6dad977493ab service nova] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Received unexpected event network-vif-plugged-94165c29-4578-453b-aa55-f9440d4ae07c for instance with vm_state deleted and task_state None.
Aug 14 16:55:17 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-5e24ca89-452c-4ed0-b584-adad9fd73545 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:55:17 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-5e24ca89-452c-4ed0-b584-adad9fd73545 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:55:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5e24ca89-452c-4ed0-b584-adad9fd73545 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.273s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:55:17 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-5e24ca89-452c-4ed0-b584-adad9fd73545 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Deleted allocations for instance 122c6152-2360-448b-b8e6-6d86bc736500
Aug 14 16:55:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5e24ca89-452c-4ed0-b584-adad9fd73545 tempest-AttachVolumeNegativeTest-860464885 tempest-AttachVolumeNegativeTest-860464885-project-member] Lock "122c6152-2360-448b-b8e6-6d86bc736500" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.786s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:55:17 user nova-compute[73056]: DEBUG nova.compute.manager [req-ca2f0ec9-3ecd-47f7-bcd6-c19561c5f3e5 req-9da82b72-50de-4100-b436-6b05521582de service nova] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Received event network-changed-8301812a-2a56-49e5-8747-f50c95c3de26 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:55:17 user nova-compute[73056]: DEBUG nova.compute.manager [req-ca2f0ec9-3ecd-47f7-bcd6-c19561c5f3e5 req-9da82b72-50de-4100-b436-6b05521582de service nova] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Refreshing instance network info cache due to event network-changed-8301812a-2a56-49e5-8747-f50c95c3de26. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:55:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ca2f0ec9-3ecd-47f7-bcd6-c19561c5f3e5 req-9da82b72-50de-4100-b436-6b05521582de service nova] Acquiring lock "refresh_cache-61357ac0-230f-4711-8954-0bb04bfcb2f6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:55:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ca2f0ec9-3ecd-47f7-bcd6-c19561c5f3e5 req-9da82b72-50de-4100-b436-6b05521582de service nova] Acquired lock "refresh_cache-61357ac0-230f-4711-8954-0bb04bfcb2f6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:55:17 user nova-compute[73056]: DEBUG nova.network.neutron [req-ca2f0ec9-3ecd-47f7-bcd6-c19561c5f3e5 req-9da82b72-50de-4100-b436-6b05521582de service nova] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Refreshing network info cache for port 8301812a-2a56-49e5-8747-f50c95c3de26 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:55:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6bb46c51-8614-4e9c-80e6-b28344af565c tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Acquiring lock "61357ac0-230f-4711-8954-0bb04bfcb2f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:55:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6bb46c51-8614-4e9c-80e6-b28344af565c tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "61357ac0-230f-4711-8954-0bb04bfcb2f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:55:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6bb46c51-8614-4e9c-80e6-b28344af565c tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Acquiring lock "61357ac0-230f-4711-8954-0bb04bfcb2f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:55:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6bb46c51-8614-4e9c-80e6-b28344af565c tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "61357ac0-230f-4711-8954-0bb04bfcb2f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:55:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6bb46c51-8614-4e9c-80e6-b28344af565c tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "61357ac0-230f-4711-8954-0bb04bfcb2f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:55:17 user nova-compute[73056]: INFO nova.compute.manager [None req-6bb46c51-8614-4e9c-80e6-b28344af565c tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Terminating instance
Aug 14 16:55:17 user nova-compute[73056]: DEBUG nova.compute.manager [None req-6bb46c51-8614-4e9c-80e6-b28344af565c tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 16:55:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:18 user nova-compute[73056]: DEBUG nova.network.neutron [req-ca2f0ec9-3ecd-47f7-bcd6-c19561c5f3e5 req-9da82b72-50de-4100-b436-6b05521582de service nova] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Updated VIF entry in instance network info cache for port 8301812a-2a56-49e5-8747-f50c95c3de26. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:55:18 user nova-compute[73056]: DEBUG nova.network.neutron [req-ca2f0ec9-3ecd-47f7-bcd6-c19561c5f3e5 req-9da82b72-50de-4100-b436-6b05521582de service nova] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Updating instance_info_cache with network_info: [{"id": "8301812a-2a56-49e5-8747-f50c95c3de26", "address": "fa:16:3e:77:f0:bf", "network": {"id": "c2b49cd1-a248-4bd2-924f-bd8b560aed47", "bridge": "br-int", "label": "tempest-TestStampPattern-1795667966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d796c14bd3489883e161ea1b311ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8301812a-2a", "ovs_interfaceid": "8301812a-2a56-49e5-8747-f50c95c3de26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:55:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ca2f0ec9-3ecd-47f7-bcd6-c19561c5f3e5 req-9da82b72-50de-4100-b436-6b05521582de service nova] Releasing lock "refresh_cache-61357ac0-230f-4711-8954-0bb04bfcb2f6" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:55:18 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Instance destroyed successfully.
Aug 14 16:55:18 user nova-compute[73056]: DEBUG nova.objects.instance [None req-6bb46c51-8614-4e9c-80e6-b28344af565c tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lazy-loading 'resources' on Instance uuid 61357ac0-230f-4711-8954-0bb04bfcb2f6 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:55:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-6bb46c51-8614-4e9c-80e6-b28344af565c tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:47:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-467601654',display_name='tempest-TestStampPattern-server-467601654',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-467601654',id=28,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1L8q/UE/lP/2VxMJW4uvrcAleicidYPp3XEOqORx+N0k8ZiuhpRRdaAVC38mPfWQU7Ahb0+HsQ9477x/V7V9afEg8xu6rOrZVCKgLaCY5Gqr1Mn3uZleqqMyDV507BJw==',key_name='tempest-TestStampPattern-2127629561',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:47:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2d796c14bd3489883e161ea1b311ca5',ramdisk_id='',reservation_id='r-fx0covhi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1217754811',owner_user_name='tempest-TestStampPattern-1217754811-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:51:05Z,user_data=None,user_id='18edcf10dda041c8a2bde2fb231b4fde',uuid=61357ac0-230f-4711-8954-0bb04bfcb2f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8301812a-2a56-49e5-8747-f50c95c3de26", "address": "fa:16:3e:77:f0:bf", "network": {"id": "c2b49cd1-a248-4bd2-924f-bd8b560aed47", "bridge": "br-int", "label": "tempest-TestStampPattern-1795667966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d796c14bd3489883e161ea1b311ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8301812a-2a", "ovs_interfaceid": "8301812a-2a56-49e5-8747-f50c95c3de26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:55:18 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-6bb46c51-8614-4e9c-80e6-b28344af565c tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Converting VIF {"id": "8301812a-2a56-49e5-8747-f50c95c3de26", "address": "fa:16:3e:77:f0:bf", "network": {"id": "c2b49cd1-a248-4bd2-924f-bd8b560aed47", "bridge": "br-int", "label": "tempest-TestStampPattern-1795667966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2d796c14bd3489883e161ea1b311ca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8301812a-2a", "ovs_interfaceid": "8301812a-2a56-49e5-8747-f50c95c3de26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:55:18 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-6bb46c51-8614-4e9c-80e6-b28344af565c tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:f0:bf,bridge_name='br-int',has_traffic_filtering=True,id=8301812a-2a56-49e5-8747-f50c95c3de26,network=Network(c2b49cd1-a248-4bd2-924f-bd8b560aed47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8301812a-2a') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:55:18 user nova-compute[73056]: DEBUG os_vif [None req-6bb46c51-8614-4e9c-80e6-b28344af565c tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:f0:bf,bridge_name='br-int',has_traffic_filtering=True,id=8301812a-2a56-49e5-8747-f50c95c3de26,network=Network(c2b49cd1-a248-4bd2-924f-bd8b560aed47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8301812a-2a') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:55:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8301812a-2a, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:55:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:18 user nova-compute[73056]: INFO os_vif [None req-6bb46c51-8614-4e9c-80e6-b28344af565c tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:f0:bf,bridge_name='br-int',has_traffic_filtering=True,id=8301812a-2a56-49e5-8747-f50c95c3de26,network=Network(c2b49cd1-a248-4bd2-924f-bd8b560aed47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8301812a-2a')
Aug 14 16:55:18 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-6bb46c51-8614-4e9c-80e6-b28344af565c tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Deleting instance files /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6_del
Aug 14 16:55:18 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-6bb46c51-8614-4e9c-80e6-b28344af565c tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Deletion of /opt/stack/data/nova/instances/61357ac0-230f-4711-8954-0bb04bfcb2f6_del complete
Aug 14 16:55:18 user nova-compute[73056]: INFO nova.compute.manager [None req-6bb46c51-8614-4e9c-80e6-b28344af565c tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 14 16:55:18 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-6bb46c51-8614-4e9c-80e6-b28344af565c tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 16:55:18 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 16:55:18 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 16:55:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:18 user nova-compute[73056]: DEBUG nova.compute.manager [req-e84e71e1-c1fc-4916-a8f8-5ecf9a00ef05 req-f2c969a8-b6fa-48ae-b2c1-38fdc5c21efc service nova] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Received event network-vif-unplugged-8301812a-2a56-49e5-8747-f50c95c3de26 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:55:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e84e71e1-c1fc-4916-a8f8-5ecf9a00ef05 req-f2c969a8-b6fa-48ae-b2c1-38fdc5c21efc service nova] Acquiring lock "61357ac0-230f-4711-8954-0bb04bfcb2f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:55:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e84e71e1-c1fc-4916-a8f8-5ecf9a00ef05 req-f2c969a8-b6fa-48ae-b2c1-38fdc5c21efc service nova] Lock "61357ac0-230f-4711-8954-0bb04bfcb2f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:55:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e84e71e1-c1fc-4916-a8f8-5ecf9a00ef05 req-f2c969a8-b6fa-48ae-b2c1-38fdc5c21efc service nova] Lock "61357ac0-230f-4711-8954-0bb04bfcb2f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:55:18 user nova-compute[73056]: DEBUG nova.compute.manager [req-e84e71e1-c1fc-4916-a8f8-5ecf9a00ef05 req-f2c969a8-b6fa-48ae-b2c1-38fdc5c21efc service nova] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] No waiting events found dispatching network-vif-unplugged-8301812a-2a56-49e5-8747-f50c95c3de26 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:55:18 user nova-compute[73056]: DEBUG nova.compute.manager [req-e84e71e1-c1fc-4916-a8f8-5ecf9a00ef05 req-f2c969a8-b6fa-48ae-b2c1-38fdc5c21efc service nova] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Received event network-vif-unplugged-8301812a-2a56-49e5-8747-f50c95c3de26 for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:55:18 user nova-compute[73056]: DEBUG nova.compute.manager [req-e84e71e1-c1fc-4916-a8f8-5ecf9a00ef05 req-f2c969a8-b6fa-48ae-b2c1-38fdc5c21efc service nova] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Received event network-vif-plugged-8301812a-2a56-49e5-8747-f50c95c3de26 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:55:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e84e71e1-c1fc-4916-a8f8-5ecf9a00ef05 req-f2c969a8-b6fa-48ae-b2c1-38fdc5c21efc service nova] Acquiring lock "61357ac0-230f-4711-8954-0bb04bfcb2f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:55:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e84e71e1-c1fc-4916-a8f8-5ecf9a00ef05 req-f2c969a8-b6fa-48ae-b2c1-38fdc5c21efc service nova] Lock "61357ac0-230f-4711-8954-0bb04bfcb2f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:55:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e84e71e1-c1fc-4916-a8f8-5ecf9a00ef05 req-f2c969a8-b6fa-48ae-b2c1-38fdc5c21efc service nova] Lock "61357ac0-230f-4711-8954-0bb04bfcb2f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:55:18 user nova-compute[73056]: DEBUG nova.compute.manager [req-e84e71e1-c1fc-4916-a8f8-5ecf9a00ef05 req-f2c969a8-b6fa-48ae-b2c1-38fdc5c21efc service nova] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] No waiting events found dispatching network-vif-plugged-8301812a-2a56-49e5-8747-f50c95c3de26 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:55:18 user nova-compute[73056]: WARNING nova.compute.manager [req-e84e71e1-c1fc-4916-a8f8-5ecf9a00ef05 req-f2c969a8-b6fa-48ae-b2c1-38fdc5c21efc service nova] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Received unexpected event network-vif-plugged-8301812a-2a56-49e5-8747-f50c95c3de26 for instance with vm_state active and task_state deleting.
Aug 14 16:55:19 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:55:19 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Took 1.08 seconds to deallocate network for instance.
Aug 14 16:55:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6bb46c51-8614-4e9c-80e6-b28344af565c tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:55:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6bb46c51-8614-4e9c-80e6-b28344af565c tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:55:19 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-6bb46c51-8614-4e9c-80e6-b28344af565c tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:55:19 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-6bb46c51-8614-4e9c-80e6-b28344af565c tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:55:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6bb46c51-8614-4e9c-80e6-b28344af565c tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.235s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:55:19 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-6bb46c51-8614-4e9c-80e6-b28344af565c tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Deleted allocations for instance 61357ac0-230f-4711-8954-0bb04bfcb2f6
Aug 14 16:55:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6bb46c51-8614-4e9c-80e6-b28344af565c tempest-TestStampPattern-1217754811 tempest-TestStampPattern-1217754811-project-member] Lock "61357ac0-230f-4711-8954-0bb04bfcb2f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.371s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:55:21 user nova-compute[73056]: DEBUG nova.compute.manager [req-d5f97659-c250-4fc6-a5e7-d5588556a48f req-d3a03f9f-bd22-405d-87e0-4c08ab6aff25 service nova] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Received event network-vif-deleted-8301812a-2a56-49e5-8747-f50c95c3de26 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:55:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:26 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "5191b082-a6f3-467c-b28b-fda85e15f330" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:55:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "5191b082-a6f3-467c-b28b-fda85e15f330" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:55:28 user nova-compute[73056]: DEBUG nova.compute.manager [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:55:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "6c9ce215-9006-468d-998d-a18df5bf4222" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:55:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "6c9ce215-9006-468d-998d-a18df5bf4222" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:55:28 user nova-compute[73056]: DEBUG nova.compute.manager [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:55:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:55:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:55:28 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:55:28 user nova-compute[73056]: INFO nova.compute.claims [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Claim successful on node user
Aug 14 16:55:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:55:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:28 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:55:28 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:55:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.354s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:55:28 user nova-compute[73056]: DEBUG nova.compute.manager [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:55:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.312s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:55:28 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:55:28 user nova-compute[73056]: INFO nova.compute.claims [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Claim successful on node user
Aug 14 16:55:28 user nova-compute[73056]: DEBUG nova.compute.manager [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:55:28 user nova-compute[73056]: DEBUG nova.network.neutron [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:55:28 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:55:28 user nova-compute[73056]: DEBUG nova.compute.manager [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:55:28 user nova-compute[73056]: DEBUG nova.policy [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '958f0c79efdc4352b35874e6c6f940d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56fc678888b4653802e94ac6b47f95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:55:28 user nova-compute[73056]: DEBUG nova.compute.manager [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:55:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:55:28 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Creating image(s)
Aug 14 16:55:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "/opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:55:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "/opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:55:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "/opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:55:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.403s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG nova.compute.manager [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.197s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "c889592ab94cd0b0ce896f27a2af0323771db234" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG nova.compute.manager [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG nova.network.neutron [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:55:29 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:55:29 user nova-compute[73056]: DEBUG nova.compute.manager [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:55:29 user nova-compute[73056]: INFO nova.virt.block_device [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Booting with volume f6491f97-549b-46cc-9de0-96a2ad50a297 at /dev/vda
Aug 14 16:55:29 user nova-compute[73056]: DEBUG nova.policy [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2be1b098ca9f4232bd198b515630f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffb5203b9284500b8add8a6586cad49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.189s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG os_brick.utils [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk 1073741824" returned: 0 in 0.054s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8633518-0335-4601-999a-440385dd3de7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[59673827-9711-4e4f-af15-994891337af1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e051e8-e459-40ae-b3a9-b7ee172deacf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cd010d-6aaf-4249-ae68-ea7f21e524d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG nova.network.neutron [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Successfully created port: dee958cc-5a62-479c-8429-4c503bef3672 {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:55:29 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:55:29 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a629c125-9c42-440e-b530-cd3c00b6b12a]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG os_brick.utils [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Updating existing volume attachment record: f913d8e0-faa3-4c4f-8a9d-07d5e7892a5f {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.188s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Cannot resize image /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG nova.objects.instance [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lazy-loading 'migration_context' on Instance uuid 5191b082-a6f3-467c-b28b-fda85e15f330 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Ensure instance console log exists: /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:55:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.network.neutron [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Successfully created port: 09f698e2-41d7-4329-92b1-9a80dc461259 {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692032115.333664, 122c6152-2360-448b-b8e6-6d86bc736500 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:55:30 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] VM Stopped (Lifecycle Event)
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.compute.manager [None req-2801d8e8-a3cf-495b-91f5-c94ec421fd9c None None] [instance: 122c6152-2360-448b-b8e6-6d86bc736500] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.network.neutron [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Successfully updated port: dee958cc-5a62-479c-8429-4c503bef3672 {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "refresh_cache-5191b082-a6f3-467c-b28b-fda85e15f330" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquired lock "refresh_cache-5191b082-a6f3-467c-b28b-fda85e15f330" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.network.neutron [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.compute.manager [req-a471ab31-217e-4b04-b030-4023c6199f5f req-1d75e177-9124-4003-ab18-5bc3964af0ce service nova] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Received event network-changed-dee958cc-5a62-479c-8429-4c503bef3672 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.compute.manager [req-a471ab31-217e-4b04-b030-4023c6199f5f req-1d75e177-9124-4003-ab18-5bc3964af0ce service nova] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Refreshing instance network info cache due to event network-changed-dee958cc-5a62-479c-8429-4c503bef3672. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a471ab31-217e-4b04-b030-4023c6199f5f req-1d75e177-9124-4003-ab18-5bc3964af0ce service nova] Acquiring lock "refresh_cache-5191b082-a6f3-467c-b28b-fda85e15f330" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.network.neutron [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.network.neutron [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Updating instance_info_cache with network_info: [{"id": "dee958cc-5a62-479c-8429-4c503bef3672", "address": "fa:16:3e:3e:a3:b5", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee958cc-5a", "ovs_interfaceid": "dee958cc-5a62-479c-8429-4c503bef3672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.network.neutron [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Successfully updated port: 09f698e2-41d7-4329-92b1-9a80dc461259 {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Releasing lock "refresh_cache-5191b082-a6f3-467c-b28b-fda85e15f330" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.compute.manager [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Instance network_info: |[{"id": "dee958cc-5a62-479c-8429-4c503bef3672", "address": "fa:16:3e:3e:a3:b5", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee958cc-5a", "ovs_interfaceid": "dee958cc-5a62-479c-8429-4c503bef3672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a471ab31-217e-4b04-b030-4023c6199f5f req-1d75e177-9124-4003-ab18-5bc3964af0ce service nova] Acquired lock "refresh_cache-5191b082-a6f3-467c-b28b-fda85e15f330" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.network.neutron [req-a471ab31-217e-4b04-b030-4023c6199f5f req-1d75e177-9124-4003-ab18-5bc3964af0ce service nova] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Refreshing network info cache for port dee958cc-5a62-479c-8429-4c503bef3672 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Start _get_guest_xml network_info=[{"id": "dee958cc-5a62-479c-8429-4c503bef3672", "address": "fa:16:3e:3e:a3:b5", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee958cc-5a", "ovs_interfaceid": "dee958cc-5a62-479c-8429-4c503bef3672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "refresh_cache-6c9ce215-9006-468d-998d-a18df5bf4222" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquired lock "refresh_cache-6c9ce215-9006-468d-998d-a18df5bf4222" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.network.neutron [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:55:30 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:55:30 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:55:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-608145548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-608145548',id=40,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a56fc678888b4653802e94ac6b47f95d',ramdisk_id='',reservation_id='r-e0807ie7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-572642883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:55:29Z,user_data=None,user_id='958f0c79efdc4352b35874e6c6f940d8',uuid=5191b082-a6f3-467c-b28b-fda85e15f330,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dee958cc-5a62-479c-8429-4c503bef3672", "address": "fa:16:3e:3e:a3:b5", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee958cc-5a", "ovs_interfaceid": "dee958cc-5a62-479c-8429-4c503bef3672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Converting VIF {"id": "dee958cc-5a62-479c-8429-4c503bef3672", "address": "fa:16:3e:3e:a3:b5", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee958cc-5a", "ovs_interfaceid": "dee958cc-5a62-479c-8429-4c503bef3672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:a3:b5,bridge_name='br-int',has_traffic_filtering=True,id=dee958cc-5a62-479c-8429-4c503bef3672,network=Network(ac2d700d-98d2-4459-8da8-a4858cda8864),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdee958cc-5a') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.objects.instance [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lazy-loading 'pci_devices' on Instance uuid 5191b082-a6f3-467c-b28b-fda85e15f330 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.compute.manager [req-1a0dfa24-047f-4a35-93c3-49dee6b52263 req-1ff0b5c2-fc1e-4650-9234-ae0535c3bde4 service nova] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Received event network-changed-09f698e2-41d7-4329-92b1-9a80dc461259 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.compute.manager [req-1a0dfa24-047f-4a35-93c3-49dee6b52263 req-1ff0b5c2-fc1e-4650-9234-ae0535c3bde4 service nova] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Refreshing instance network info cache due to event network-changed-09f698e2-41d7-4329-92b1-9a80dc461259. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1a0dfa24-047f-4a35-93c3-49dee6b52263 req-1ff0b5c2-fc1e-4650-9234-ae0535c3bde4 service nova] Acquiring lock "refresh_cache-6c9ce215-9006-468d-998d-a18df5bf4222" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.network.neutron [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:55:30 user nova-compute[73056]:   <uuid>5191b082-a6f3-467c-b28b-fda85e15f330</uuid>
Aug 14 16:55:30 user nova-compute[73056]:   <name>instance-00000028</name>
Aug 14 16:55:30 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:55:30 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:55:30 user nova-compute[73056]:   <metadata>
Aug 14 16:55:30 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:55:30 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:55:30 user nova-compute[73056]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-608145548</nova:name>
Aug 14 16:55:30 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:55:30</nova:creationTime>
Aug 14 16:55:30 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:55:30 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:55:30 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:55:30 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:55:30 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:55:30 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:55:30 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:55:30 user nova-compute[73056]:       <nova:owner>
Aug 14 16:55:30 user nova-compute[73056]:         <nova:user uuid="958f0c79efdc4352b35874e6c6f940d8">tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member</nova:user>
Aug 14 16:55:30 user nova-compute[73056]:         <nova:project uuid="a56fc678888b4653802e94ac6b47f95d">tempest-ServerBootFromVolumeStableRescueTest-572642883</nova:project>
Aug 14 16:55:30 user nova-compute[73056]:       </nova:owner>
Aug 14 16:55:30 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:55:30 user nova-compute[73056]:       <nova:ports>
Aug 14 16:55:30 user nova-compute[73056]:         <nova:port uuid="dee958cc-5a62-479c-8429-4c503bef3672">
Aug 14 16:55:30 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 16:55:30 user nova-compute[73056]:         </nova:port>
Aug 14 16:55:30 user nova-compute[73056]:       </nova:ports>
Aug 14 16:55:30 user nova-compute[73056]:     </nova:instance>
Aug 14 16:55:30 user nova-compute[73056]:   </metadata>
Aug 14 16:55:30 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:55:30 user nova-compute[73056]:     <system>
Aug 14 16:55:30 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:55:30 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:55:30 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:55:30 user nova-compute[73056]:       <entry name="serial">5191b082-a6f3-467c-b28b-fda85e15f330</entry>
Aug 14 16:55:30 user nova-compute[73056]:       <entry name="uuid">5191b082-a6f3-467c-b28b-fda85e15f330</entry>
Aug 14 16:55:30 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:55:30 user nova-compute[73056]:     </system>
Aug 14 16:55:30 user nova-compute[73056]:   </sysinfo>
Aug 14 16:55:30 user nova-compute[73056]:   <os>
Aug 14 16:55:30 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:55:30 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:55:30 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:55:30 user nova-compute[73056]:   </os>
Aug 14 16:55:30 user nova-compute[73056]:   <features>
Aug 14 16:55:30 user nova-compute[73056]:     <acpi/>
Aug 14 16:55:30 user nova-compute[73056]:     <apic/>
Aug 14 16:55:30 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:55:30 user nova-compute[73056]:   </features>
Aug 14 16:55:30 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:55:30 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:55:30 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:55:30 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:55:30 user nova-compute[73056]:   </clock>
Aug 14 16:55:30 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:55:30 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:55:30 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:55:30 user nova-compute[73056]:   </cpu>
Aug 14 16:55:30 user nova-compute[73056]:   <devices>
Aug 14 16:55:30 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:55:30 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:55:30 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk"/>
Aug 14 16:55:30 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:55:30 user nova-compute[73056]:     </disk>
Aug 14 16:55:30 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:55:30 user nova-compute[73056]:       <mac address="fa:16:3e:3e:a3:b5"/>
Aug 14 16:55:30 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:55:30 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:55:30 user nova-compute[73056]:       <target dev="tapdee958cc-5a"/>
Aug 14 16:55:30 user nova-compute[73056]:     </interface>
Aug 14 16:55:30 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:55:30 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/console.log" append="off"/>
Aug 14 16:55:30 user nova-compute[73056]:     </serial>
Aug 14 16:55:30 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:55:30 user nova-compute[73056]:     <video>
Aug 14 16:55:30 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:55:30 user nova-compute[73056]:     </video>
Aug 14 16:55:30 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:55:30 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:55:30 user nova-compute[73056]:     </rng>
Aug 14 16:55:30 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:55:30 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:55:30 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:55:30 user nova-compute[73056]:     </memballoon>
Aug 14 16:55:30 user nova-compute[73056]:   </devices>
Aug 14 16:55:30 user nova-compute[73056]: </domain>
Aug 14 16:55:30 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:55:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-608145548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-608145548',id=40,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a56fc678888b4653802e94ac6b47f95d',ramdisk_id='',reservation_id='r-e0807ie7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-572642883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:55:29Z,user_data=None,user_id='958f0c79efdc4352b35874e6c6f940d8',uuid=5191b082-a6f3-467c-b28b-fda85e15f330,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dee958cc-5a62-479c-8429-4c503bef3672", "address": "fa:16:3e:3e:a3:b5", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee958cc-5a", "ovs_interfaceid": "dee958cc-5a62-479c-8429-4c503bef3672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Converting VIF {"id": "dee958cc-5a62-479c-8429-4c503bef3672", "address": "fa:16:3e:3e:a3:b5", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee958cc-5a", "ovs_interfaceid": "dee958cc-5a62-479c-8429-4c503bef3672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:a3:b5,bridge_name='br-int',has_traffic_filtering=True,id=dee958cc-5a62-479c-8429-4c503bef3672,network=Network(ac2d700d-98d2-4459-8da8-a4858cda8864),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdee958cc-5a') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG os_vif [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:a3:b5,bridge_name='br-int',has_traffic_filtering=True,id=dee958cc-5a62-479c-8429-4c503bef3672,network=Network(ac2d700d-98d2-4459-8da8-a4858cda8864),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdee958cc-5a') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdee958cc-5a, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdee958cc-5a, col_values=(('external_ids', {'iface-id': 'dee958cc-5a62-479c-8429-4c503bef3672', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:a3:b5', 'vm-uuid': '5191b082-a6f3-467c-b28b-fda85e15f330'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:30 user nova-compute[73056]: INFO os_vif [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:a3:b5,bridge_name='br-int',has_traffic_filtering=True,id=dee958cc-5a62-479c-8429-4c503bef3672,network=Network(ac2d700d-98d2-4459-8da8-a4858cda8864),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdee958cc-5a')
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:55:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] No VIF found with MAC fa:16:3e:3e:a3:b5, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:55:31 user nova-compute[73056]: DEBUG nova.network.neutron [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Updating instance_info_cache with network_info: [{"id": "09f698e2-41d7-4329-92b1-9a80dc461259", "address": "fa:16:3e:dc:48:7c", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f698e2-41", "ovs_interfaceid": "09f698e2-41d7-4329-92b1-9a80dc461259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:55:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Releasing lock "refresh_cache-6c9ce215-9006-468d-998d-a18df5bf4222" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:55:31 user nova-compute[73056]: DEBUG nova.compute.manager [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Instance network_info: |[{"id": "09f698e2-41d7-4329-92b1-9a80dc461259", "address": "fa:16:3e:dc:48:7c", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f698e2-41", "ovs_interfaceid": "09f698e2-41d7-4329-92b1-9a80dc461259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:55:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1a0dfa24-047f-4a35-93c3-49dee6b52263 req-1ff0b5c2-fc1e-4650-9234-ae0535c3bde4 service nova] Acquired lock "refresh_cache-6c9ce215-9006-468d-998d-a18df5bf4222" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:55:31 user nova-compute[73056]: DEBUG nova.network.neutron [req-1a0dfa24-047f-4a35-93c3-49dee6b52263 req-1ff0b5c2-fc1e-4650-9234-ae0535c3bde4 service nova] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Refreshing network info cache for port 09f698e2-41d7-4329-92b1-9a80dc461259 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:55:31 user nova-compute[73056]: DEBUG nova.network.neutron [req-a471ab31-217e-4b04-b030-4023c6199f5f req-1d75e177-9124-4003-ab18-5bc3964af0ce service nova] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Updated VIF entry in instance network info cache for port dee958cc-5a62-479c-8429-4c503bef3672. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:55:31 user nova-compute[73056]: DEBUG nova.network.neutron [req-a471ab31-217e-4b04-b030-4023c6199f5f req-1d75e177-9124-4003-ab18-5bc3964af0ce service nova] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Updating instance_info_cache with network_info: [{"id": "dee958cc-5a62-479c-8429-4c503bef3672", "address": "fa:16:3e:3e:a3:b5", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee958cc-5a", "ovs_interfaceid": "dee958cc-5a62-479c-8429-4c503bef3672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:55:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a471ab31-217e-4b04-b030-4023c6199f5f req-1d75e177-9124-4003-ab18-5bc3964af0ce service nova] Releasing lock "refresh_cache-5191b082-a6f3-467c-b28b-fda85e15f330" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:55:31 user nova-compute[73056]: DEBUG nova.network.neutron [req-1a0dfa24-047f-4a35-93c3-49dee6b52263 req-1ff0b5c2-fc1e-4650-9234-ae0535c3bde4 service nova] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Updated VIF entry in instance network info cache for port 09f698e2-41d7-4329-92b1-9a80dc461259. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:55:31 user nova-compute[73056]: DEBUG nova.network.neutron [req-1a0dfa24-047f-4a35-93c3-49dee6b52263 req-1ff0b5c2-fc1e-4650-9234-ae0535c3bde4 service nova] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Updating instance_info_cache with network_info: [{"id": "09f698e2-41d7-4329-92b1-9a80dc461259", "address": "fa:16:3e:dc:48:7c", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f698e2-41", "ovs_interfaceid": "09f698e2-41d7-4329-92b1-9a80dc461259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:55:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1a0dfa24-047f-4a35-93c3-49dee6b52263 req-1ff0b5c2-fc1e-4650-9234-ae0535c3bde4 service nova] Releasing lock "refresh_cache-6c9ce215-9006-468d-998d-a18df5bf4222" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:55:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:32 user nova-compute[73056]: DEBUG nova.compute.manager [req-5b4e16a2-74f5-4358-89be-7770d1e4b87d req-8d5ad511-acb3-44b2-854c-5bfc9d34bb86 service nova] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Received event network-vif-plugged-dee958cc-5a62-479c-8429-4c503bef3672 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:55:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-5b4e16a2-74f5-4358-89be-7770d1e4b87d req-8d5ad511-acb3-44b2-854c-5bfc9d34bb86 service nova] Acquiring lock "5191b082-a6f3-467c-b28b-fda85e15f330-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:55:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-5b4e16a2-74f5-4358-89be-7770d1e4b87d req-8d5ad511-acb3-44b2-854c-5bfc9d34bb86 service nova] Lock "5191b082-a6f3-467c-b28b-fda85e15f330-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:55:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-5b4e16a2-74f5-4358-89be-7770d1e4b87d req-8d5ad511-acb3-44b2-854c-5bfc9d34bb86 service nova] Lock "5191b082-a6f3-467c-b28b-fda85e15f330-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:55:32 user nova-compute[73056]: DEBUG nova.compute.manager [req-5b4e16a2-74f5-4358-89be-7770d1e4b87d req-8d5ad511-acb3-44b2-854c-5bfc9d34bb86 service nova] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] No waiting events found dispatching network-vif-plugged-dee958cc-5a62-479c-8429-4c503bef3672 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:55:32 user nova-compute[73056]: WARNING nova.compute.manager [req-5b4e16a2-74f5-4358-89be-7770d1e4b87d req-8d5ad511-acb3-44b2-854c-5bfc9d34bb86 service nova] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Received unexpected event network-vif-plugged-dee958cc-5a62-479c-8429-4c503bef3672 for instance with vm_state building and task_state spawning.
Aug 14 16:55:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:33 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692032118.409699, 61357ac0-230f-4711-8954-0bb04bfcb2f6 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:55:33 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] VM Stopped (Lifecycle Event)
Aug 14 16:55:33 user nova-compute[73056]: DEBUG nova.compute.manager [None req-94719b09-83cd-4ab4-b889-2cc774241b9e None None] [instance: 61357ac0-230f-4711-8954-0bb04bfcb2f6] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:55:34 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692032134.4361813, 5191b082-a6f3-467c-b28b-fda85e15f330 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:55:34 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] VM Resumed (Lifecycle Event)
Aug 14 16:55:34 user nova-compute[73056]: DEBUG nova.compute.manager [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:55:34 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:55:34 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Instance spawned successfully.
Aug 14 16:55:34 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:55:34 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:55:34 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:55:34 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:55:34 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:55:34 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:55:34 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:55:34 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:55:34 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:55:34 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:55:34 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692032134.4376154, 5191b082-a6f3-467c-b28b-fda85e15f330 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:55:34 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] VM Started (Lifecycle Event)
Aug 14 16:55:34 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:55:34 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:55:34 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:55:34 user nova-compute[73056]: INFO nova.compute.manager [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Took 5.67 seconds to spawn the instance on the hypervisor.
Aug 14 16:55:34 user nova-compute[73056]: DEBUG nova.compute.manager [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:55:34 user nova-compute[73056]: DEBUG nova.compute.manager [req-d8ad6f02-2b1b-493a-bf79-1d0e51e45642 req-d4544941-299a-45d4-ba11-97004a455dd5 service nova] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Received event network-vif-plugged-dee958cc-5a62-479c-8429-4c503bef3672 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:55:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-d8ad6f02-2b1b-493a-bf79-1d0e51e45642 req-d4544941-299a-45d4-ba11-97004a455dd5 service nova] Acquiring lock "5191b082-a6f3-467c-b28b-fda85e15f330-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:55:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-d8ad6f02-2b1b-493a-bf79-1d0e51e45642 req-d4544941-299a-45d4-ba11-97004a455dd5 service nova] Lock "5191b082-a6f3-467c-b28b-fda85e15f330-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:55:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-d8ad6f02-2b1b-493a-bf79-1d0e51e45642 req-d4544941-299a-45d4-ba11-97004a455dd5 service nova] Lock "5191b082-a6f3-467c-b28b-fda85e15f330-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:55:34 user nova-compute[73056]: DEBUG nova.compute.manager [req-d8ad6f02-2b1b-493a-bf79-1d0e51e45642 req-d4544941-299a-45d4-ba11-97004a455dd5 service nova] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] No waiting events found dispatching network-vif-plugged-dee958cc-5a62-479c-8429-4c503bef3672 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:55:34 user nova-compute[73056]: WARNING nova.compute.manager [req-d8ad6f02-2b1b-493a-bf79-1d0e51e45642 req-d4544941-299a-45d4-ba11-97004a455dd5 service nova] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Received unexpected event network-vif-plugged-dee958cc-5a62-479c-8429-4c503bef3672 for instance with vm_state building and task_state spawning.
Aug 14 16:55:34 user nova-compute[73056]: INFO nova.compute.manager [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Took 6.34 seconds to build instance.
Aug 14 16:55:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ffee76c4-d2e5-46f8-a6fe-4feda11081c9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "5191b082-a6f3-467c-b28b-fda85e15f330" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.436s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:55:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG nova.compute.manager [req-53f8e5d1-2966-4274-8b0f-c5a564afcd69 req-b00ed343-c8a8-4485-971a-310a431d60c6 service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Received event network-changed-9cdd486e-fc3e-4637-8958-eb7e065728fc {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG nova.compute.manager [req-53f8e5d1-2966-4274-8b0f-c5a564afcd69 req-b00ed343-c8a8-4485-971a-310a431d60c6 service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Refreshing instance network info cache due to event network-changed-9cdd486e-fc3e-4637-8958-eb7e065728fc. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-53f8e5d1-2966-4274-8b0f-c5a564afcd69 req-b00ed343-c8a8-4485-971a-310a431d60c6 service nova] Acquiring lock "refresh_cache-6910e1fe-8863-4a4b-b975-48c9ebb0b087" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-53f8e5d1-2966-4274-8b0f-c5a564afcd69 req-b00ed343-c8a8-4485-971a-310a431d60c6 service nova] Acquired lock "refresh_cache-6910e1fe-8863-4a4b-b975-48c9ebb0b087" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG nova.network.neutron [req-53f8e5d1-2966-4274-8b0f-c5a564afcd69 req-b00ed343-c8a8-4485-971a-310a431d60c6 service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Refreshing network info cache for port 9cdd486e-fc3e-4637-8958-eb7e065728fc {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Acquiring lock "6910e1fe-8863-4a4b-b975-48c9ebb0b087" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lock "6910e1fe-8863-4a4b-b975-48c9ebb0b087" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Acquiring lock "6910e1fe-8863-4a4b-b975-48c9ebb0b087-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lock "6910e1fe-8863-4a4b-b975-48c9ebb0b087-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lock "6910e1fe-8863-4a4b-b975-48c9ebb0b087-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:55:38 user nova-compute[73056]: INFO nova.compute.manager [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Terminating instance
Aug 14 16:55:38 user nova-compute[73056]: DEBUG nova.compute.manager [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG nova.compute.manager [req-32458077-8305-41aa-baf6-d0aedb595912 req-3fcec573-76ef-45c4-bd3d-d0dc3ba9afbc service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Received event network-vif-unplugged-9cdd486e-fc3e-4637-8958-eb7e065728fc {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-32458077-8305-41aa-baf6-d0aedb595912 req-3fcec573-76ef-45c4-bd3d-d0dc3ba9afbc service nova] Acquiring lock "6910e1fe-8863-4a4b-b975-48c9ebb0b087-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-32458077-8305-41aa-baf6-d0aedb595912 req-3fcec573-76ef-45c4-bd3d-d0dc3ba9afbc service nova] Lock "6910e1fe-8863-4a4b-b975-48c9ebb0b087-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-32458077-8305-41aa-baf6-d0aedb595912 req-3fcec573-76ef-45c4-bd3d-d0dc3ba9afbc service nova] Lock "6910e1fe-8863-4a4b-b975-48c9ebb0b087-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG nova.compute.manager [req-32458077-8305-41aa-baf6-d0aedb595912 req-3fcec573-76ef-45c4-bd3d-d0dc3ba9afbc service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] No waiting events found dispatching network-vif-unplugged-9cdd486e-fc3e-4637-8958-eb7e065728fc {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG nova.compute.manager [req-32458077-8305-41aa-baf6-d0aedb595912 req-3fcec573-76ef-45c4-bd3d-d0dc3ba9afbc service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Received event network-vif-unplugged-9cdd486e-fc3e-4637-8958-eb7e065728fc for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG nova.compute.manager [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:55:38 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Creating image(s)
Aug 14 16:55:38 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Did not create local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Ensure instance console log exists: /opt/stack/data/nova/instances/6c9ce215-9006-468d-998d-a18df5bf4222/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Start _get_guest_xml network_info=[{"id": "09f698e2-41d7-4329-92b1-9a80dc461259", "address": "fa:16:3e:dc:48:7c", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f698e2-41", "ovs_interfaceid": "09f698e2-41d7-4329-92b1-9a80dc461259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbFahCRc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6c9ce215-9006-468d-998d-a18df5bf4222', 'attached_at': '', 'detached_at': '', 'volume_id': 'f6491f97-549b-46cc-9de0-96a2ad50a297', 'serial': 'f6491f97-549b-46cc-9de0-96a2ad50a297'}, 'attachment_id': 'f913d8e0-faa3-4c4f-8a9d-07d5e7892a5f', 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:55:38 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:55:38 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:55:38 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:55:38 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbFahCRc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:55:39 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:55:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:55:39 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:55:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:55:39 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:55:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG nova.network.neutron [req-53f8e5d1-2966-4274-8b0f-c5a564afcd69 req-b00ed343-c8a8-4485-971a-310a431d60c6 service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Updated VIF entry in instance network info cache for port 9cdd486e-fc3e-4637-8958-eb7e065728fc. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG nova.network.neutron [req-53f8e5d1-2966-4274-8b0f-c5a564afcd69 req-b00ed343-c8a8-4485-971a-310a431d60c6 service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Updating instance_info_cache with network_info: [{"id": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "address": "fa:16:3e:ef:51:62", "network": {"id": "73253aa9-a146-4f82-b5bb-1cc2dc68755c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1632478330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd21ca04890479e82483a51d05ba69b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cdd486e-fc", "ovs_interfaceid": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d3aa17-6936-4055-b2a1-4648c99fa844]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:55:39 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-53f8e5d1-2966-4274-8b0f-c5a564afcd69 req-b00ed343-c8a8-4485-971a-310a431d60c6 service nova] Releasing lock "refresh_cache-6910e1fe-8863-4a4b-b975-48c9ebb0b087" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf1f8c8-548e-4ae4-af43-2a603fcb8103]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297] added
Aug 14 16:55:39 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edf1e03-bbab-4e52-83d4-aa63dae4339a]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08ab183-422f-4321-9769-2a95d9fc5133]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UbFahCRc {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:39 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Instance destroyed successfully.
Aug 14 16:55:39 user nova-compute[73056]: DEBUG nova.objects.instance [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lazy-loading 'resources' on Instance uuid 6910e1fe-8863-4a4b-b975-48c9ebb0b087 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T16:50:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-717451743',display_name='tempest-TestShelveInstance-server-717451743',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-717451743',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDhRa2OjjgafvbJzcWrUCAP3qcSeG+uScQ8aA6hOwczKubuJ9/RnKumPvOjbV+/S/S6PA9IzzUTPPv8AfFZzY4UVcbBr5jN47hcUBtIDD3aa8Tw2SRUV7hGEyr2sbVldg==',key_name='tempest-TestShelveInstance-1292582580',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:54:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dcd21ca04890479e82483a51d05ba69b',ramdisk_id='',reservation_id='r-288qfle8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-559346633',owner_user_name='tempest-TestShelveInstance-559346633-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:54:03Z,user_data=None,user_id='d586451958914503bac9c1fb5dedea9e',uuid=6910e1fe-8863-4a4b-b975-48c9ebb0b087,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "address": "fa:16:3e:ef:51:62", "network": {"id": "73253aa9-a146-4f82-b5bb-1cc2dc68755c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1632478330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd21ca04890479e82483a51d05ba69b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cdd486e-fc", "ovs_interfaceid": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Converting VIF {"id": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "address": "fa:16:3e:ef:51:62", "network": {"id": "73253aa9-a146-4f82-b5bb-1cc2dc68755c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1632478330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcd21ca04890479e82483a51d05ba69b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cdd486e-fc", "ovs_interfaceid": "9cdd486e-fc3e-4637-8958-eb7e065728fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:51:62,bridge_name='br-int',has_traffic_filtering=True,id=9cdd486e-fc3e-4637-8958-eb7e065728fc,network=Network(73253aa9-a146-4f82-b5bb-1cc2dc68755c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cdd486e-fc') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG os_vif [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:51:62,bridge_name='br-int',has_traffic_filtering=True,id=9cdd486e-fc3e-4637-8958-eb7e065728fc,network=Network(73253aa9-a146-4f82-b5bb-1cc2dc68755c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cdd486e-fc') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UbFahCRc" returned: 0 in 0.027s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5e31df-9099-40ac-9d73-920685e4358d]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UbFahCRc'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9cdd486e-fc, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:55:39 user nova-compute[73056]: INFO os_vif [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:51:62,bridge_name='br-int',has_traffic_filtering=True,id=9cdd486e-fc3e-4637-8958-eb7e065728fc,network=Network(73253aa9-a146-4f82-b5bb-1cc2dc68755c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cdd486e-fc')
Aug 14 16:55:39 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BinUXqAW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:55:39 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:55:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2170d9ca-30e4-4685-911e-66265b94c5ed]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[35656dee-90e5-4362-8b52-b2d227b7d3af]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)
Aug 14 16:55:39 user nova-compute[73056]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f (non-flash)
Aug 14 16:55:39 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)
Aug 14 16:55:39 user nova-compute[73056]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f (non-flash)
Aug 14 16:55:39 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[750f9a13-d75e-42e8-8c40-a3bdd39d6ac6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297, portal: 172.16.0.220,3260]
Aug 14 16:55:39 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297, portal: 172.16.0.220,3260] successful.
Aug 14 16:55:39 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d924f1e6-4a36-4325-80ad-0835c3d5af5b]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5605d023-846c-4233-adfd-8fb4b36e88f0]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)
Aug 14 16:55:39 user nova-compute[73056]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f (non-flash)
Aug 14 16:55:39 user nova-compute[73056]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:55:39 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)
Aug 14 16:55:39 user nova-compute[73056]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f (non-flash)
Aug 14 16:55:39 user nova-compute[73056]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:55:39 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.360s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e3649e-6187-4782-9acb-529d7fc769a5]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:55:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbFahCRc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '23031633939316662', 'path': '/dev/sdc'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031633939316662', 'path': '/dev/sdc'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.228s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:55:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-935573900',display_name='tempest-TestVolumeBootPattern-server-935573900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-935573900',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBF9UVFrNwhQEMB/CeZfBoQaAoJOYsqM67ncFaZmWIdIzJd1Na96dOaZXAGstQENK3pBtGzJ44fKFGGhrlwWzWMk9Hm8I+KfAGKsRBWs7QP0LhARS9gNshqYVaA6cOdig==',key_name='tempest-TestVolumeBootPattern-829376797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cffb5203b9284500b8add8a6586cad49',ramdisk_id='',reservation_id='r-60nmlk1u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1676214558',owner_user_name='tempest-TestVolumeBootPattern-1676214558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:55:29Z,user_data=None,user_id='2be1b098ca9f4232bd198b515630f6ad',uuid=6c9ce215-9006-468d-998d-a18df5bf4222,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09f698e2-41d7-4329-92b1-9a80dc461259", "address": "fa:16:3e:dc:48:7c", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f698e2-41", "ovs_interfaceid": "09f698e2-41d7-4329-92b1-9a80dc461259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Converting VIF {"id": "09f698e2-41d7-4329-92b1-9a80dc461259", "address": "fa:16:3e:dc:48:7c", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f698e2-41", "ovs_interfaceid": "09f698e2-41d7-4329-92b1-9a80dc461259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:48:7c,bridge_name='br-int',has_traffic_filtering=True,id=09f698e2-41d7-4329-92b1-9a80dc461259,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f698e2-41') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG nova.objects.instance [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c9ce215-9006-468d-998d-a18df5bf4222 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9819ff1-b6ef-452b-8496-57164bd74d88]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:55:40 user nova-compute[73056]:   <uuid>6c9ce215-9006-468d-998d-a18df5bf4222</uuid>
Aug 14 16:55:40 user nova-compute[73056]:   <name>instance-00000027</name>
Aug 14 16:55:40 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:55:40 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:55:40 user nova-compute[73056]:   <metadata>
Aug 14 16:55:40 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:55:40 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:55:40 user nova-compute[73056]:       <nova:name>tempest-TestVolumeBootPattern-server-935573900</nova:name>
Aug 14 16:55:40 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:55:38</nova:creationTime>
Aug 14 16:55:40 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:55:40 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:55:40 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:55:40 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:55:40 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:55:40 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:55:40 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:55:40 user nova-compute[73056]:       <nova:owner>
Aug 14 16:55:40 user nova-compute[73056]:         <nova:user uuid="2be1b098ca9f4232bd198b515630f6ad">tempest-TestVolumeBootPattern-1676214558-project-member</nova:user>
Aug 14 16:55:40 user nova-compute[73056]:         <nova:project uuid="cffb5203b9284500b8add8a6586cad49">tempest-TestVolumeBootPattern-1676214558</nova:project>
Aug 14 16:55:40 user nova-compute[73056]:       </nova:owner>
Aug 14 16:55:40 user nova-compute[73056]:       <nova:ports>
Aug 14 16:55:40 user nova-compute[73056]:         <nova:port uuid="09f698e2-41d7-4329-92b1-9a80dc461259">
Aug 14 16:55:40 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 14 16:55:40 user nova-compute[73056]:         </nova:port>
Aug 14 16:55:40 user nova-compute[73056]:       </nova:ports>
Aug 14 16:55:40 user nova-compute[73056]:     </nova:instance>
Aug 14 16:55:40 user nova-compute[73056]:   </metadata>
Aug 14 16:55:40 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:55:40 user nova-compute[73056]:     <system>
Aug 14 16:55:40 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:55:40 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:55:40 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:55:40 user nova-compute[73056]:       <entry name="serial">6c9ce215-9006-468d-998d-a18df5bf4222</entry>
Aug 14 16:55:40 user nova-compute[73056]:       <entry name="uuid">6c9ce215-9006-468d-998d-a18df5bf4222</entry>
Aug 14 16:55:40 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:55:40 user nova-compute[73056]:     </system>
Aug 14 16:55:40 user nova-compute[73056]:   </sysinfo>
Aug 14 16:55:40 user nova-compute[73056]:   <os>
Aug 14 16:55:40 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:55:40 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:55:40 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:55:40 user nova-compute[73056]:   </os>
Aug 14 16:55:40 user nova-compute[73056]:   <features>
Aug 14 16:55:40 user nova-compute[73056]:     <acpi/>
Aug 14 16:55:40 user nova-compute[73056]:     <apic/>
Aug 14 16:55:40 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:55:40 user nova-compute[73056]:   </features>
Aug 14 16:55:40 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:55:40 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:55:40 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:55:40 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:55:40 user nova-compute[73056]:   </clock>
Aug 14 16:55:40 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:55:40 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:55:40 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:55:40 user nova-compute[73056]:   </cpu>
Aug 14 16:55:40 user nova-compute[73056]:   <devices>
Aug 14 16:55:40 user nova-compute[73056]:     <disk type="block" device="disk">
Aug 14 16:55:40 user nova-compute[73056]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:55:40 user nova-compute[73056]:       <source dev="/dev/sdc"/>
Aug 14 16:55:40 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:55:40 user nova-compute[73056]:       <serial>f6491f97-549b-46cc-9de0-96a2ad50a297</serial>
Aug 14 16:55:40 user nova-compute[73056]:     </disk>
Aug 14 16:55:40 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:55:40 user nova-compute[73056]:       <mac address="fa:16:3e:dc:48:7c"/>
Aug 14 16:55:40 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:55:40 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:55:40 user nova-compute[73056]:       <target dev="tap09f698e2-41"/>
Aug 14 16:55:40 user nova-compute[73056]:     </interface>
Aug 14 16:55:40 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:55:40 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/6c9ce215-9006-468d-998d-a18df5bf4222/console.log" append="off"/>
Aug 14 16:55:40 user nova-compute[73056]:     </serial>
Aug 14 16:55:40 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:55:40 user nova-compute[73056]:     <video>
Aug 14 16:55:40 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:55:40 user nova-compute[73056]:     </video>
Aug 14 16:55:40 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:55:40 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:55:40 user nova-compute[73056]:     </rng>
Aug 14 16:55:40 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:55:40 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:55:40 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:55:40 user nova-compute[73056]:     </memballoon>
Aug 14 16:55:40 user nova-compute[73056]:   </devices>
Aug 14 16:55:40 user nova-compute[73056]: </domain>
Aug 14 16:55:40 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:55:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-935573900',display_name='tempest-TestVolumeBootPattern-server-935573900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-935573900',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBF9UVFrNwhQEMB/CeZfBoQaAoJOYsqM67ncFaZmWIdIzJd1Na96dOaZXAGstQENK3pBtGzJ44fKFGGhrlwWzWMk9Hm8I+KfAGKsRBWs7QP0LhARS9gNshqYVaA6cOdig==',key_name='tempest-TestVolumeBootPattern-829376797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cffb5203b9284500b8add8a6586cad49',ramdisk_id='',reservation_id='r-60nmlk1u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1676214558',owner_user_name='tempest-TestVolumeBootPattern-1676214558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:55:29Z,user_data=None,user_id='2be1b098ca9f4232bd198b515630f6ad',uuid=6c9ce215-9006-468d-998d-a18df5bf4222,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09f698e2-41d7-4329-92b1-9a80dc461259", "address": "fa:16:3e:dc:48:7c", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f698e2-41", "ovs_interfaceid": "09f698e2-41d7-4329-92b1-9a80dc461259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Converting VIF {"id": "09f698e2-41d7-4329-92b1-9a80dc461259", "address": "fa:16:3e:dc:48:7c", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f698e2-41", "ovs_interfaceid": "09f698e2-41d7-4329-92b1-9a80dc461259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:48:7c,bridge_name='br-int',has_traffic_filtering=True,id=09f698e2-41d7-4329-92b1-9a80dc461259,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f698e2-41') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG os_vif [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:48:7c,bridge_name='br-int',has_traffic_filtering=True,id=09f698e2-41d7-4329-92b1-9a80dc461259,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f698e2-41') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5724e0-fe86-45e9-8583-ba64a227f253]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)
Aug 14 16:55:40 user nova-compute[73056]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f (non-flash)
Aug 14 16:55:40 user nova-compute[73056]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:55:40 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d (non-flash)
Aug 14 16:55:40 user nova-compute[73056]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f (non-flash)
Aug 14 16:55:40 user nova-compute[73056]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:55:40 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff300343010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d'): ({'sdb'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Removing single pathed devices sdb {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09f698e2-41, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap09f698e2-41, col_values=(('external_ids', {'iface-id': '09f698e2-41d7-4329-92b1-9a80dc461259', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:48:7c', 'vm-uuid': '6c9ce215-9006-468d-998d-a18df5bf4222'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:40 user nova-compute[73056]: INFO os_vif [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:48:7c,bridge_name='br-int',has_traffic_filtering=True,id=09f698e2-41d7-4329-92b1-9a80dc461259,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f698e2-41')
Aug 14 16:55:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f8a8d5-0ac3-4086-8be9-fc02211df6cd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[6584d5e7-c1c3-4e4a-973e-b60b34f18c4b]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Flushing IO for device /dev/sdb {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[913e8b83-0f6e-41d0-99d4-31cd657bfad6]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] No VIF found with MAC fa:16:3e:dc:48:7c, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d18ec72-676c-44c4-a451-2ef1de0f0502]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] SCSI volumes sdb have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c734563c-9f3b-4da8-998e-31a0e5d1aae9]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0111ac5-6b8c-409c-8a33-4d5bbee9c254]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d, portal: 172.16.0.220,3260]
Aug 14 16:55:40 user nova-compute[73056]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d, portal: 172.16.0.220,3260] successful.
Aug 14 16:55:40 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ee0e8f1-8f40-460f-98df-7326372dac7d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f950d24-0bea-4b09-8c6f-08f528a9a4ec]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] <== disconnect_volume: return (1531ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:55:40 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Deleting instance files /opt/stack/data/nova/instances/6910e1fe-8863-4a4b-b975-48c9ebb0b087_del
Aug 14 16:55:40 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Deletion of /opt/stack/data/nova/instances/6910e1fe-8863-4a4b-b975-48c9ebb0b087_del complete
Aug 14 16:55:40 user nova-compute[73056]: INFO nova.compute.manager [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Took 2.42 seconds to destroy the instance on the hypervisor.
Aug 14 16:55:40 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG nova.compute.manager [req-7b8076d5-3fb3-4361-8cc6-a868e093f55e req-a71f404b-6fdd-403c-9053-0797b058ad7c service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Received event network-vif-plugged-9cdd486e-fc3e-4637-8958-eb7e065728fc {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-7b8076d5-3fb3-4361-8cc6-a868e093f55e req-a71f404b-6fdd-403c-9053-0797b058ad7c service nova] Acquiring lock "6910e1fe-8863-4a4b-b975-48c9ebb0b087-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-7b8076d5-3fb3-4361-8cc6-a868e093f55e req-a71f404b-6fdd-403c-9053-0797b058ad7c service nova] Lock "6910e1fe-8863-4a4b-b975-48c9ebb0b087-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-7b8076d5-3fb3-4361-8cc6-a868e093f55e req-a71f404b-6fdd-403c-9053-0797b058ad7c service nova] Lock "6910e1fe-8863-4a4b-b975-48c9ebb0b087-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:55:40 user nova-compute[73056]: DEBUG nova.compute.manager [req-7b8076d5-3fb3-4361-8cc6-a868e093f55e req-a71f404b-6fdd-403c-9053-0797b058ad7c service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] No waiting events found dispatching network-vif-plugged-9cdd486e-fc3e-4637-8958-eb7e065728fc {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:55:40 user nova-compute[73056]: WARNING nova.compute.manager [req-7b8076d5-3fb3-4361-8cc6-a868e093f55e req-a71f404b-6fdd-403c-9053-0797b058ad7c service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Received unexpected event network-vif-plugged-9cdd486e-fc3e-4637-8958-eb7e065728fc for instance with vm_state active and task_state deleting.
Aug 14 16:55:41 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:55:41 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Took 0.60 seconds to deallocate network for instance.
Aug 14 16:55:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a3dbcc24-d972-4d80-9d0e-f49f8069b922 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "bcbe7449-6199-4e86-a8b6-c075e142aa34" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:55:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a3dbcc24-d972-4d80-9d0e-f49f8069b922 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "bcbe7449-6199-4e86-a8b6-c075e142aa34" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:55:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a3dbcc24-d972-4d80-9d0e-f49f8069b922 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "bcbe7449-6199-4e86-a8b6-c075e142aa34-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:55:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a3dbcc24-d972-4d80-9d0e-f49f8069b922 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "bcbe7449-6199-4e86-a8b6-c075e142aa34-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:55:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a3dbcc24-d972-4d80-9d0e-f49f8069b922 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "bcbe7449-6199-4e86-a8b6-c075e142aa34-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:55:42 user nova-compute[73056]: INFO nova.compute.manager [None req-a3dbcc24-d972-4d80-9d0e-f49f8069b922 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Terminating instance
Aug 14 16:55:42 user nova-compute[73056]: DEBUG nova.compute.manager [None req-a3dbcc24-d972-4d80-9d0e-f49f8069b922 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 16:55:42 user nova-compute[73056]: INFO nova.compute.manager [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Took 1.01 seconds to detach 1 volumes for instance.
Aug 14 16:55:42 user nova-compute[73056]: DEBUG nova.compute.manager [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Deleting volume: 5ee0e8f1-8f40-460f-98df-7326372dac7d {{(pid=73056) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 16:55:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:55:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:55:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:42 user nova-compute[73056]: DEBUG nova.compute.manager [req-511b80b0-832e-4d32-a7a6-200cb6f7bd42 req-065d75ba-6415-48e2-88fa-84fe9aa6ec5c service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Received event network-vif-unplugged-cb018af9-f526-4333-9a2f-0cc2d91d22b2 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:55:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-511b80b0-832e-4d32-a7a6-200cb6f7bd42 req-065d75ba-6415-48e2-88fa-84fe9aa6ec5c service nova] Acquiring lock "bcbe7449-6199-4e86-a8b6-c075e142aa34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:55:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-511b80b0-832e-4d32-a7a6-200cb6f7bd42 req-065d75ba-6415-48e2-88fa-84fe9aa6ec5c service nova] Lock "bcbe7449-6199-4e86-a8b6-c075e142aa34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:55:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-511b80b0-832e-4d32-a7a6-200cb6f7bd42 req-065d75ba-6415-48e2-88fa-84fe9aa6ec5c service nova] Lock "bcbe7449-6199-4e86-a8b6-c075e142aa34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:55:42 user nova-compute[73056]: DEBUG nova.compute.manager [req-511b80b0-832e-4d32-a7a6-200cb6f7bd42 req-065d75ba-6415-48e2-88fa-84fe9aa6ec5c service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] No waiting events found dispatching network-vif-unplugged-cb018af9-f526-4333-9a2f-0cc2d91d22b2 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:55:42 user nova-compute[73056]: DEBUG nova.compute.manager [req-511b80b0-832e-4d32-a7a6-200cb6f7bd42 req-065d75ba-6415-48e2-88fa-84fe9aa6ec5c service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Received event network-vif-unplugged-cb018af9-f526-4333-9a2f-0cc2d91d22b2 for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:55:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:42 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:55:42 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:55:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.401s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:55:43 user nova-compute[73056]: DEBUG nova.compute.manager [req-f6a135ce-e789-4ef7-ab92-f402492c9123 req-4dd9f592-c264-4b75-bf75-350d139f916a service nova] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Received event network-vif-deleted-9cdd486e-fc3e-4637-8958-eb7e065728fc {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:55:43 user nova-compute[73056]: DEBUG nova.compute.manager [req-f6a135ce-e789-4ef7-ab92-f402492c9123 req-4dd9f592-c264-4b75-bf75-350d139f916a service nova] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Received event network-vif-plugged-09f698e2-41d7-4329-92b1-9a80dc461259 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:55:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f6a135ce-e789-4ef7-ab92-f402492c9123 req-4dd9f592-c264-4b75-bf75-350d139f916a service nova] Acquiring lock "6c9ce215-9006-468d-998d-a18df5bf4222-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:55:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f6a135ce-e789-4ef7-ab92-f402492c9123 req-4dd9f592-c264-4b75-bf75-350d139f916a service nova] Lock "6c9ce215-9006-468d-998d-a18df5bf4222-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:55:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f6a135ce-e789-4ef7-ab92-f402492c9123 req-4dd9f592-c264-4b75-bf75-350d139f916a service nova] Lock "6c9ce215-9006-468d-998d-a18df5bf4222-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:55:43 user nova-compute[73056]: DEBUG nova.compute.manager [req-f6a135ce-e789-4ef7-ab92-f402492c9123 req-4dd9f592-c264-4b75-bf75-350d139f916a service nova] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] No waiting events found dispatching network-vif-plugged-09f698e2-41d7-4329-92b1-9a80dc461259 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:55:43 user nova-compute[73056]: WARNING nova.compute.manager [req-f6a135ce-e789-4ef7-ab92-f402492c9123 req-4dd9f592-c264-4b75-bf75-350d139f916a service nova] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Received unexpected event network-vif-plugged-09f698e2-41d7-4329-92b1-9a80dc461259 for instance with vm_state building and task_state spawning.
Aug 14 16:55:43 user nova-compute[73056]: DEBUG nova.compute.manager [req-f6a135ce-e789-4ef7-ab92-f402492c9123 req-4dd9f592-c264-4b75-bf75-350d139f916a service nova] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Received event network-vif-plugged-09f698e2-41d7-4329-92b1-9a80dc461259 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:55:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f6a135ce-e789-4ef7-ab92-f402492c9123 req-4dd9f592-c264-4b75-bf75-350d139f916a service nova] Acquiring lock "6c9ce215-9006-468d-998d-a18df5bf4222-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:55:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f6a135ce-e789-4ef7-ab92-f402492c9123 req-4dd9f592-c264-4b75-bf75-350d139f916a service nova] Lock "6c9ce215-9006-468d-998d-a18df5bf4222-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:55:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f6a135ce-e789-4ef7-ab92-f402492c9123 req-4dd9f592-c264-4b75-bf75-350d139f916a service nova] Lock "6c9ce215-9006-468d-998d-a18df5bf4222-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:55:43 user nova-compute[73056]: DEBUG nova.compute.manager [req-f6a135ce-e789-4ef7-ab92-f402492c9123 req-4dd9f592-c264-4b75-bf75-350d139f916a service nova] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] No waiting events found dispatching network-vif-plugged-09f698e2-41d7-4329-92b1-9a80dc461259 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:55:43 user nova-compute[73056]: WARNING nova.compute.manager [req-f6a135ce-e789-4ef7-ab92-f402492c9123 req-4dd9f592-c264-4b75-bf75-350d139f916a service nova] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Received unexpected event network-vif-plugged-09f698e2-41d7-4329-92b1-9a80dc461259 for instance with vm_state building and task_state spawning.
Aug 14 16:55:43 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Deleted allocations for instance 6910e1fe-8863-4a4b-b975-48c9ebb0b087
Aug 14 16:55:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9bdea09e-6b33-4635-81fd-a1825c463d02 tempest-TestShelveInstance-559346633 tempest-TestShelveInstance-559346633-project-member] Lock "6910e1fe-8863-4a4b-b975-48c9ebb0b087" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.746s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:55:43 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Instance destroyed successfully.
Aug 14 16:55:43 user nova-compute[73056]: DEBUG nova.objects.instance [None req-a3dbcc24-d972-4d80-9d0e-f49f8069b922 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lazy-loading 'resources' on Instance uuid bcbe7449-6199-4e86-a8b6-c075e142aa34 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:55:43 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-a3dbcc24-d972-4d80-9d0e-f49f8069b922 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T16:49:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1786420487',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1786420487',id=32,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIdip50bFOgddyMp6IylDQR0N/sRWs26ps8mtW957zlQ+lUd9LWGr01UNUfLRmUqKtnkrF4wbWmLfe2tOUrlScj2d5EzqiHJaA+1Q0ekto05woc7a99HlXR6VMKQ86FEw==',key_name='tempest-keypair-1929561178',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:53:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c67a1c8fcd97416e90f6b5a50a886a75',ramdisk_id='',reservation_id='r-c4car4yy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1935390723',owner_user_name='tempest-AttachVolumeShelveTestJSON-1935390723-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:53:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a20dd4c88984674996e26fdcfa4f126',uuid=bcbe7449-6199-4e86-a8b6-c075e142aa34,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "address": "fa:16:3e:04:a3:9a", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb018af9-f5", "ovs_interfaceid": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:55:43 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-a3dbcc24-d972-4d80-9d0e-f49f8069b922 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Converting VIF {"id": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "address": "fa:16:3e:04:a3:9a", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb018af9-f5", "ovs_interfaceid": "cb018af9-f526-4333-9a2f-0cc2d91d22b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:55:43 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-a3dbcc24-d972-4d80-9d0e-f49f8069b922 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:a3:9a,bridge_name='br-int',has_traffic_filtering=True,id=cb018af9-f526-4333-9a2f-0cc2d91d22b2,network=Network(20384d1d-92c0-4ac7-a993-956fa784cd87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb018af9-f5') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:55:43 user nova-compute[73056]: DEBUG os_vif [None req-a3dbcc24-d972-4d80-9d0e-f49f8069b922 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:a3:9a,bridge_name='br-int',has_traffic_filtering=True,id=cb018af9-f526-4333-9a2f-0cc2d91d22b2,network=Network(20384d1d-92c0-4ac7-a993-956fa784cd87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb018af9-f5') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:55:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb018af9-f5, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:55:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:55:43 user nova-compute[73056]: INFO os_vif [None req-a3dbcc24-d972-4d80-9d0e-f49f8069b922 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:a3:9a,bridge_name='br-int',has_traffic_filtering=True,id=cb018af9-f526-4333-9a2f-0cc2d91d22b2,network=Network(20384d1d-92c0-4ac7-a993-956fa784cd87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb018af9-f5')
Aug 14 16:55:43 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-a3dbcc24-d972-4d80-9d0e-f49f8069b922 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Deleting instance files /opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34_del
Aug 14 16:55:43 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-a3dbcc24-d972-4d80-9d0e-f49f8069b922 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Deletion of /opt/stack/data/nova/instances/bcbe7449-6199-4e86-a8b6-c075e142aa34_del complete
Aug 14 16:55:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:43 user nova-compute[73056]: INFO nova.compute.manager [None req-a3dbcc24-d972-4d80-9d0e-f49f8069b922 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 14 16:55:43 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-a3dbcc24-d972-4d80-9d0e-f49f8069b922 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 16:55:43 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 16:55:43 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 16:55:44 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692032144.0774293, 6c9ce215-9006-468d-998d-a18df5bf4222 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:55:44 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] VM Resumed (Lifecycle Event)
Aug 14 16:55:44 user nova-compute[73056]: DEBUG nova.compute.manager [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:55:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:55:44 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:55:44 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Instance spawned successfully.
Aug 14 16:55:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:55:44 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:55:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:55:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:55:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:55:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:55:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:55:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:55:44 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:55:44 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692032144.0806236, 6c9ce215-9006-468d-998d-a18df5bf4222 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:55:44 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] VM Started (Lifecycle Event)
Aug 14 16:55:44 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:55:44 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:55:44 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:55:44 user nova-compute[73056]: INFO nova.compute.manager [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Took 5.26 seconds to spawn the instance on the hypervisor.
Aug 14 16:55:44 user nova-compute[73056]: DEBUG nova.compute.manager [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:55:44 user nova-compute[73056]: INFO nova.compute.manager [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Took 15.95 seconds to build instance.
Aug 14 16:55:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-cea1f7cf-7a90-459f-adb2-636966da0b7b tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "6c9ce215-9006-468d-998d-a18df5bf4222" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.048s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:55:44 user nova-compute[73056]: DEBUG nova.compute.manager [req-03b61c57-12d8-4b17-b2a3-c95f70c55e0a req-eecdcc5d-cc37-4f7d-9aba-9692c421649d service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Received event network-vif-plugged-cb018af9-f526-4333-9a2f-0cc2d91d22b2 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:55:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-03b61c57-12d8-4b17-b2a3-c95f70c55e0a req-eecdcc5d-cc37-4f7d-9aba-9692c421649d service nova] Acquiring lock "bcbe7449-6199-4e86-a8b6-c075e142aa34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:55:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-03b61c57-12d8-4b17-b2a3-c95f70c55e0a req-eecdcc5d-cc37-4f7d-9aba-9692c421649d service nova] Lock "bcbe7449-6199-4e86-a8b6-c075e142aa34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:55:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-03b61c57-12d8-4b17-b2a3-c95f70c55e0a req-eecdcc5d-cc37-4f7d-9aba-9692c421649d service nova] Lock "bcbe7449-6199-4e86-a8b6-c075e142aa34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:55:44 user nova-compute[73056]: DEBUG nova.compute.manager [req-03b61c57-12d8-4b17-b2a3-c95f70c55e0a req-eecdcc5d-cc37-4f7d-9aba-9692c421649d service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] No waiting events found dispatching network-vif-plugged-cb018af9-f526-4333-9a2f-0cc2d91d22b2 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:55:44 user nova-compute[73056]: WARNING nova.compute.manager [req-03b61c57-12d8-4b17-b2a3-c95f70c55e0a req-eecdcc5d-cc37-4f7d-9aba-9692c421649d service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Received unexpected event network-vif-plugged-cb018af9-f526-4333-9a2f-0cc2d91d22b2 for instance with vm_state active and task_state deleting.
Aug 14 16:55:44 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:55:44 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Took 1.49 seconds to deallocate network for instance.
Aug 14 16:55:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a3dbcc24-d972-4d80-9d0e-f49f8069b922 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:55:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a3dbcc24-d972-4d80-9d0e-f49f8069b922 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:55:45 user nova-compute[73056]: DEBUG nova.compute.manager [req-04695fe5-b349-4f06-8e8b-dba215adfd2f req-8297ba32-2cfc-4c36-b7e5-b5a71e0e0348 service nova] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Received event network-vif-deleted-cb018af9-f526-4333-9a2f-0cc2d91d22b2 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:55:45 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-a3dbcc24-d972-4d80-9d0e-f49f8069b922 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:55:45 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-a3dbcc24-d972-4d80-9d0e-f49f8069b922 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:55:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a3dbcc24-d972-4d80-9d0e-f49f8069b922 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.298s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:55:45 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-a3dbcc24-d972-4d80-9d0e-f49f8069b922 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Deleted allocations for instance bcbe7449-6199-4e86-a8b6-c075e142aa34
Aug 14 16:55:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a3dbcc24-d972-4d80-9d0e-f49f8069b922 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "bcbe7449-6199-4e86-a8b6-c075e142aa34" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.949s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:55:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:54 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692032139.134844, 6910e1fe-8863-4a4b-b975-48c9ebb0b087 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:55:54 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] VM Stopped (Lifecycle Event)
Aug 14 16:55:54 user nova-compute[73056]: DEBUG nova.compute.manager [None req-912d774f-76c9-4550-99b3-9537485893ba None None] [instance: 6910e1fe-8863-4a4b-b975-48c9ebb0b087] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:55:58 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692032143.1818118, bcbe7449-6199-4e86-a8b6-c075e142aa34 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:55:58 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] VM Stopped (Lifecycle Event)
Aug 14 16:55:58 user nova-compute[73056]: DEBUG nova.compute.manager [None req-eae9024e-434f-429e-9207-f62ed24dc7f0 None None] [instance: bcbe7449-6199-4e86-a8b6-c075e142aa34] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:55:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:55:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:00 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:56:00 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 16:56:02 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:56:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:06 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:56:06 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 16:56:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-ee670695-1123-4d95-a7ad-ac79f9a4c16e" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:56:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-ee670695-1123-4d95-a7ad-ac79f9a4c16e" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:56:06 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 16:56:07 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Updating instance_info_cache with network_info: [{"id": "5fd92a95-cd11-4828-9731-91e305ac7b26", "address": "fa:16:3e:b4:d2:be", "network": {"id": "89b465ce-32d9-4246-ab29-eaca3017bf33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-295083994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bd5d01bac1242ec9897e6931102e1b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd92a95-cd", "ovs_interfaceid": "5fd92a95-cd11-4828-9731-91e305ac7b26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:56:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-ee670695-1123-4d95-a7ad-ac79f9a4c16e" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:56:07 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 16:56:07 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:56:07 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:56:07 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:56:07 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:56:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:56:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:56:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:56:07 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 16:56:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:56:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:56:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:56:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:56:07 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:56:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:56:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:56:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:56:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk (vdb) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:56:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:56:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:56:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:56:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:56:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:56:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:56:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:56:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:56:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:56:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:56:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:56:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:56:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:56:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee670695-1123-4d95-a7ad-ac79f9a4c16e/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:56:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee670695-1123-4d95-a7ad-ac79f9a4c16e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:56:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee670695-1123-4d95-a7ad-ac79f9a4c16e/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:56:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee670695-1123-4d95-a7ad-ac79f9a4c16e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:56:10 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:56:10 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:56:10 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=7741MB free_disk=25.308513641357422GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 16:56:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:56:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:56:10 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance b580e3d0-88b5-42a3-a953-84b94c088f41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:56:10 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 92c34cf0-fd39-49fc-9244-4da8ccae6eec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:56:10 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance ee670695-1123-4d95-a7ad-ac79f9a4c16e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:56:10 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 5914b70b-665a-4ce0-ab4e-11db2b8bc057 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:56:10 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 6c9ce215-9006-468d-998d-a18df5bf4222 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:56:10 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 5191b082-a6f3-467c-b28b-fda85e15f330 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:56:10 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 16:56:10 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 16:56:10 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:56:10 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:56:10 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 16:56:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.376s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:56:11 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:56:11 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:56:11 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:56:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:21 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:22 user nova-compute[73056]: INFO nova.compute.manager [None req-f67fb76e-ab69-41dc-92bd-b6d855e504f8 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Unrescuing
Aug 14 16:56:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-f67fb76e-ab69-41dc-92bd-b6d855e504f8 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "refresh_cache-5914b70b-665a-4ce0-ab4e-11db2b8bc057" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:56:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-f67fb76e-ab69-41dc-92bd-b6d855e504f8 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquired lock "refresh_cache-5914b70b-665a-4ce0-ab4e-11db2b8bc057" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:56:22 user nova-compute[73056]: DEBUG nova.network.neutron [None req-f67fb76e-ab69-41dc-92bd-b6d855e504f8 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:56:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:23 user nova-compute[73056]: DEBUG nova.network.neutron [None req-f67fb76e-ab69-41dc-92bd-b6d855e504f8 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Updating instance_info_cache with network_info: [{"id": "c9eb236b-5c65-4108-9527-dbf9550cf01f", "address": "fa:16:3e:af:d2:e8", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9eb236b-5c", "ovs_interfaceid": "c9eb236b-5c65-4108-9527-dbf9550cf01f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:56:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-f67fb76e-ab69-41dc-92bd-b6d855e504f8 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Releasing lock "refresh_cache-5914b70b-665a-4ce0-ab4e-11db2b8bc057" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:56:23 user nova-compute[73056]: DEBUG nova.objects.instance [None req-f67fb76e-ab69-41dc-92bd-b6d855e504f8 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lazy-loading 'flavor' on Instance uuid 5914b70b-665a-4ce0-ab4e-11db2b8bc057 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:56:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:23 user nova-compute[73056]: DEBUG nova.compute.manager [req-7711cd82-a241-4ee5-ba92-489fbc4e6dd2 req-8716146a-c6c7-4c79-ba6c-7b9604cc5c1f service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Received event network-vif-unplugged-c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:56:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-7711cd82-a241-4ee5-ba92-489fbc4e6dd2 req-8716146a-c6c7-4c79-ba6c-7b9604cc5c1f service nova] Acquiring lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:56:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-7711cd82-a241-4ee5-ba92-489fbc4e6dd2 req-8716146a-c6c7-4c79-ba6c-7b9604cc5c1f service nova] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:56:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-7711cd82-a241-4ee5-ba92-489fbc4e6dd2 req-8716146a-c6c7-4c79-ba6c-7b9604cc5c1f service nova] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:56:23 user nova-compute[73056]: DEBUG nova.compute.manager [req-7711cd82-a241-4ee5-ba92-489fbc4e6dd2 req-8716146a-c6c7-4c79-ba6c-7b9604cc5c1f service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] No waiting events found dispatching network-vif-unplugged-c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:56:23 user nova-compute[73056]: WARNING nova.compute.manager [req-7711cd82-a241-4ee5-ba92-489fbc4e6dd2 req-8716146a-c6c7-4c79-ba6c-7b9604cc5c1f service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Received unexpected event network-vif-unplugged-c9eb236b-5c65-4108-9527-dbf9550cf01f for instance with vm_state rescued and task_state unrescuing.
Aug 14 16:56:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:24 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:24 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:24 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:24 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Instance destroyed successfully.
Aug 14 16:56:24 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:24 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:24 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:24 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:24 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:25 user nova-compute[73056]: DEBUG nova.compute.manager [req-3c354667-0e04-4bfe-8e1c-ddc062469931 req-1ab43dcf-f907-46c9-a471-b6aee9f18fcc service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Received event network-vif-plugged-c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:56:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3c354667-0e04-4bfe-8e1c-ddc062469931 req-1ab43dcf-f907-46c9-a471-b6aee9f18fcc service nova] Acquiring lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:56:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3c354667-0e04-4bfe-8e1c-ddc062469931 req-1ab43dcf-f907-46c9-a471-b6aee9f18fcc service nova] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:56:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3c354667-0e04-4bfe-8e1c-ddc062469931 req-1ab43dcf-f907-46c9-a471-b6aee9f18fcc service nova] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:56:25 user nova-compute[73056]: DEBUG nova.compute.manager [req-3c354667-0e04-4bfe-8e1c-ddc062469931 req-1ab43dcf-f907-46c9-a471-b6aee9f18fcc service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] No waiting events found dispatching network-vif-plugged-c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:56:25 user nova-compute[73056]: WARNING nova.compute.manager [req-3c354667-0e04-4bfe-8e1c-ddc062469931 req-1ab43dcf-f907-46c9-a471-b6aee9f18fcc service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Received unexpected event network-vif-plugged-c9eb236b-5c65-4108-9527-dbf9550cf01f for instance with vm_state rescued and task_state unrescuing.
Aug 14 16:56:25 user nova-compute[73056]: DEBUG nova.compute.manager [req-3c354667-0e04-4bfe-8e1c-ddc062469931 req-1ab43dcf-f907-46c9-a471-b6aee9f18fcc service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Received event network-vif-plugged-c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:56:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3c354667-0e04-4bfe-8e1c-ddc062469931 req-1ab43dcf-f907-46c9-a471-b6aee9f18fcc service nova] Acquiring lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:56:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3c354667-0e04-4bfe-8e1c-ddc062469931 req-1ab43dcf-f907-46c9-a471-b6aee9f18fcc service nova] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:56:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3c354667-0e04-4bfe-8e1c-ddc062469931 req-1ab43dcf-f907-46c9-a471-b6aee9f18fcc service nova] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:56:25 user nova-compute[73056]: DEBUG nova.compute.manager [req-3c354667-0e04-4bfe-8e1c-ddc062469931 req-1ab43dcf-f907-46c9-a471-b6aee9f18fcc service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] No waiting events found dispatching network-vif-plugged-c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:56:25 user nova-compute[73056]: WARNING nova.compute.manager [req-3c354667-0e04-4bfe-8e1c-ddc062469931 req-1ab43dcf-f907-46c9-a471-b6aee9f18fcc service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Received unexpected event network-vif-plugged-c9eb236b-5c65-4108-9527-dbf9550cf01f for instance with vm_state rescued and task_state unrescuing.
Aug 14 16:56:25 user nova-compute[73056]: DEBUG nova.compute.manager [req-3c354667-0e04-4bfe-8e1c-ddc062469931 req-1ab43dcf-f907-46c9-a471-b6aee9f18fcc service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Received event network-vif-plugged-c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:56:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3c354667-0e04-4bfe-8e1c-ddc062469931 req-1ab43dcf-f907-46c9-a471-b6aee9f18fcc service nova] Acquiring lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:56:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3c354667-0e04-4bfe-8e1c-ddc062469931 req-1ab43dcf-f907-46c9-a471-b6aee9f18fcc service nova] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:56:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3c354667-0e04-4bfe-8e1c-ddc062469931 req-1ab43dcf-f907-46c9-a471-b6aee9f18fcc service nova] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:56:25 user nova-compute[73056]: DEBUG nova.compute.manager [req-3c354667-0e04-4bfe-8e1c-ddc062469931 req-1ab43dcf-f907-46c9-a471-b6aee9f18fcc service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] No waiting events found dispatching network-vif-plugged-c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:56:25 user nova-compute[73056]: WARNING nova.compute.manager [req-3c354667-0e04-4bfe-8e1c-ddc062469931 req-1ab43dcf-f907-46c9-a471-b6aee9f18fcc service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Received unexpected event network-vif-plugged-c9eb236b-5c65-4108-9527-dbf9550cf01f for instance with vm_state rescued and task_state unrescuing.
Aug 14 16:56:25 user nova-compute[73056]: DEBUG nova.compute.manager [req-3c354667-0e04-4bfe-8e1c-ddc062469931 req-1ab43dcf-f907-46c9-a471-b6aee9f18fcc service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Received event network-vif-unplugged-c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:56:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3c354667-0e04-4bfe-8e1c-ddc062469931 req-1ab43dcf-f907-46c9-a471-b6aee9f18fcc service nova] Acquiring lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:56:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3c354667-0e04-4bfe-8e1c-ddc062469931 req-1ab43dcf-f907-46c9-a471-b6aee9f18fcc service nova] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:56:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3c354667-0e04-4bfe-8e1c-ddc062469931 req-1ab43dcf-f907-46c9-a471-b6aee9f18fcc service nova] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:56:25 user nova-compute[73056]: DEBUG nova.compute.manager [req-3c354667-0e04-4bfe-8e1c-ddc062469931 req-1ab43dcf-f907-46c9-a471-b6aee9f18fcc service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] No waiting events found dispatching network-vif-unplugged-c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:56:25 user nova-compute[73056]: WARNING nova.compute.manager [req-3c354667-0e04-4bfe-8e1c-ddc062469931 req-1ab43dcf-f907-46c9-a471-b6aee9f18fcc service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Received unexpected event network-vif-unplugged-c9eb236b-5c65-4108-9527-dbf9550cf01f for instance with vm_state rescued and task_state unrescuing.
Aug 14 16:56:25 user nova-compute[73056]: DEBUG nova.compute.manager [req-3c354667-0e04-4bfe-8e1c-ddc062469931 req-1ab43dcf-f907-46c9-a471-b6aee9f18fcc service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Received event network-vif-plugged-c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:56:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3c354667-0e04-4bfe-8e1c-ddc062469931 req-1ab43dcf-f907-46c9-a471-b6aee9f18fcc service nova] Acquiring lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:56:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3c354667-0e04-4bfe-8e1c-ddc062469931 req-1ab43dcf-f907-46c9-a471-b6aee9f18fcc service nova] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:56:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3c354667-0e04-4bfe-8e1c-ddc062469931 req-1ab43dcf-f907-46c9-a471-b6aee9f18fcc service nova] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:56:25 user nova-compute[73056]: DEBUG nova.compute.manager [req-3c354667-0e04-4bfe-8e1c-ddc062469931 req-1ab43dcf-f907-46c9-a471-b6aee9f18fcc service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] No waiting events found dispatching network-vif-plugged-c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:56:25 user nova-compute[73056]: WARNING nova.compute.manager [req-3c354667-0e04-4bfe-8e1c-ddc062469931 req-1ab43dcf-f907-46c9-a471-b6aee9f18fcc service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Received unexpected event network-vif-plugged-c9eb236b-5c65-4108-9527-dbf9550cf01f for instance with vm_state rescued and task_state unrescuing.
Aug 14 16:56:25 user nova-compute[73056]: DEBUG nova.compute.manager [req-3c354667-0e04-4bfe-8e1c-ddc062469931 req-1ab43dcf-f907-46c9-a471-b6aee9f18fcc service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Received event network-vif-plugged-c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:56:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3c354667-0e04-4bfe-8e1c-ddc062469931 req-1ab43dcf-f907-46c9-a471-b6aee9f18fcc service nova] Acquiring lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:56:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3c354667-0e04-4bfe-8e1c-ddc062469931 req-1ab43dcf-f907-46c9-a471-b6aee9f18fcc service nova] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:56:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3c354667-0e04-4bfe-8e1c-ddc062469931 req-1ab43dcf-f907-46c9-a471-b6aee9f18fcc service nova] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:56:25 user nova-compute[73056]: DEBUG nova.compute.manager [req-3c354667-0e04-4bfe-8e1c-ddc062469931 req-1ab43dcf-f907-46c9-a471-b6aee9f18fcc service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] No waiting events found dispatching network-vif-plugged-c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:56:25 user nova-compute[73056]: WARNING nova.compute.manager [req-3c354667-0e04-4bfe-8e1c-ddc062469931 req-1ab43dcf-f907-46c9-a471-b6aee9f18fcc service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Received unexpected event network-vif-plugged-c9eb236b-5c65-4108-9527-dbf9550cf01f for instance with vm_state rescued and task_state unrescuing.
Aug 14 16:56:27 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Removed pending event for 5914b70b-665a-4ce0-ab4e-11db2b8bc057 due to event {{(pid=73056) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 16:56:27 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692032187.6554995, 5914b70b-665a-4ce0-ab4e-11db2b8bc057 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:56:27 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] VM Resumed (Lifecycle Event)
Aug 14 16:56:27 user nova-compute[73056]: DEBUG nova.compute.manager [None req-f67fb76e-ab69-41dc-92bd-b6d855e504f8 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:56:27 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:56:27 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:56:27 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 16:56:27 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692032187.6573935, 5914b70b-665a-4ce0-ab4e-11db2b8bc057 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:56:27 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] VM Started (Lifecycle Event)
Aug 14 16:56:27 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:56:27 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:56:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:27 user nova-compute[73056]: DEBUG nova.compute.manager [req-5febc11f-8e5d-4fec-86f0-9fa2133d9166 req-419bba79-6698-43b6-b1e9-93a30f2620b7 service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Received event network-vif-plugged-c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:56:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-5febc11f-8e5d-4fec-86f0-9fa2133d9166 req-419bba79-6698-43b6-b1e9-93a30f2620b7 service nova] Acquiring lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:56:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-5febc11f-8e5d-4fec-86f0-9fa2133d9166 req-419bba79-6698-43b6-b1e9-93a30f2620b7 service nova] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:56:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-5febc11f-8e5d-4fec-86f0-9fa2133d9166 req-419bba79-6698-43b6-b1e9-93a30f2620b7 service nova] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:56:27 user nova-compute[73056]: DEBUG nova.compute.manager [req-5febc11f-8e5d-4fec-86f0-9fa2133d9166 req-419bba79-6698-43b6-b1e9-93a30f2620b7 service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] No waiting events found dispatching network-vif-plugged-c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:56:27 user nova-compute[73056]: WARNING nova.compute.manager [req-5febc11f-8e5d-4fec-86f0-9fa2133d9166 req-419bba79-6698-43b6-b1e9-93a30f2620b7 service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Received unexpected event network-vif-plugged-c9eb236b-5c65-4108-9527-dbf9550cf01f for instance with vm_state active and task_state None.
Aug 14 16:56:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:56:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:56:38 user nova-compute[73056]: DEBUG nova.compute.manager [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:56:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:56:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:56:38 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:56:38 user nova-compute[73056]: INFO nova.compute.claims [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Claim successful on node user
Aug 14 16:56:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:38 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:56:38 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:56:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.382s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:56:38 user nova-compute[73056]: DEBUG nova.compute.manager [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:56:38 user nova-compute[73056]: DEBUG nova.compute.manager [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:56:38 user nova-compute[73056]: DEBUG nova.network.neutron [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:56:38 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:56:38 user nova-compute[73056]: DEBUG nova.compute.manager [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:56:38 user nova-compute[73056]: DEBUG nova.policy [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a20dd4c88984674996e26fdcfa4f126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67a1c8fcd97416e90f6b5a50a886a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:56:38 user nova-compute[73056]: DEBUG nova.compute.manager [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:56:38 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:56:38 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Creating image(s)
Aug 14 16:56:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "/opt/stack/data/nova/instances/e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:56:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "/opt/stack/data/nova/instances/e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:56:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "/opt/stack/data/nova/instances/e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:56:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:56:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.189s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:56:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "c889592ab94cd0b0ce896f27a2af0323771db234" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:56:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:56:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:56:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.183s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:56:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:56:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3/disk 1073741824" returned: 0 in 0.059s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:56:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:56:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:56:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.198s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:56:39 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 16:56:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:56:39 user nova-compute[73056]: DEBUG nova.network.neutron [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Successfully created port: 2f9ed6a8-5d92-4e63-9c4e-2658d1cec310 {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:56:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:56:39 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Cannot resize image /opt/stack/data/nova/instances/e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 16:56:39 user nova-compute[73056]: DEBUG nova.objects.instance [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lazy-loading 'migration_context' on Instance uuid e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:56:39 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 16:56:39 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Ensure instance console log exists: /opt/stack/data/nova/instances/e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:56:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:56:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:56:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:56:40 user nova-compute[73056]: DEBUG nova.network.neutron [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Successfully updated port: 2f9ed6a8-5d92-4e63-9c4e-2658d1cec310 {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:56:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "refresh_cache-e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:56:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquired lock "refresh_cache-e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:56:40 user nova-compute[73056]: DEBUG nova.network.neutron [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:56:40 user nova-compute[73056]: DEBUG nova.compute.manager [req-ae395bb5-7b8a-4cd1-a351-df3ba14d9f86 req-11decaad-6ee5-4cdd-be28-26176f71cbbb service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Received event network-changed-2f9ed6a8-5d92-4e63-9c4e-2658d1cec310 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:56:40 user nova-compute[73056]: DEBUG nova.compute.manager [req-ae395bb5-7b8a-4cd1-a351-df3ba14d9f86 req-11decaad-6ee5-4cdd-be28-26176f71cbbb service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Refreshing instance network info cache due to event network-changed-2f9ed6a8-5d92-4e63-9c4e-2658d1cec310. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:56:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ae395bb5-7b8a-4cd1-a351-df3ba14d9f86 req-11decaad-6ee5-4cdd-be28-26176f71cbbb service nova] Acquiring lock "refresh_cache-e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:56:40 user nova-compute[73056]: DEBUG nova.network.neutron [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG nova.network.neutron [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Updating instance_info_cache with network_info: [{"id": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "address": "fa:16:3e:24:f8:f3", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9ed6a8-5d", "ovs_interfaceid": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Releasing lock "refresh_cache-e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG nova.compute.manager [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Instance network_info: |[{"id": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "address": "fa:16:3e:24:f8:f3", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9ed6a8-5d", "ovs_interfaceid": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ae395bb5-7b8a-4cd1-a351-df3ba14d9f86 req-11decaad-6ee5-4cdd-be28-26176f71cbbb service nova] Acquired lock "refresh_cache-e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG nova.network.neutron [req-ae395bb5-7b8a-4cd1-a351-df3ba14d9f86 req-11decaad-6ee5-4cdd-be28-26176f71cbbb service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Refreshing network info cache for port 2f9ed6a8-5d92-4e63-9c4e-2658d1cec310 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Start _get_guest_xml network_info=[{"id": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "address": "fa:16:3e:24:f8:f3", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9ed6a8-5d", "ovs_interfaceid": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:56:41 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:56:41 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:56:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:56:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-948039001',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-948039001',id=41,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHYNBfnC2ikOrzBY4cz5LLIum5X5oxpuFuwOJsgbUapOe+ZhLzeRuq82OuvfQs1nq2h3Js5eBhWIRwcRYkBy8csHsKYVKBxxR6b3mKZP/TEs4IfBOUR0BP2bP1OopKMnUA==',key_name='tempest-keypair-707146351',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c67a1c8fcd97416e90f6b5a50a886a75',ramdisk_id='',reservation_id='r-p59njr5z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1935390723',owner_user_name='tempest-AttachVolumeShelveTestJSON-1935390723-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:56:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a20dd4c88984674996e26fdcfa4f126',uuid=e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "address": "fa:16:3e:24:f8:f3", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9ed6a8-5d", "ovs_interfaceid": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Converting VIF {"id": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "address": "fa:16:3e:24:f8:f3", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9ed6a8-5d", "ovs_interfaceid": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:f8:f3,bridge_name='br-int',has_traffic_filtering=True,id=2f9ed6a8-5d92-4e63-9c4e-2658d1cec310,network=Network(20384d1d-92c0-4ac7-a993-956fa784cd87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f9ed6a8-5d') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG nova.objects.instance [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lazy-loading 'pci_devices' on Instance uuid e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:56:41 user nova-compute[73056]:   <uuid>e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3</uuid>
Aug 14 16:56:41 user nova-compute[73056]:   <name>instance-00000029</name>
Aug 14 16:56:41 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:56:41 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:56:41 user nova-compute[73056]:   <metadata>
Aug 14 16:56:41 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:56:41 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:56:41 user nova-compute[73056]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-948039001</nova:name>
Aug 14 16:56:41 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:56:41</nova:creationTime>
Aug 14 16:56:41 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:56:41 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:56:41 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:56:41 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:56:41 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:56:41 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:56:41 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:56:41 user nova-compute[73056]:       <nova:owner>
Aug 14 16:56:41 user nova-compute[73056]:         <nova:user uuid="9a20dd4c88984674996e26fdcfa4f126">tempest-AttachVolumeShelveTestJSON-1935390723-project-member</nova:user>
Aug 14 16:56:41 user nova-compute[73056]:         <nova:project uuid="c67a1c8fcd97416e90f6b5a50a886a75">tempest-AttachVolumeShelveTestJSON-1935390723</nova:project>
Aug 14 16:56:41 user nova-compute[73056]:       </nova:owner>
Aug 14 16:56:41 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:56:41 user nova-compute[73056]:       <nova:ports>
Aug 14 16:56:41 user nova-compute[73056]:         <nova:port uuid="2f9ed6a8-5d92-4e63-9c4e-2658d1cec310">
Aug 14 16:56:41 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 16:56:41 user nova-compute[73056]:         </nova:port>
Aug 14 16:56:41 user nova-compute[73056]:       </nova:ports>
Aug 14 16:56:41 user nova-compute[73056]:     </nova:instance>
Aug 14 16:56:41 user nova-compute[73056]:   </metadata>
Aug 14 16:56:41 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:56:41 user nova-compute[73056]:     <system>
Aug 14 16:56:41 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:56:41 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:56:41 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:56:41 user nova-compute[73056]:       <entry name="serial">e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3</entry>
Aug 14 16:56:41 user nova-compute[73056]:       <entry name="uuid">e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3</entry>
Aug 14 16:56:41 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:56:41 user nova-compute[73056]:     </system>
Aug 14 16:56:41 user nova-compute[73056]:   </sysinfo>
Aug 14 16:56:41 user nova-compute[73056]:   <os>
Aug 14 16:56:41 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:56:41 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:56:41 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:56:41 user nova-compute[73056]:   </os>
Aug 14 16:56:41 user nova-compute[73056]:   <features>
Aug 14 16:56:41 user nova-compute[73056]:     <acpi/>
Aug 14 16:56:41 user nova-compute[73056]:     <apic/>
Aug 14 16:56:41 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:56:41 user nova-compute[73056]:   </features>
Aug 14 16:56:41 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:56:41 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:56:41 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:56:41 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:56:41 user nova-compute[73056]:   </clock>
Aug 14 16:56:41 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:56:41 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:56:41 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:56:41 user nova-compute[73056]:   </cpu>
Aug 14 16:56:41 user nova-compute[73056]:   <devices>
Aug 14 16:56:41 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 16:56:41 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 16:56:41 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3/disk"/>
Aug 14 16:56:41 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:56:41 user nova-compute[73056]:     </disk>
Aug 14 16:56:41 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:56:41 user nova-compute[73056]:       <mac address="fa:16:3e:24:f8:f3"/>
Aug 14 16:56:41 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:56:41 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:56:41 user nova-compute[73056]:       <target dev="tap2f9ed6a8-5d"/>
Aug 14 16:56:41 user nova-compute[73056]:     </interface>
Aug 14 16:56:41 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:56:41 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3/console.log" append="off"/>
Aug 14 16:56:41 user nova-compute[73056]:     </serial>
Aug 14 16:56:41 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:56:41 user nova-compute[73056]:     <video>
Aug 14 16:56:41 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:56:41 user nova-compute[73056]:     </video>
Aug 14 16:56:41 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:56:41 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:56:41 user nova-compute[73056]:     </rng>
Aug 14 16:56:41 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:56:41 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:56:41 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:56:41 user nova-compute[73056]:     </memballoon>
Aug 14 16:56:41 user nova-compute[73056]:   </devices>
Aug 14 16:56:41 user nova-compute[73056]: </domain>
Aug 14 16:56:41 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:56:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-948039001',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-948039001',id=41,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHYNBfnC2ikOrzBY4cz5LLIum5X5oxpuFuwOJsgbUapOe+ZhLzeRuq82OuvfQs1nq2h3Js5eBhWIRwcRYkBy8csHsKYVKBxxR6b3mKZP/TEs4IfBOUR0BP2bP1OopKMnUA==',key_name='tempest-keypair-707146351',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c67a1c8fcd97416e90f6b5a50a886a75',ramdisk_id='',reservation_id='r-p59njr5z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1935390723',owner_user_name='tempest-AttachVolumeShelveTestJSON-1935390723-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:56:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a20dd4c88984674996e26fdcfa4f126',uuid=e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "address": "fa:16:3e:24:f8:f3", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9ed6a8-5d", "ovs_interfaceid": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Converting VIF {"id": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "address": "fa:16:3e:24:f8:f3", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9ed6a8-5d", "ovs_interfaceid": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:f8:f3,bridge_name='br-int',has_traffic_filtering=True,id=2f9ed6a8-5d92-4e63-9c4e-2658d1cec310,network=Network(20384d1d-92c0-4ac7-a993-956fa784cd87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f9ed6a8-5d') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG os_vif [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:f8:f3,bridge_name='br-int',has_traffic_filtering=True,id=2f9ed6a8-5d92-4e63-9c4e-2658d1cec310,network=Network(20384d1d-92c0-4ac7-a993-956fa784cd87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f9ed6a8-5d') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f9ed6a8-5d, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2f9ed6a8-5d, col_values=(('external_ids', {'iface-id': '2f9ed6a8-5d92-4e63-9c4e-2658d1cec310', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:f8:f3', 'vm-uuid': 'e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:41 user nova-compute[73056]: INFO os_vif [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:f8:f3,bridge_name='br-int',has_traffic_filtering=True,id=2f9ed6a8-5d92-4e63-9c4e-2658d1cec310,network=Network(20384d1d-92c0-4ac7-a993-956fa784cd87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f9ed6a8-5d')
Aug 14 16:56:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] No VIF found with MAC fa:16:3e:24:f8:f3, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG nova.network.neutron [req-ae395bb5-7b8a-4cd1-a351-df3ba14d9f86 req-11decaad-6ee5-4cdd-be28-26176f71cbbb service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Updated VIF entry in instance network info cache for port 2f9ed6a8-5d92-4e63-9c4e-2658d1cec310. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG nova.network.neutron [req-ae395bb5-7b8a-4cd1-a351-df3ba14d9f86 req-11decaad-6ee5-4cdd-be28-26176f71cbbb service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Updating instance_info_cache with network_info: [{"id": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "address": "fa:16:3e:24:f8:f3", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9ed6a8-5d", "ovs_interfaceid": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:56:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ae395bb5-7b8a-4cd1-a351-df3ba14d9f86 req-11decaad-6ee5-4cdd-be28-26176f71cbbb service nova] Releasing lock "refresh_cache-e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:56:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:43 user nova-compute[73056]: DEBUG nova.compute.manager [req-e7587644-ef67-457f-82e6-68f956a5e6d4 req-4c4c15d4-cc4e-4ef1-93e9-ecb4c4b1a6af service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Received event network-vif-plugged-2f9ed6a8-5d92-4e63-9c4e-2658d1cec310 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:56:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e7587644-ef67-457f-82e6-68f956a5e6d4 req-4c4c15d4-cc4e-4ef1-93e9-ecb4c4b1a6af service nova] Acquiring lock "e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:56:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e7587644-ef67-457f-82e6-68f956a5e6d4 req-4c4c15d4-cc4e-4ef1-93e9-ecb4c4b1a6af service nova] Lock "e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:56:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e7587644-ef67-457f-82e6-68f956a5e6d4 req-4c4c15d4-cc4e-4ef1-93e9-ecb4c4b1a6af service nova] Lock "e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:56:43 user nova-compute[73056]: DEBUG nova.compute.manager [req-e7587644-ef67-457f-82e6-68f956a5e6d4 req-4c4c15d4-cc4e-4ef1-93e9-ecb4c4b1a6af service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] No waiting events found dispatching network-vif-plugged-2f9ed6a8-5d92-4e63-9c4e-2658d1cec310 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:56:43 user nova-compute[73056]: WARNING nova.compute.manager [req-e7587644-ef67-457f-82e6-68f956a5e6d4 req-4c4c15d4-cc4e-4ef1-93e9-ecb4c4b1a6af service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Received unexpected event network-vif-plugged-2f9ed6a8-5d92-4e63-9c4e-2658d1cec310 for instance with vm_state building and task_state spawning.
Aug 14 16:56:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-89289ff6-2009-4090-8b8d-a346ae1c3f1b tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Acquiring lock "ee670695-1123-4d95-a7ad-ac79f9a4c16e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:56:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-89289ff6-2009-4090-8b8d-a346ae1c3f1b tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Lock "ee670695-1123-4d95-a7ad-ac79f9a4c16e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:56:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-89289ff6-2009-4090-8b8d-a346ae1c3f1b tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Acquiring lock "ee670695-1123-4d95-a7ad-ac79f9a4c16e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:56:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-89289ff6-2009-4090-8b8d-a346ae1c3f1b tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Lock "ee670695-1123-4d95-a7ad-ac79f9a4c16e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:56:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-89289ff6-2009-4090-8b8d-a346ae1c3f1b tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Lock "ee670695-1123-4d95-a7ad-ac79f9a4c16e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:56:43 user nova-compute[73056]: INFO nova.compute.manager [None req-89289ff6-2009-4090-8b8d-a346ae1c3f1b tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Terminating instance
Aug 14 16:56:43 user nova-compute[73056]: DEBUG nova.compute.manager [None req-89289ff6-2009-4090-8b8d-a346ae1c3f1b tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 16:56:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:44 user nova-compute[73056]: DEBUG nova.compute.manager [req-f67390ca-2594-4b98-8a3b-2a89e257e528 req-d93ab3aa-f1c1-4db1-a175-ab7a6d85c7d3 service nova] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Received event network-vif-unplugged-5fd92a95-cd11-4828-9731-91e305ac7b26 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:56:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f67390ca-2594-4b98-8a3b-2a89e257e528 req-d93ab3aa-f1c1-4db1-a175-ab7a6d85c7d3 service nova] Acquiring lock "ee670695-1123-4d95-a7ad-ac79f9a4c16e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:56:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f67390ca-2594-4b98-8a3b-2a89e257e528 req-d93ab3aa-f1c1-4db1-a175-ab7a6d85c7d3 service nova] Lock "ee670695-1123-4d95-a7ad-ac79f9a4c16e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:56:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f67390ca-2594-4b98-8a3b-2a89e257e528 req-d93ab3aa-f1c1-4db1-a175-ab7a6d85c7d3 service nova] Lock "ee670695-1123-4d95-a7ad-ac79f9a4c16e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:56:44 user nova-compute[73056]: DEBUG nova.compute.manager [req-f67390ca-2594-4b98-8a3b-2a89e257e528 req-d93ab3aa-f1c1-4db1-a175-ab7a6d85c7d3 service nova] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] No waiting events found dispatching network-vif-unplugged-5fd92a95-cd11-4828-9731-91e305ac7b26 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:56:44 user nova-compute[73056]: DEBUG nova.compute.manager [req-f67390ca-2594-4b98-8a3b-2a89e257e528 req-d93ab3aa-f1c1-4db1-a175-ab7a6d85c7d3 service nova] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Received event network-vif-unplugged-5fd92a95-cd11-4828-9731-91e305ac7b26 for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:56:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:44 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Instance destroyed successfully.
Aug 14 16:56:44 user nova-compute[73056]: DEBUG nova.objects.instance [None req-89289ff6-2009-4090-8b8d-a346ae1c3f1b tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Lazy-loading 'resources' on Instance uuid ee670695-1123-4d95-a7ad-ac79f9a4c16e {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:56:44 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-89289ff6-2009-4090-8b8d-a346ae1c3f1b tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:51:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1307435377',display_name='tempest-SnapshotDataIntegrityTests-server-1307435377',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1307435377',id=35,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkVvreyh0PKcl3K/1he4BnJ7v28Teb+dIvDI1x122iDpfF3dyGYNX/Gx2zX8vCYtpZW9EHsORp9Ts3FXbIcpd8GxlO2fNOMGh0H42XplDA36Bq4nDVWXgq9NZ8wKxxFwg==',key_name='tempest-keypair-546350850',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:51:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2bd5d01bac1242ec9897e6931102e1b0',ramdisk_id='',reservation_id='r-4nwo5os7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-686395378',owner_user_name='tempest-SnapshotDataIntegrityTests-686395378-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:51:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a4b06c86dbd4deeab9487960525261b',uuid=ee670695-1123-4d95-a7ad-ac79f9a4c16e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5fd92a95-cd11-4828-9731-91e305ac7b26", "address": "fa:16:3e:b4:d2:be", "network": {"id": "89b465ce-32d9-4246-ab29-eaca3017bf33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-295083994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bd5d01bac1242ec9897e6931102e1b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd92a95-cd", "ovs_interfaceid": "5fd92a95-cd11-4828-9731-91e305ac7b26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:56:44 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-89289ff6-2009-4090-8b8d-a346ae1c3f1b tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Converting VIF {"id": "5fd92a95-cd11-4828-9731-91e305ac7b26", "address": "fa:16:3e:b4:d2:be", "network": {"id": "89b465ce-32d9-4246-ab29-eaca3017bf33", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-295083994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bd5d01bac1242ec9897e6931102e1b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd92a95-cd", "ovs_interfaceid": "5fd92a95-cd11-4828-9731-91e305ac7b26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:56:44 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-89289ff6-2009-4090-8b8d-a346ae1c3f1b tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:d2:be,bridge_name='br-int',has_traffic_filtering=True,id=5fd92a95-cd11-4828-9731-91e305ac7b26,network=Network(89b465ce-32d9-4246-ab29-eaca3017bf33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fd92a95-cd') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:56:44 user nova-compute[73056]: DEBUG os_vif [None req-89289ff6-2009-4090-8b8d-a346ae1c3f1b tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:d2:be,bridge_name='br-int',has_traffic_filtering=True,id=5fd92a95-cd11-4828-9731-91e305ac7b26,network=Network(89b465ce-32d9-4246-ab29-eaca3017bf33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fd92a95-cd') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:56:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5fd92a95-cd, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:56:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:56:44 user nova-compute[73056]: INFO os_vif [None req-89289ff6-2009-4090-8b8d-a346ae1c3f1b tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:d2:be,bridge_name='br-int',has_traffic_filtering=True,id=5fd92a95-cd11-4828-9731-91e305ac7b26,network=Network(89b465ce-32d9-4246-ab29-eaca3017bf33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fd92a95-cd')
Aug 14 16:56:44 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-89289ff6-2009-4090-8b8d-a346ae1c3f1b tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Deleting instance files /opt/stack/data/nova/instances/ee670695-1123-4d95-a7ad-ac79f9a4c16e_del
Aug 14 16:56:44 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-89289ff6-2009-4090-8b8d-a346ae1c3f1b tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Deletion of /opt/stack/data/nova/instances/ee670695-1123-4d95-a7ad-ac79f9a4c16e_del complete
Aug 14 16:56:44 user nova-compute[73056]: INFO nova.compute.manager [None req-89289ff6-2009-4090-8b8d-a346ae1c3f1b tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Took 0.82 seconds to destroy the instance on the hypervisor.
Aug 14 16:56:44 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-89289ff6-2009-4090-8b8d-a346ae1c3f1b tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 16:56:44 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 16:56:44 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 16:56:45 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692032205.1406655, e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:56:45 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] VM Resumed (Lifecycle Event)
Aug 14 16:56:45 user nova-compute[73056]: DEBUG nova.compute.manager [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:56:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:56:45 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Instance spawned successfully.
Aug 14 16:56:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:56:45 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:56:45 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:56:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:56:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:56:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:56:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:56:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:56:45 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:56:45 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:56:45 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692032205.141951, e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:56:45 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] VM Started (Lifecycle Event)
Aug 14 16:56:45 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:56:45 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:56:45 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:56:45 user nova-compute[73056]: INFO nova.compute.manager [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Took 6.33 seconds to spawn the instance on the hypervisor.
Aug 14 16:56:45 user nova-compute[73056]: DEBUG nova.compute.manager [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:56:45 user nova-compute[73056]: INFO nova.compute.manager [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Took 7.16 seconds to build instance.
Aug 14 16:56:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-60e18fff-9c74-4408-a042-3d9e7cb46321 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.270s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:56:45 user nova-compute[73056]: DEBUG nova.compute.manager [req-5a108578-ed26-4543-99f1-7e691681a898 req-b7a61483-257c-424f-a49b-ae09095af7c6 service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Received event network-vif-plugged-2f9ed6a8-5d92-4e63-9c4e-2658d1cec310 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:56:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-5a108578-ed26-4543-99f1-7e691681a898 req-b7a61483-257c-424f-a49b-ae09095af7c6 service nova] Acquiring lock "e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:56:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-5a108578-ed26-4543-99f1-7e691681a898 req-b7a61483-257c-424f-a49b-ae09095af7c6 service nova] Lock "e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:56:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-5a108578-ed26-4543-99f1-7e691681a898 req-b7a61483-257c-424f-a49b-ae09095af7c6 service nova] Lock "e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:56:45 user nova-compute[73056]: DEBUG nova.compute.manager [req-5a108578-ed26-4543-99f1-7e691681a898 req-b7a61483-257c-424f-a49b-ae09095af7c6 service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] No waiting events found dispatching network-vif-plugged-2f9ed6a8-5d92-4e63-9c4e-2658d1cec310 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:56:45 user nova-compute[73056]: WARNING nova.compute.manager [req-5a108578-ed26-4543-99f1-7e691681a898 req-b7a61483-257c-424f-a49b-ae09095af7c6 service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Received unexpected event network-vif-plugged-2f9ed6a8-5d92-4e63-9c4e-2658d1cec310 for instance with vm_state active and task_state None.
Aug 14 16:56:46 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:56:46 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Took 1.64 seconds to deallocate network for instance.
Aug 14 16:56:46 user nova-compute[73056]: DEBUG nova.compute.manager [req-05823638-fba9-41b2-b704-4c7fc81b68d4 req-cf275a65-e763-4fc8-9342-abf308268fb4 service nova] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Received event network-vif-plugged-5fd92a95-cd11-4828-9731-91e305ac7b26 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:56:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-05823638-fba9-41b2-b704-4c7fc81b68d4 req-cf275a65-e763-4fc8-9342-abf308268fb4 service nova] Acquiring lock "ee670695-1123-4d95-a7ad-ac79f9a4c16e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:56:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-05823638-fba9-41b2-b704-4c7fc81b68d4 req-cf275a65-e763-4fc8-9342-abf308268fb4 service nova] Lock "ee670695-1123-4d95-a7ad-ac79f9a4c16e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:56:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-05823638-fba9-41b2-b704-4c7fc81b68d4 req-cf275a65-e763-4fc8-9342-abf308268fb4 service nova] Lock "ee670695-1123-4d95-a7ad-ac79f9a4c16e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:56:46 user nova-compute[73056]: DEBUG nova.compute.manager [req-05823638-fba9-41b2-b704-4c7fc81b68d4 req-cf275a65-e763-4fc8-9342-abf308268fb4 service nova] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] No waiting events found dispatching network-vif-plugged-5fd92a95-cd11-4828-9731-91e305ac7b26 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:56:46 user nova-compute[73056]: WARNING nova.compute.manager [req-05823638-fba9-41b2-b704-4c7fc81b68d4 req-cf275a65-e763-4fc8-9342-abf308268fb4 service nova] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Received unexpected event network-vif-plugged-5fd92a95-cd11-4828-9731-91e305ac7b26 for instance with vm_state active and task_state deleting.
Aug 14 16:56:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-89289ff6-2009-4090-8b8d-a346ae1c3f1b tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:56:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-89289ff6-2009-4090-8b8d-a346ae1c3f1b tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:56:46 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-89289ff6-2009-4090-8b8d-a346ae1c3f1b tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:56:46 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-89289ff6-2009-4090-8b8d-a346ae1c3f1b tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:56:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-89289ff6-2009-4090-8b8d-a346ae1c3f1b tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:56:46 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-89289ff6-2009-4090-8b8d-a346ae1c3f1b tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Deleted allocations for instance ee670695-1123-4d95-a7ad-ac79f9a4c16e
Aug 14 16:56:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-89289ff6-2009-4090-8b8d-a346ae1c3f1b tempest-SnapshotDataIntegrityTests-686395378 tempest-SnapshotDataIntegrityTests-686395378-project-member] Lock "ee670695-1123-4d95-a7ad-ac79f9a4c16e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:56:47 user nova-compute[73056]: DEBUG nova.compute.manager [req-6043f938-d82e-4bea-b7bd-9281a9b69cdc req-870b883d-7907-4dd1-9e2b-16c88d34ee50 service nova] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Received event network-vif-deleted-5fd92a95-cd11-4828-9731-91e305ac7b26 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:56:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:54 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:56:59 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692032204.49717, ee670695-1123-4d95-a7ad-ac79f9a4c16e => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:56:59 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] VM Stopped (Lifecycle Event)
Aug 14 16:56:59 user nova-compute[73056]: DEBUG nova.compute.manager [None req-9eea03d8-f5f5-46d4-b984-be14a8a4a092 None None] [instance: ee670695-1123-4d95-a7ad-ac79f9a4c16e] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:56:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:57:00 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:57:00 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 16:57:03 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:57:03 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:57:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:57:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:57:06 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:57:06 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 16:57:06 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Rebuilding the list of instances to heal {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 16:57:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-b580e3d0-88b5-42a3-a953-84b94c088f41" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:57:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-b580e3d0-88b5-42a3-a953-84b94c088f41" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:57:06 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 16:57:06 user nova-compute[73056]: DEBUG nova.objects.instance [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lazy-loading 'info_cache' on Instance uuid b580e3d0-88b5-42a3-a953-84b94c088f41 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:57:06 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Updating instance_info_cache with network_info: [{"id": "b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0", "address": "fa:16:3e:f9:ca:00", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb006576a-8b", "ovs_interfaceid": "b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:57:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-b580e3d0-88b5-42a3-a953-84b94c088f41" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:57:06 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 16:57:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:57:08 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:57:09 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:57:09 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:57:09 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:57:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:57:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:57:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:57:09 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 16:57:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:57:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:57:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:57:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:57:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:57:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:57:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:57:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:57:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:57:10 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:57:10 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:57:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:57:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:57:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:57:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:57:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:57:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:57:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:57:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:57:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:57:11 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json" returned: 0 in 0.234s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:57:11 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:57:11 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:57:11 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:57:11 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:57:11 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:57:11 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:57:12 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:57:12 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:57:12 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=7806MB free_disk=25.294837951660156GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 16:57:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:57:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:57:12 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance b580e3d0-88b5-42a3-a953-84b94c088f41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:57:12 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 92c34cf0-fd39-49fc-9244-4da8ccae6eec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:57:12 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 5914b70b-665a-4ce0-ab4e-11db2b8bc057 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:57:12 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 6c9ce215-9006-468d-998d-a18df5bf4222 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:57:12 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 5191b082-a6f3-467c-b28b-fda85e15f330 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:57:12 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:57:12 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 16:57:12 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 16:57:12 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:57:12 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:57:12 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 16:57:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.576s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:57:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:57:14 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:57:14 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:57:14 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:57:16 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:57:16 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73056) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 16:57:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:57:19 user nova-compute[73056]: DEBUG nova.compute.manager [None req-715ad93e-aae2-4ea4-bd08-4932ab50222f tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:57:19 user nova-compute[73056]: INFO nova.compute.manager [None req-715ad93e-aae2-4ea4-bd08-4932ab50222f tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] instance snapshotting
Aug 14 16:57:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:57:19 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-715ad93e-aae2-4ea4-bd08-4932ab50222f tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Beginning live snapshot process
Aug 14 16:57:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-715ad93e-aae2-4ea4-bd08-4932ab50222f tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json -f qcow2 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:57:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-715ad93e-aae2-4ea4-bd08-4932ab50222f tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:57:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-715ad93e-aae2-4ea4-bd08-4932ab50222f tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json -f qcow2 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:57:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-715ad93e-aae2-4ea4-bd08-4932ab50222f tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:57:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-715ad93e-aae2-4ea4-bd08-4932ab50222f tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:57:20 user nova-compute[73056]: DEBUG nova.compute.manager [req-aaa1b37e-f51c-4b8d-aea0-9428959548c4 req-4d196048-c703-4285-8fa7-eba1574f7a48 service nova] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Received event network-changed-09f698e2-41d7-4329-92b1-9a80dc461259 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:57:20 user nova-compute[73056]: DEBUG nova.compute.manager [req-aaa1b37e-f51c-4b8d-aea0-9428959548c4 req-4d196048-c703-4285-8fa7-eba1574f7a48 service nova] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Refreshing instance network info cache due to event network-changed-09f698e2-41d7-4329-92b1-9a80dc461259. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:57:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-aaa1b37e-f51c-4b8d-aea0-9428959548c4 req-4d196048-c703-4285-8fa7-eba1574f7a48 service nova] Acquiring lock "refresh_cache-6c9ce215-9006-468d-998d-a18df5bf4222" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:57:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-aaa1b37e-f51c-4b8d-aea0-9428959548c4 req-4d196048-c703-4285-8fa7-eba1574f7a48 service nova] Acquired lock "refresh_cache-6c9ce215-9006-468d-998d-a18df5bf4222" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:57:20 user nova-compute[73056]: DEBUG nova.network.neutron [req-aaa1b37e-f51c-4b8d-aea0-9428959548c4 req-4d196048-c703-4285-8fa7-eba1574f7a48 service nova] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Refreshing network info cache for port 09f698e2-41d7-4329-92b1-9a80dc461259 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:57:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-715ad93e-aae2-4ea4-bd08-4932ab50222f tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.184s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:57:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-715ad93e-aae2-4ea4-bd08-4932ab50222f tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpf02yqbk_/5086d075804445919e4394ba384e1405.delta 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:57:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-715ad93e-aae2-4ea4-bd08-4932ab50222f tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpf02yqbk_/5086d075804445919e4394ba384e1405.delta 1073741824" returned: 0 in 0.066s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:57:20 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-715ad93e-aae2-4ea4-bd08-4932ab50222f tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 14 16:57:20 user nova-compute[73056]: DEBUG nova.network.neutron [req-aaa1b37e-f51c-4b8d-aea0-9428959548c4 req-4d196048-c703-4285-8fa7-eba1574f7a48 service nova] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Updated VIF entry in instance network info cache for port 09f698e2-41d7-4329-92b1-9a80dc461259. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:57:20 user nova-compute[73056]: DEBUG nova.network.neutron [req-aaa1b37e-f51c-4b8d-aea0-9428959548c4 req-4d196048-c703-4285-8fa7-eba1574f7a48 service nova] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Updating instance_info_cache with network_info: [{"id": "09f698e2-41d7-4329-92b1-9a80dc461259", "address": "fa:16:3e:dc:48:7c", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f698e2-41", "ovs_interfaceid": "09f698e2-41d7-4329-92b1-9a80dc461259", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:57:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-aaa1b37e-f51c-4b8d-aea0-9428959548c4 req-4d196048-c703-4285-8fa7-eba1574f7a48 service nova] Releasing lock "refresh_cache-6c9ce215-9006-468d-998d-a18df5bf4222" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:57:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-715ad93e-aae2-4ea4-bd08-4932ab50222f tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73056) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 16:57:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-715ad93e-aae2-4ea4-bd08-4932ab50222f tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73056) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 16:57:21 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-715ad93e-aae2-4ea4-bd08-4932ab50222f tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 14 16:57:21 user nova-compute[73056]: DEBUG nova.privsep.utils [None req-715ad93e-aae2-4ea4-bd08-4932ab50222f tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73056) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 16:57:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-715ad93e-aae2-4ea4-bd08-4932ab50222f tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpf02yqbk_/5086d075804445919e4394ba384e1405.delta /opt/stack/data/nova/instances/snapshots/tmpf02yqbk_/5086d075804445919e4394ba384e1405 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:57:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-715ad93e-aae2-4ea4-bd08-4932ab50222f tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpf02yqbk_/5086d075804445919e4394ba384e1405.delta /opt/stack/data/nova/instances/snapshots/tmpf02yqbk_/5086d075804445919e4394ba384e1405" returned: 0 in 0.629s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:57:22 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-715ad93e-aae2-4ea4-bd08-4932ab50222f tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Snapshot extracted, beginning image upload
Aug 14 16:57:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:57:24 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:57:24 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-715ad93e-aae2-4ea4-bd08-4932ab50222f tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Snapshot image upload complete
Aug 14 16:57:24 user nova-compute[73056]: INFO nova.compute.manager [None req-715ad93e-aae2-4ea4-bd08-4932ab50222f tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Took 5.31 seconds to snapshot the instance on the hypervisor.
Aug 14 16:57:28 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:57:28 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Cleaning up deleted instances {{(pid=73056) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 16:57:28 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] There are 0 instances to clean {{(pid=73056) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 16:57:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:57:29 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:57:34 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:57:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:57:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:57:39 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:57:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:57:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:57:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:57:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:57:54 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:57:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "a8757bd2-d48f-4fde-93be-1f32f25dee8a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:57:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "a8757bd2-d48f-4fde-93be-1f32f25dee8a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:57:54 user nova-compute[73056]: DEBUG nova.compute.manager [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:57:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:57:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:57:54 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:57:54 user nova-compute[73056]: INFO nova.compute.claims [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Claim successful on node user
Aug 14 16:57:55 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Refreshing inventories for resource provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 16:57:55 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Updating ProviderTree inventory for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 16:57:55 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Updating inventory in ProviderTree for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 16:57:55 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Refreshing aggregate associations for resource provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b, aggregates: None {{(pid=73056) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 16:57:55 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Refreshing trait associations for resource provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=73056) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 16:57:55 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:57:55 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:57:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.459s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:57:55 user nova-compute[73056]: DEBUG nova.compute.manager [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:57:55 user nova-compute[73056]: DEBUG nova.compute.manager [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:57:55 user nova-compute[73056]: DEBUG nova.network.neutron [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:57:55 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:57:55 user nova-compute[73056]: DEBUG nova.compute.manager [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:57:55 user nova-compute[73056]: INFO nova.virt.block_device [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Booting with volume 57f885a0-24ca-4f5f-97f8-4d543ea30446 at /dev/vda
Aug 14 16:57:55 user nova-compute[73056]: DEBUG nova.policy [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2be1b098ca9f4232bd198b515630f6ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffb5203b9284500b8add8a6586cad49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:57:55 user nova-compute[73056]: DEBUG os_brick.utils [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:57:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:57:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:57:55 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1d1bfb-c130-4f45-8705-b32692c4af34]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:57:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:57:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:57:55 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b059bd2-3ea2-4c18-bbd2-a0e2a63966b0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:57:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:57:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:57:55 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e83da1-50ab-46d7-bdb2-c814d8ec06fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:57:55 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc38d49c-98e6-4e37-9807-0c0968de5db1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:57:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:57:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:57:55 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:57:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:57:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:57:55 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:57:55 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[371c2e64-f15a-48e6-b553-4fcabb81644d]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:57:55 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:57:55 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:57:55 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:57:55 user nova-compute[73056]: DEBUG os_brick.utils [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:57:55 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Updating existing volume attachment record: 68cb5c6c-7ea0-4393-86b2-e450caf71a39 {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 16:57:56 user nova-compute[73056]: DEBUG nova.network.neutron [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Successfully created port: 91e720d2-bdc5-4f49-93ab-2384a12ae22a {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:57:57 user nova-compute[73056]: DEBUG nova.network.neutron [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Successfully updated port: 91e720d2-bdc5-4f49-93ab-2384a12ae22a {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:57:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "refresh_cache-a8757bd2-d48f-4fde-93be-1f32f25dee8a" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:57:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquired lock "refresh_cache-a8757bd2-d48f-4fde-93be-1f32f25dee8a" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:57:57 user nova-compute[73056]: DEBUG nova.network.neutron [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:57:57 user nova-compute[73056]: DEBUG nova.compute.manager [req-4baddf1d-e225-45e3-a8ba-e344f314bf48 req-0106a54b-404a-4cee-b5df-e2b64077014d service nova] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Received event network-changed-91e720d2-bdc5-4f49-93ab-2384a12ae22a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:57:57 user nova-compute[73056]: DEBUG nova.compute.manager [req-4baddf1d-e225-45e3-a8ba-e344f314bf48 req-0106a54b-404a-4cee-b5df-e2b64077014d service nova] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Refreshing instance network info cache due to event network-changed-91e720d2-bdc5-4f49-93ab-2384a12ae22a. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:57:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4baddf1d-e225-45e3-a8ba-e344f314bf48 req-0106a54b-404a-4cee-b5df-e2b64077014d service nova] Acquiring lock "refresh_cache-a8757bd2-d48f-4fde-93be-1f32f25dee8a" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:57:57 user nova-compute[73056]: DEBUG nova.network.neutron [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:57:57 user nova-compute[73056]: DEBUG nova.network.neutron [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Updating instance_info_cache with network_info: [{"id": "91e720d2-bdc5-4f49-93ab-2384a12ae22a", "address": "fa:16:3e:f0:e9:20", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e720d2-bd", "ovs_interfaceid": "91e720d2-bdc5-4f49-93ab-2384a12ae22a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:57:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Releasing lock "refresh_cache-a8757bd2-d48f-4fde-93be-1f32f25dee8a" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:57:57 user nova-compute[73056]: DEBUG nova.compute.manager [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Instance network_info: |[{"id": "91e720d2-bdc5-4f49-93ab-2384a12ae22a", "address": "fa:16:3e:f0:e9:20", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e720d2-bd", "ovs_interfaceid": "91e720d2-bdc5-4f49-93ab-2384a12ae22a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:57:57 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4baddf1d-e225-45e3-a8ba-e344f314bf48 req-0106a54b-404a-4cee-b5df-e2b64077014d service nova] Acquired lock "refresh_cache-a8757bd2-d48f-4fde-93be-1f32f25dee8a" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:57:57 user nova-compute[73056]: DEBUG nova.network.neutron [req-4baddf1d-e225-45e3-a8ba-e344f314bf48 req-0106a54b-404a-4cee-b5df-e2b64077014d service nova] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Refreshing network info cache for port 91e720d2-bdc5-4f49-93ab-2384a12ae22a {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:57:58 user nova-compute[73056]: DEBUG nova.network.neutron [req-4baddf1d-e225-45e3-a8ba-e344f314bf48 req-0106a54b-404a-4cee-b5df-e2b64077014d service nova] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Updated VIF entry in instance network info cache for port 91e720d2-bdc5-4f49-93ab-2384a12ae22a. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:57:58 user nova-compute[73056]: DEBUG nova.network.neutron [req-4baddf1d-e225-45e3-a8ba-e344f314bf48 req-0106a54b-404a-4cee-b5df-e2b64077014d service nova] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Updating instance_info_cache with network_info: [{"id": "91e720d2-bdc5-4f49-93ab-2384a12ae22a", "address": "fa:16:3e:f0:e9:20", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e720d2-bd", "ovs_interfaceid": "91e720d2-bdc5-4f49-93ab-2384a12ae22a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:57:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4baddf1d-e225-45e3-a8ba-e344f314bf48 req-0106a54b-404a-4cee-b5df-e2b64077014d service nova] Releasing lock "refresh_cache-a8757bd2-d48f-4fde-93be-1f32f25dee8a" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:57:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:58:01 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:58:01 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG nova.compute.manager [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:58:04 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Creating image(s)
Aug 14 16:58:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Did not create local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Ensure instance console log exists: /opt/stack/data/nova/instances/a8757bd2-d48f-4fde-93be-1f32f25dee8a/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Start _get_guest_xml network_info=[{"id": "91e720d2-bdc5-4f49-93ab-2384a12ae22a", "address": "fa:16:3e:f0:e9:20", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e720d2-bd", "ovs_interfaceid": "91e720d2-bdc5-4f49-93ab-2384a12ae22a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NcGdmwej', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a8757bd2-d48f-4fde-93be-1f32f25dee8a', 'attached_at': '', 'detached_at': '', 'volume_id': '57f885a0-24ca-4f5f-97f8-4d543ea30446', 'serial': '57f885a0-24ca-4f5f-97f8-4d543ea30446'}, 'attachment_id': '68cb5c6c-7ea0-4393-86b2-e450caf71a39', 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:58:04 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:58:04 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:58:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NcGdmwej', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:58:04 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:58:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:58:04 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:58:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:58:04 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:58:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446 -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8f8a1c-f3d2-4dba-a95d-f855e874a27d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:58:04 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446 -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea12c03-ced8-4d59-ab6d-cd71e14841b9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446] added
Aug 14 16:58:04 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07a2bb2-9792-4460-b104-6464a088bd87]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[22dcb9db-6572-4fb5-8ddd-9fd771ada85a]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NcGdmwej {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NcGdmwej" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d4f69d-5b31-4f33-a1df-39e3f6323a4b]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NcGdmwej'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c05300-2849-432b-af7e-51dec9668046]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b445cb8e-9d4c-4def-ba27-861619586e73]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f (non-flash)
Aug 14 16:58:04 user nova-compute[73056]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:58:04 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f (non-flash)
Aug 14 16:58:04 user nova-compute[73056]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:58:04 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446 -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb5f66b-d822-4995-b667-f55d65e9aa4d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446, portal: 172.16.0.220,3260]
Aug 14 16:58:04 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446, portal: 172.16.0.220,3260] successful.
Aug 14 16:58:04 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b630231-c9ae-4daa-9baa-98b401ae2af8]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcd601e-6821-4487-9f40-19f23b5b13d7]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f (non-flash)
Aug 14 16:58:04 user nova-compute[73056]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:58:04 user nova-compute[73056]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446 (non-flash)
Aug 14 16:58:04 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f (non-flash)
Aug 14 16:58:04 user nova-compute[73056]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:58:04 user nova-compute[73056]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446 (non-flash)
Aug 14 16:58:04 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa59c55-433b-4e59-b947-1b0a8c540106]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:58:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NcGdmwej', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:58:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:58:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '26166633462336135', 'path': '/dev/sdb'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:58:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166633462336135', 'path': '/dev/sdb'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:58:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-712496658',display_name='tempest-TestVolumeBootPattern-server-712496658',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-712496658',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBF9UVFrNwhQEMB/CeZfBoQaAoJOYsqM67ncFaZmWIdIzJd1Na96dOaZXAGstQENK3pBtGzJ44fKFGGhrlwWzWMk9Hm8I+KfAGKsRBWs7QP0LhARS9gNshqYVaA6cOdig==',key_name='tempest-TestVolumeBootPattern-829376797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cffb5203b9284500b8add8a6586cad49',ramdisk_id='',reservation_id='r-h0iqmuh9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1676214558',owner_user_name='tempest-TestVolumeBootPattern-1676214558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:57:56Z,user_data=None,user_id='2be1b098ca9f4232bd198b515630f6ad',uuid=a8757bd2-d48f-4fde-93be-1f32f25dee8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91e720d2-bdc5-4f49-93ab-2384a12ae22a", "address": "fa:16:3e:f0:e9:20", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e720d2-bd", "ovs_interfaceid": "91e720d2-bdc5-4f49-93ab-2384a12ae22a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:58:05 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Converting VIF {"id": "91e720d2-bdc5-4f49-93ab-2384a12ae22a", "address": "fa:16:3e:f0:e9:20", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e720d2-bd", "ovs_interfaceid": "91e720d2-bdc5-4f49-93ab-2384a12ae22a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:58:05 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e9:20,bridge_name='br-int',has_traffic_filtering=True,id=91e720d2-bdc5-4f49-93ab-2384a12ae22a,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91e720d2-bd') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:58:05 user nova-compute[73056]: DEBUG nova.objects.instance [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lazy-loading 'pci_devices' on Instance uuid a8757bd2-d48f-4fde-93be-1f32f25dee8a {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:58:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:58:05 user nova-compute[73056]:   <uuid>a8757bd2-d48f-4fde-93be-1f32f25dee8a</uuid>
Aug 14 16:58:05 user nova-compute[73056]:   <name>instance-0000002a</name>
Aug 14 16:58:05 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:58:05 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:58:05 user nova-compute[73056]:   <metadata>
Aug 14 16:58:05 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:58:05 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:58:05 user nova-compute[73056]:       <nova:name>tempest-TestVolumeBootPattern-server-712496658</nova:name>
Aug 14 16:58:05 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:58:04</nova:creationTime>
Aug 14 16:58:05 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:58:05 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:58:05 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:58:05 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:58:05 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:58:05 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:58:05 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:58:05 user nova-compute[73056]:       <nova:owner>
Aug 14 16:58:05 user nova-compute[73056]:         <nova:user uuid="2be1b098ca9f4232bd198b515630f6ad">tempest-TestVolumeBootPattern-1676214558-project-member</nova:user>
Aug 14 16:58:05 user nova-compute[73056]:         <nova:project uuid="cffb5203b9284500b8add8a6586cad49">tempest-TestVolumeBootPattern-1676214558</nova:project>
Aug 14 16:58:05 user nova-compute[73056]:       </nova:owner>
Aug 14 16:58:05 user nova-compute[73056]:       <nova:ports>
Aug 14 16:58:05 user nova-compute[73056]:         <nova:port uuid="91e720d2-bdc5-4f49-93ab-2384a12ae22a">
Aug 14 16:58:05 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 14 16:58:05 user nova-compute[73056]:         </nova:port>
Aug 14 16:58:05 user nova-compute[73056]:       </nova:ports>
Aug 14 16:58:05 user nova-compute[73056]:     </nova:instance>
Aug 14 16:58:05 user nova-compute[73056]:   </metadata>
Aug 14 16:58:05 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:58:05 user nova-compute[73056]:     <system>
Aug 14 16:58:05 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:58:05 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:58:05 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:58:05 user nova-compute[73056]:       <entry name="serial">a8757bd2-d48f-4fde-93be-1f32f25dee8a</entry>
Aug 14 16:58:05 user nova-compute[73056]:       <entry name="uuid">a8757bd2-d48f-4fde-93be-1f32f25dee8a</entry>
Aug 14 16:58:05 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:58:05 user nova-compute[73056]:     </system>
Aug 14 16:58:05 user nova-compute[73056]:   </sysinfo>
Aug 14 16:58:05 user nova-compute[73056]:   <os>
Aug 14 16:58:05 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:58:05 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:58:05 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:58:05 user nova-compute[73056]:   </os>
Aug 14 16:58:05 user nova-compute[73056]:   <features>
Aug 14 16:58:05 user nova-compute[73056]:     <acpi/>
Aug 14 16:58:05 user nova-compute[73056]:     <apic/>
Aug 14 16:58:05 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:58:05 user nova-compute[73056]:   </features>
Aug 14 16:58:05 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:58:05 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:58:05 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:58:05 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:58:05 user nova-compute[73056]:   </clock>
Aug 14 16:58:05 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:58:05 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:58:05 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:58:05 user nova-compute[73056]:   </cpu>
Aug 14 16:58:05 user nova-compute[73056]:   <devices>
Aug 14 16:58:05 user nova-compute[73056]:     <disk type="block" device="disk">
Aug 14 16:58:05 user nova-compute[73056]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:58:05 user nova-compute[73056]:       <source dev="/dev/sdb"/>
Aug 14 16:58:05 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:58:05 user nova-compute[73056]:       <serial>57f885a0-24ca-4f5f-97f8-4d543ea30446</serial>
Aug 14 16:58:05 user nova-compute[73056]:     </disk>
Aug 14 16:58:05 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:58:05 user nova-compute[73056]:       <mac address="fa:16:3e:f0:e9:20"/>
Aug 14 16:58:05 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:58:05 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:58:05 user nova-compute[73056]:       <target dev="tap91e720d2-bd"/>
Aug 14 16:58:05 user nova-compute[73056]:     </interface>
Aug 14 16:58:05 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:58:05 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/a8757bd2-d48f-4fde-93be-1f32f25dee8a/console.log" append="off"/>
Aug 14 16:58:05 user nova-compute[73056]:     </serial>
Aug 14 16:58:05 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:58:05 user nova-compute[73056]:     <video>
Aug 14 16:58:05 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:58:05 user nova-compute[73056]:     </video>
Aug 14 16:58:05 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:58:05 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:58:05 user nova-compute[73056]:     </rng>
Aug 14 16:58:05 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:58:05 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:58:05 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:58:05 user nova-compute[73056]:     </memballoon>
Aug 14 16:58:05 user nova-compute[73056]:   </devices>
Aug 14 16:58:05 user nova-compute[73056]: </domain>
Aug 14 16:58:05 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:58:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-712496658',display_name='tempest-TestVolumeBootPattern-server-712496658',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-712496658',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBF9UVFrNwhQEMB/CeZfBoQaAoJOYsqM67ncFaZmWIdIzJd1Na96dOaZXAGstQENK3pBtGzJ44fKFGGhrlwWzWMk9Hm8I+KfAGKsRBWs7QP0LhARS9gNshqYVaA6cOdig==',key_name='tempest-TestVolumeBootPattern-829376797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cffb5203b9284500b8add8a6586cad49',ramdisk_id='',reservation_id='r-h0iqmuh9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1676214558',owner_user_name='tempest-TestVolumeBootPattern-1676214558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:57:56Z,user_data=None,user_id='2be1b098ca9f4232bd198b515630f6ad',uuid=a8757bd2-d48f-4fde-93be-1f32f25dee8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91e720d2-bdc5-4f49-93ab-2384a12ae22a", "address": "fa:16:3e:f0:e9:20", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e720d2-bd", "ovs_interfaceid": "91e720d2-bdc5-4f49-93ab-2384a12ae22a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:58:05 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Converting VIF {"id": "91e720d2-bdc5-4f49-93ab-2384a12ae22a", "address": "fa:16:3e:f0:e9:20", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e720d2-bd", "ovs_interfaceid": "91e720d2-bdc5-4f49-93ab-2384a12ae22a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:58:05 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e9:20,bridge_name='br-int',has_traffic_filtering=True,id=91e720d2-bdc5-4f49-93ab-2384a12ae22a,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91e720d2-bd') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:58:05 user nova-compute[73056]: DEBUG os_vif [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e9:20,bridge_name='br-int',has_traffic_filtering=True,id=91e720d2-bdc5-4f49-93ab-2384a12ae22a,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91e720d2-bd') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:58:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:58:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:58:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap91e720d2-bd, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:58:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap91e720d2-bd, col_values=(('external_ids', {'iface-id': '91e720d2-bdc5-4f49-93ab-2384a12ae22a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:e9:20', 'vm-uuid': 'a8757bd2-d48f-4fde-93be-1f32f25dee8a'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:58:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:58:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:05 user nova-compute[73056]: INFO os_vif [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e9:20,bridge_name='br-int',has_traffic_filtering=True,id=91e720d2-bdc5-4f49-93ab-2384a12ae22a,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91e720d2-bd')
Aug 14 16:58:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:58:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] No VIF found with MAC fa:16:3e:f0:e9:20, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:58:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:07 user nova-compute[73056]: DEBUG nova.compute.manager [req-76304fc2-f595-4c39-99a5-4a6752137466 req-fa01c79a-c3ce-43d2-b80a-0dffe773fd44 service nova] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Received event network-vif-plugged-91e720d2-bdc5-4f49-93ab-2384a12ae22a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:58:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-76304fc2-f595-4c39-99a5-4a6752137466 req-fa01c79a-c3ce-43d2-b80a-0dffe773fd44 service nova] Acquiring lock "a8757bd2-d48f-4fde-93be-1f32f25dee8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:58:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-76304fc2-f595-4c39-99a5-4a6752137466 req-fa01c79a-c3ce-43d2-b80a-0dffe773fd44 service nova] Lock "a8757bd2-d48f-4fde-93be-1f32f25dee8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:58:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-76304fc2-f595-4c39-99a5-4a6752137466 req-fa01c79a-c3ce-43d2-b80a-0dffe773fd44 service nova] Lock "a8757bd2-d48f-4fde-93be-1f32f25dee8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:58:07 user nova-compute[73056]: DEBUG nova.compute.manager [req-76304fc2-f595-4c39-99a5-4a6752137466 req-fa01c79a-c3ce-43d2-b80a-0dffe773fd44 service nova] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] No waiting events found dispatching network-vif-plugged-91e720d2-bdc5-4f49-93ab-2384a12ae22a {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:58:07 user nova-compute[73056]: WARNING nova.compute.manager [req-76304fc2-f595-4c39-99a5-4a6752137466 req-fa01c79a-c3ce-43d2-b80a-0dffe773fd44 service nova] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Received unexpected event network-vif-plugged-91e720d2-bdc5-4f49-93ab-2384a12ae22a for instance with vm_state building and task_state spawning.
Aug 14 16:58:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:08 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:58:08 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 16:58:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-92c34cf0-fd39-49fc-9244-4da8ccae6eec" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:58:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-92c34cf0-fd39-49fc-9244-4da8ccae6eec" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:58:08 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 16:58:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:08 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Updating instance_info_cache with network_info: [{"id": "2a57f016-2b33-46f4-a885-51c4ac8658bb", "address": "fa:16:3e:11:b2:3a", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a57f016-2b", "ovs_interfaceid": "2a57f016-2b33-46f4-a885-51c4ac8658bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:58:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-92c34cf0-fd39-49fc-9244-4da8ccae6eec" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:58:08 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 16:58:09 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692032289.2306736, a8757bd2-d48f-4fde-93be-1f32f25dee8a => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:58:09 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] VM Resumed (Lifecycle Event)
Aug 14 16:58:09 user nova-compute[73056]: DEBUG nova.compute.manager [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:58:09 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:58:09 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Instance spawned successfully.
Aug 14 16:58:09 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:58:09 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:58:09 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:58:09 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:58:09 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:58:09 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:58:09 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:58:09 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:58:09 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:58:09 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:58:09 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692032289.2322433, a8757bd2-d48f-4fde-93be-1f32f25dee8a => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:58:09 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] VM Started (Lifecycle Event)
Aug 14 16:58:09 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:58:09 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:58:09 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:58:09 user nova-compute[73056]: DEBUG nova.compute.manager [req-2feeb442-64f2-4d8a-90bb-7a993f3e8eec req-3af262d8-71ce-4970-a95d-35023bb02da0 service nova] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Received event network-vif-plugged-91e720d2-bdc5-4f49-93ab-2384a12ae22a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:58:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2feeb442-64f2-4d8a-90bb-7a993f3e8eec req-3af262d8-71ce-4970-a95d-35023bb02da0 service nova] Acquiring lock "a8757bd2-d48f-4fde-93be-1f32f25dee8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:58:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2feeb442-64f2-4d8a-90bb-7a993f3e8eec req-3af262d8-71ce-4970-a95d-35023bb02da0 service nova] Lock "a8757bd2-d48f-4fde-93be-1f32f25dee8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:58:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2feeb442-64f2-4d8a-90bb-7a993f3e8eec req-3af262d8-71ce-4970-a95d-35023bb02da0 service nova] Lock "a8757bd2-d48f-4fde-93be-1f32f25dee8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:58:09 user nova-compute[73056]: DEBUG nova.compute.manager [req-2feeb442-64f2-4d8a-90bb-7a993f3e8eec req-3af262d8-71ce-4970-a95d-35023bb02da0 service nova] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] No waiting events found dispatching network-vif-plugged-91e720d2-bdc5-4f49-93ab-2384a12ae22a {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:58:09 user nova-compute[73056]: WARNING nova.compute.manager [req-2feeb442-64f2-4d8a-90bb-7a993f3e8eec req-3af262d8-71ce-4970-a95d-35023bb02da0 service nova] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Received unexpected event network-vif-plugged-91e720d2-bdc5-4f49-93ab-2384a12ae22a for instance with vm_state building and task_state spawning.
Aug 14 16:58:09 user nova-compute[73056]: INFO nova.compute.manager [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Took 5.23 seconds to spawn the instance on the hypervisor.
Aug 14 16:58:09 user nova-compute[73056]: DEBUG nova.compute.manager [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:58:09 user nova-compute[73056]: INFO nova.compute.manager [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Took 14.59 seconds to build instance.
Aug 14 16:58:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-eb4dcddd-0f89-41d2-a8af-302946c8b351 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "a8757bd2-d48f-4fde-93be-1f32f25dee8a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.690s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:58:09 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:58:09 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:58:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:11 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:58:11 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:58:11 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:58:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:58:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:58:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:58:11 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 16:58:11 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:11 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:11 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:11 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:11 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:12 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:58:12 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:58:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:12 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:58:14 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:58:14 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:58:14 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=8079MB free_disk=25.241313934326172GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 16:58:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:58:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:58:14 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance b580e3d0-88b5-42a3-a953-84b94c088f41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:58:14 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 92c34cf0-fd39-49fc-9244-4da8ccae6eec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:58:14 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 5914b70b-665a-4ce0-ab4e-11db2b8bc057 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:58:14 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 6c9ce215-9006-468d-998d-a18df5bf4222 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:58:14 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 5191b082-a6f3-467c-b28b-fda85e15f330 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:58:14 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:58:14 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance a8757bd2-d48f-4fde-93be-1f32f25dee8a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:58:14 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 16:58:14 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 16:58:14 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:58:14 user nova-compute[73056]: DEBUG nova.compute.manager [req-903b8dee-b2a9-4d45-9da5-8c816b4c9932 req-2d1aa48a-c96e-4337-894b-8d5581dbfecb service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Received event network-changed-c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:58:14 user nova-compute[73056]: DEBUG nova.compute.manager [req-903b8dee-b2a9-4d45-9da5-8c816b4c9932 req-2d1aa48a-c96e-4337-894b-8d5581dbfecb service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Refreshing instance network info cache due to event network-changed-c9eb236b-5c65-4108-9527-dbf9550cf01f. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:58:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-903b8dee-b2a9-4d45-9da5-8c816b4c9932 req-2d1aa48a-c96e-4337-894b-8d5581dbfecb service nova] Acquiring lock "refresh_cache-5914b70b-665a-4ce0-ab4e-11db2b8bc057" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:58:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-903b8dee-b2a9-4d45-9da5-8c816b4c9932 req-2d1aa48a-c96e-4337-894b-8d5581dbfecb service nova] Acquired lock "refresh_cache-5914b70b-665a-4ce0-ab4e-11db2b8bc057" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:58:14 user nova-compute[73056]: DEBUG nova.network.neutron [req-903b8dee-b2a9-4d45-9da5-8c816b4c9932 req-2d1aa48a-c96e-4337-894b-8d5581dbfecb service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Refreshing network info cache for port c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:58:14 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:58:14 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 16:58:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.428s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-89682203-44df-444a-907a-7088e01aa706 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-89682203-44df-444a-907a-7088e01aa706 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:58:15 user nova-compute[73056]: INFO nova.compute.manager [None req-89682203-44df-444a-907a-7088e01aa706 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Detaching volume 82d8a96b-6b13-4960-8883-d6b8e274cd3f
Aug 14 16:58:15 user nova-compute[73056]: INFO nova.virt.block_device [None req-89682203-44df-444a-907a-7088e01aa706 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Attempting to driver detach volume 82d8a96b-6b13-4960-8883-d6b8e274cd3f from mountpoint /dev/vdb
Aug 14 16:58:15 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-89682203-44df-444a-907a-7088e01aa706 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Attempting to detach device vdb from instance 5914b70b-665a-4ce0-ab4e-11db2b8bc057 from the persistent domain config. {{(pid=73056) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-89682203-44df-444a-907a-7088e01aa706 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 16:58:15 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:58:15 user nova-compute[73056]:   <source dev="/dev/sdd"/>
Aug 14 16:58:15 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:58:15 user nova-compute[73056]:   <serial>82d8a96b-6b13-4960-8883-d6b8e274cd3f</serial>
Aug 14 16:58:15 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 16:58:15 user nova-compute[73056]: </disk>
Aug 14 16:58:15 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 16:58:15 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-89682203-44df-444a-907a-7088e01aa706 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Successfully detached device vdb from instance 5914b70b-665a-4ce0-ab4e-11db2b8bc057 from the persistent domain config.
Aug 14 16:58:15 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-89682203-44df-444a-907a-7088e01aa706 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5914b70b-665a-4ce0-ab4e-11db2b8bc057 from the live domain config. {{(pid=73056) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-89682203-44df-444a-907a-7088e01aa706 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 16:58:15 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:58:15 user nova-compute[73056]:   <source dev="/dev/sdd"/>
Aug 14 16:58:15 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 16:58:15 user nova-compute[73056]:   <serial>82d8a96b-6b13-4960-8883-d6b8e274cd3f</serial>
Aug 14 16:58:15 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 16:58:15 user nova-compute[73056]: </disk>
Aug 14 16:58:15 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG nova.network.neutron [req-903b8dee-b2a9-4d45-9da5-8c816b4c9932 req-2d1aa48a-c96e-4337-894b-8d5581dbfecb service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Updated VIF entry in instance network info cache for port c9eb236b-5c65-4108-9527-dbf9550cf01f. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG nova.network.neutron [req-903b8dee-b2a9-4d45-9da5-8c816b4c9932 req-2d1aa48a-c96e-4337-894b-8d5581dbfecb service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Updating instance_info_cache with network_info: [{"id": "c9eb236b-5c65-4108-9527-dbf9550cf01f", "address": "fa:16:3e:af:d2:e8", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9eb236b-5c", "ovs_interfaceid": "c9eb236b-5c65-4108-9527-dbf9550cf01f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-903b8dee-b2a9-4d45-9da5-8c816b4c9932 req-2d1aa48a-c96e-4337-894b-8d5581dbfecb service nova] Releasing lock "refresh_cache-5914b70b-665a-4ce0-ab4e-11db2b8bc057" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Received event <DeviceRemovedEvent: 1692032295.5438852, 5914b70b-665a-4ce0-ab4e-11db2b8bc057 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73056) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-89682203-44df-444a-907a-7088e01aa706 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5914b70b-665a-4ce0-ab4e-11db2b8bc057 {{(pid=73056) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 16:58:15 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-89682203-44df-444a-907a-7088e01aa706 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Successfully detached device vdb from instance 5914b70b-665a-4ce0-ab4e-11db2b8bc057 from the live domain config.
Aug 14 16:58:15 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89682203-44df-444a-907a-7088e01aa706 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-89682203-44df-444a-907a-7088e01aa706 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SVTXHDay', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:58:15 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-89682203-44df-444a-907a-7088e01aa706 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:58:15 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-89682203-44df-444a-907a-7088e01aa706 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-89682203-44df-444a-907a-7088e01aa706 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-89682203-44df-444a-907a-7088e01aa706 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8003a90-cbbd-42d8-bc36-a5d4042a592d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[66180f3f-2b64-4267-9169-ce4166167ad2]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-89682203-44df-444a-907a-7088e01aa706 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f (non-flash)
Aug 14 16:58:15 user nova-compute[73056]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:58:15 user nova-compute[73056]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446 (non-flash)
Aug 14 16:58:15 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-89682203-44df-444a-907a-7088e01aa706 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f (non-flash)
Aug 14 16:58:15 user nova-compute[73056]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:58:15 user nova-compute[73056]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446 (non-flash)
Aug 14 16:58:15 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-89682203-44df-444a-907a-7088e01aa706 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff2dcd5aa70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f'): ({'sdd'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-89682203-44df-444a-907a-7088e01aa706 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Removing single pathed devices sdd {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22a8786-fe27-4a6e-90cd-5212de094d9e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.028s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e56e6c2-0431-4c53-9d27-3908cf97697c]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-89682203-44df-444a-907a-7088e01aa706 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Flushing IO for device /dev/sdd {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[981c8d82-2286-4c12-92e4-e2f425e8a802]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-89682203-44df-444a-907a-7088e01aa706 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[82aac50a-aa40-49a3-9924-e12f64cd8eb3]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-89682203-44df-444a-907a-7088e01aa706 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-89682203-44df-444a-907a-7088e01aa706 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] SCSI volumes sdd have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-89682203-44df-444a-907a-7088e01aa706 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c62361-b86c-4131-bafa-ed23743a60cf]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-89682203-44df-444a-907a-7088e01aa706 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a17b8a-fa53-4569-9714-1fbd391472da]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-89682203-44df-444a-907a-7088e01aa706 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f, portal: 172.16.0.220,3260]
Aug 14 16:58:15 user nova-compute[73056]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f, portal: 172.16.0.220,3260] successful.
Aug 14 16:58:15 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82d8a96b-6b13-4960-8883-d6b8e274cd3f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fcb994-e65d-40f1-a2f4-c9a8483b95d3]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-89682203-44df-444a-907a-7088e01aa706 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-89682203-44df-444a-907a-7088e01aa706 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-89682203-44df-444a-907a-7088e01aa706 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] <== disconnect_volume: return (323ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:58:15 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89682203-44df-444a-907a-7088e01aa706 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:58:16 user nova-compute[73056]: DEBUG nova.objects.instance [None req-89682203-44df-444a-907a-7088e01aa706 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lazy-loading 'flavor' on Instance uuid 5914b70b-665a-4ce0-ab4e-11db2b8bc057 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:58:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-89682203-44df-444a-907a-7088e01aa706 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.575s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:58:16 user nova-compute[73056]: DEBUG nova.compute.manager [req-3a6439bb-1817-4dc9-83e3-2edcabd73bad req-6c3310c0-ce5a-44c9-b138-1aa00986da28 service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Received event network-changed-c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:58:16 user nova-compute[73056]: DEBUG nova.compute.manager [req-3a6439bb-1817-4dc9-83e3-2edcabd73bad req-6c3310c0-ce5a-44c9-b138-1aa00986da28 service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Refreshing instance network info cache due to event network-changed-c9eb236b-5c65-4108-9527-dbf9550cf01f. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:58:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3a6439bb-1817-4dc9-83e3-2edcabd73bad req-6c3310c0-ce5a-44c9-b138-1aa00986da28 service nova] Acquiring lock "refresh_cache-5914b70b-665a-4ce0-ab4e-11db2b8bc057" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:58:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3a6439bb-1817-4dc9-83e3-2edcabd73bad req-6c3310c0-ce5a-44c9-b138-1aa00986da28 service nova] Acquired lock "refresh_cache-5914b70b-665a-4ce0-ab4e-11db2b8bc057" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:58:16 user nova-compute[73056]: DEBUG nova.network.neutron [req-3a6439bb-1817-4dc9-83e3-2edcabd73bad req-6c3310c0-ce5a-44c9-b138-1aa00986da28 service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Refreshing network info cache for port c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:58:17 user nova-compute[73056]: DEBUG nova.network.neutron [req-3a6439bb-1817-4dc9-83e3-2edcabd73bad req-6c3310c0-ce5a-44c9-b138-1aa00986da28 service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Updated VIF entry in instance network info cache for port c9eb236b-5c65-4108-9527-dbf9550cf01f. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:58:17 user nova-compute[73056]: DEBUG nova.network.neutron [req-3a6439bb-1817-4dc9-83e3-2edcabd73bad req-6c3310c0-ce5a-44c9-b138-1aa00986da28 service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Updating instance_info_cache with network_info: [{"id": "c9eb236b-5c65-4108-9527-dbf9550cf01f", "address": "fa:16:3e:af:d2:e8", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9eb236b-5c", "ovs_interfaceid": "c9eb236b-5c65-4108-9527-dbf9550cf01f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:58:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3a6439bb-1817-4dc9-83e3-2edcabd73bad req-6c3310c0-ce5a-44c9-b138-1aa00986da28 service nova] Releasing lock "refresh_cache-5914b70b-665a-4ce0-ab4e-11db2b8bc057" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:58:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "fb1a193b-73b7-4690-8571-be9af04b3b14" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:58:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "fb1a193b-73b7-4690-8571-be9af04b3b14" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:58:27 user nova-compute[73056]: DEBUG nova.compute.manager [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 16:58:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:58:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:58:27 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 16:58:27 user nova-compute[73056]: INFO nova.compute.claims [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Claim successful on node user
Aug 14 16:58:27 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:58:27 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:58:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.333s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:58:27 user nova-compute[73056]: DEBUG nova.compute.manager [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 16:58:27 user nova-compute[73056]: DEBUG nova.compute.manager [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 16:58:27 user nova-compute[73056]: DEBUG nova.network.neutron [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 16:58:27 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 16:58:27 user nova-compute[73056]: DEBUG nova.compute.manager [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 16:58:27 user nova-compute[73056]: INFO nova.virt.block_device [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Booting with blank volume at /dev/vda
Aug 14 16:58:27 user nova-compute[73056]: DEBUG nova.policy [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '958f0c79efdc4352b35874e6c6f940d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56fc678888b4653802e94ac6b47f95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 16:58:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:28 user nova-compute[73056]: DEBUG nova.network.neutron [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Successfully created port: 852ab20a-9a1b-47c5-b85e-52a44fff3e36 {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 16:58:29 user nova-compute[73056]: DEBUG nova.compute.manager [req-f9afd36f-054a-4a68-8f1a-1fd217b3953b req-d9d206bd-a6dc-49a5-82ed-9dc9c03a5924 service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Received event network-changed-2f9ed6a8-5d92-4e63-9c4e-2658d1cec310 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:58:29 user nova-compute[73056]: DEBUG nova.compute.manager [req-f9afd36f-054a-4a68-8f1a-1fd217b3953b req-d9d206bd-a6dc-49a5-82ed-9dc9c03a5924 service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Refreshing instance network info cache due to event network-changed-2f9ed6a8-5d92-4e63-9c4e-2658d1cec310. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:58:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f9afd36f-054a-4a68-8f1a-1fd217b3953b req-d9d206bd-a6dc-49a5-82ed-9dc9c03a5924 service nova] Acquiring lock "refresh_cache-e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:58:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f9afd36f-054a-4a68-8f1a-1fd217b3953b req-d9d206bd-a6dc-49a5-82ed-9dc9c03a5924 service nova] Acquired lock "refresh_cache-e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:58:29 user nova-compute[73056]: DEBUG nova.network.neutron [req-f9afd36f-054a-4a68-8f1a-1fd217b3953b req-d9d206bd-a6dc-49a5-82ed-9dc9c03a5924 service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Refreshing network info cache for port 2f9ed6a8-5d92-4e63-9c4e-2658d1cec310 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:58:29 user nova-compute[73056]: DEBUG nova.network.neutron [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Successfully updated port: 852ab20a-9a1b-47c5-b85e-52a44fff3e36 {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 16:58:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "refresh_cache-fb1a193b-73b7-4690-8571-be9af04b3b14" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:58:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquired lock "refresh_cache-fb1a193b-73b7-4690-8571-be9af04b3b14" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:58:29 user nova-compute[73056]: DEBUG nova.network.neutron [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:58:29 user nova-compute[73056]: DEBUG nova.compute.manager [req-0fea7dcf-d2c8-4954-84e9-2e755c53acdb req-19eb8de1-e014-4a75-99bb-1487cab760dc service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Received event network-changed-852ab20a-9a1b-47c5-b85e-52a44fff3e36 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:58:29 user nova-compute[73056]: DEBUG nova.compute.manager [req-0fea7dcf-d2c8-4954-84e9-2e755c53acdb req-19eb8de1-e014-4a75-99bb-1487cab760dc service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Refreshing instance network info cache due to event network-changed-852ab20a-9a1b-47c5-b85e-52a44fff3e36. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:58:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0fea7dcf-d2c8-4954-84e9-2e755c53acdb req-19eb8de1-e014-4a75-99bb-1487cab760dc service nova] Acquiring lock "refresh_cache-fb1a193b-73b7-4690-8571-be9af04b3b14" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:58:29 user nova-compute[73056]: DEBUG nova.network.neutron [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 16:58:29 user nova-compute[73056]: DEBUG nova.network.neutron [req-f9afd36f-054a-4a68-8f1a-1fd217b3953b req-d9d206bd-a6dc-49a5-82ed-9dc9c03a5924 service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Updated VIF entry in instance network info cache for port 2f9ed6a8-5d92-4e63-9c4e-2658d1cec310. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:58:29 user nova-compute[73056]: DEBUG nova.network.neutron [req-f9afd36f-054a-4a68-8f1a-1fd217b3953b req-d9d206bd-a6dc-49a5-82ed-9dc9c03a5924 service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Updating instance_info_cache with network_info: [{"id": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "address": "fa:16:3e:24:f8:f3", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9ed6a8-5d", "ovs_interfaceid": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:58:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f9afd36f-054a-4a68-8f1a-1fd217b3953b req-d9d206bd-a6dc-49a5-82ed-9dc9c03a5924 service nova] Releasing lock "refresh_cache-e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:58:30 user nova-compute[73056]: DEBUG nova.network.neutron [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Updating instance_info_cache with network_info: [{"id": "852ab20a-9a1b-47c5-b85e-52a44fff3e36", "address": "fa:16:3e:32:95:fb", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852ab20a-9a", "ovs_interfaceid": "852ab20a-9a1b-47c5-b85e-52a44fff3e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:58:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Releasing lock "refresh_cache-fb1a193b-73b7-4690-8571-be9af04b3b14" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:58:30 user nova-compute[73056]: DEBUG nova.compute.manager [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Instance network_info: |[{"id": "852ab20a-9a1b-47c5-b85e-52a44fff3e36", "address": "fa:16:3e:32:95:fb", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852ab20a-9a", "ovs_interfaceid": "852ab20a-9a1b-47c5-b85e-52a44fff3e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 16:58:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0fea7dcf-d2c8-4954-84e9-2e755c53acdb req-19eb8de1-e014-4a75-99bb-1487cab760dc service nova] Acquired lock "refresh_cache-fb1a193b-73b7-4690-8571-be9af04b3b14" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:58:30 user nova-compute[73056]: DEBUG nova.network.neutron [req-0fea7dcf-d2c8-4954-84e9-2e755c53acdb req-19eb8de1-e014-4a75-99bb-1487cab760dc service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Refreshing network info cache for port 852ab20a-9a1b-47c5-b85e-52a44fff3e36 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:58:30 user nova-compute[73056]: DEBUG nova.network.neutron [req-0fea7dcf-d2c8-4954-84e9-2e755c53acdb req-19eb8de1-e014-4a75-99bb-1487cab760dc service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Updated VIF entry in instance network info cache for port 852ab20a-9a1b-47c5-b85e-52a44fff3e36. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:58:30 user nova-compute[73056]: DEBUG nova.network.neutron [req-0fea7dcf-d2c8-4954-84e9-2e755c53acdb req-19eb8de1-e014-4a75-99bb-1487cab760dc service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Updating instance_info_cache with network_info: [{"id": "852ab20a-9a1b-47c5-b85e-52a44fff3e36", "address": "fa:16:3e:32:95:fb", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852ab20a-9a", "ovs_interfaceid": "852ab20a-9a1b-47c5-b85e-52a44fff3e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:58:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0fea7dcf-d2c8-4954-84e9-2e755c53acdb req-19eb8de1-e014-4a75-99bb-1487cab760dc service nova] Releasing lock "refresh_cache-fb1a193b-73b7-4690-8571-be9af04b3b14" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:58:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:33 user nova-compute[73056]: DEBUG os_brick.utils [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:58:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:33 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[8701cafc-0f8f-498b-b0bf-aae1f245c3a1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:58:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:33 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2305bc5b-67db-417f-9ad1-054e3923d30c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:58:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:33 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[400eb36c-0c05-4236-baea-2a449afcf54d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:58:33 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c5df78-eb1a-4f0b-b947-47064171e8b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:58:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:58:33 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 16:58:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 16:58:33 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 16:58:33 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aafb2ac-727a-4448-b58d-cad3762aeded]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:58:33 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 16:58:33 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 16:58:33 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 16:58:33 user nova-compute[73056]: DEBUG os_brick.utils [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:58:33 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Updating existing volume attachment record: 49f04eed-a58d-4b66-97f2-f48e0e2b809f {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 16:58:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5054b983-9ad0-415e-a3dd-5b6c03ef8a1f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:58:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5054b983-9ad0-415e-a3dd-5b6c03ef8a1f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:58:33 user nova-compute[73056]: INFO nova.compute.manager [None req-5054b983-9ad0-415e-a3dd-5b6c03ef8a1f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Shelving
Aug 14 16:58:34 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:34 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:34 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:34 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:34 user nova-compute[73056]: DEBUG nova.compute.manager [req-70063cbf-bed1-4fb6-9eb0-3df332783024 req-66db6b75-f228-4598-847b-9a03990d9402 service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Received event network-vif-unplugged-2f9ed6a8-5d92-4e63-9c4e-2658d1cec310 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:58:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-70063cbf-bed1-4fb6-9eb0-3df332783024 req-66db6b75-f228-4598-847b-9a03990d9402 service nova] Acquiring lock "e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:58:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-70063cbf-bed1-4fb6-9eb0-3df332783024 req-66db6b75-f228-4598-847b-9a03990d9402 service nova] Lock "e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:58:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-70063cbf-bed1-4fb6-9eb0-3df332783024 req-66db6b75-f228-4598-847b-9a03990d9402 service nova] Lock "e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:58:34 user nova-compute[73056]: DEBUG nova.compute.manager [req-70063cbf-bed1-4fb6-9eb0-3df332783024 req-66db6b75-f228-4598-847b-9a03990d9402 service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] No waiting events found dispatching network-vif-unplugged-2f9ed6a8-5d92-4e63-9c4e-2658d1cec310 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:58:34 user nova-compute[73056]: WARNING nova.compute.manager [req-70063cbf-bed1-4fb6-9eb0-3df332783024 req-66db6b75-f228-4598-847b-9a03990d9402 service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Received unexpected event network-vif-unplugged-2f9ed6a8-5d92-4e63-9c4e-2658d1cec310 for instance with vm_state active and task_state shelving.
Aug 14 16:58:34 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Instance destroyed successfully.
Aug 14 16:58:34 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-5054b983-9ad0-415e-a3dd-5b6c03ef8a1f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Beginning cold snapshot process
Aug 14 16:58:34 user nova-compute[73056]: DEBUG nova.privsep.utils [None req-5054b983-9ad0-415e-a3dd-5b6c03ef8a1f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73056) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 16:58:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-5054b983-9ad0-415e-a3dd-5b6c03ef8a1f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3/disk /opt/stack/data/nova/instances/snapshots/tmpxeyl1czd/2b3acd48bc7d48c7b3581364d73137bf {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:35 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-5054b983-9ad0-415e-a3dd-5b6c03ef8a1f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3/disk /opt/stack/data/nova/instances/snapshots/tmpxeyl1czd/2b3acd48bc7d48c7b3581364d73137bf" returned: 0 in 0.680s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:35 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-5054b983-9ad0-415e-a3dd-5b6c03ef8a1f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Snapshot extracted, beginning image upload
Aug 14 16:58:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:36 user nova-compute[73056]: DEBUG nova.compute.manager [req-4d33573a-891c-4cb0-a088-f446ee67d021 req-de3a9e15-b85d-4a2e-90d6-764b445d362b service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Received event network-vif-plugged-2f9ed6a8-5d92-4e63-9c4e-2658d1cec310 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:58:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4d33573a-891c-4cb0-a088-f446ee67d021 req-de3a9e15-b85d-4a2e-90d6-764b445d362b service nova] Acquiring lock "e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:58:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4d33573a-891c-4cb0-a088-f446ee67d021 req-de3a9e15-b85d-4a2e-90d6-764b445d362b service nova] Lock "e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:58:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4d33573a-891c-4cb0-a088-f446ee67d021 req-de3a9e15-b85d-4a2e-90d6-764b445d362b service nova] Lock "e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:58:36 user nova-compute[73056]: DEBUG nova.compute.manager [req-4d33573a-891c-4cb0-a088-f446ee67d021 req-de3a9e15-b85d-4a2e-90d6-764b445d362b service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] No waiting events found dispatching network-vif-plugged-2f9ed6a8-5d92-4e63-9c4e-2658d1cec310 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:58:36 user nova-compute[73056]: WARNING nova.compute.manager [req-4d33573a-891c-4cb0-a088-f446ee67d021 req-de3a9e15-b85d-4a2e-90d6-764b445d362b service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Received unexpected event network-vif-plugged-2f9ed6a8-5d92-4e63-9c4e-2658d1cec310 for instance with vm_state active and task_state shelving_image_uploading.
Aug 14 16:58:38 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-5054b983-9ad0-415e-a3dd-5b6c03ef8a1f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Snapshot image upload complete
Aug 14 16:58:38 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5054b983-9ad0-415e-a3dd-5b6c03ef8a1f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:58:38 user nova-compute[73056]: INFO nova.compute.manager [None req-5054b983-9ad0-415e-a3dd-5b6c03ef8a1f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Shelve offloading
Aug 14 16:58:38 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Instance destroyed successfully.
Aug 14 16:58:38 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5054b983-9ad0-415e-a3dd-5b6c03ef8a1f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:58:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5054b983-9ad0-415e-a3dd-5b6c03ef8a1f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "refresh_cache-e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:58:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5054b983-9ad0-415e-a3dd-5b6c03ef8a1f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquired lock "refresh_cache-e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:58:38 user nova-compute[73056]: DEBUG nova.network.neutron [None req-5054b983-9ad0-415e-a3dd-5b6c03ef8a1f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 16:58:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:38 user nova-compute[73056]: DEBUG nova.network.neutron [None req-5054b983-9ad0-415e-a3dd-5b6c03ef8a1f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Updating instance_info_cache with network_info: [{"id": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "address": "fa:16:3e:24:f8:f3", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9ed6a8-5d", "ovs_interfaceid": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:58:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5054b983-9ad0-415e-a3dd-5b6c03ef8a1f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Releasing lock "refresh_cache-e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:58:39 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Instance destroyed successfully.
Aug 14 16:58:39 user nova-compute[73056]: DEBUG nova.objects.instance [None req-5054b983-9ad0-415e-a3dd-5b6c03ef8a1f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lazy-loading 'resources' on Instance uuid e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:58:39 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-5054b983-9ad0-415e-a3dd-5b6c03ef8a1f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:56:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-948039001',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-948039001',id=41,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHYNBfnC2ikOrzBY4cz5LLIum5X5oxpuFuwOJsgbUapOe+ZhLzeRuq82OuvfQs1nq2h3Js5eBhWIRwcRYkBy8csHsKYVKBxxR6b3mKZP/TEs4IfBOUR0BP2bP1OopKMnUA==',key_name='tempest-keypair-707146351',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:56:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c67a1c8fcd97416e90f6b5a50a886a75',ramdisk_id='',reservation_id='r-p59njr5z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1935390723',owner_user_name='tempest-AttachVolumeShelveTestJSON-1935390723-project-member',shelved_at='2023-08-14T16:58:38.048169',shelved_host='user',shelved_image_id='13e3ca97-f3c2-40c8-b9f6-925232fa32d2'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:58:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a20dd4c88984674996e26fdcfa4f126',uuid=e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "address": "fa:16:3e:24:f8:f3", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9ed6a8-5d", "ovs_interfaceid": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:58:39 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-5054b983-9ad0-415e-a3dd-5b6c03ef8a1f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Converting VIF {"id": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "address": "fa:16:3e:24:f8:f3", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9ed6a8-5d", "ovs_interfaceid": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:58:39 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-5054b983-9ad0-415e-a3dd-5b6c03ef8a1f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:f8:f3,bridge_name='br-int',has_traffic_filtering=True,id=2f9ed6a8-5d92-4e63-9c4e-2658d1cec310,network=Network(20384d1d-92c0-4ac7-a993-956fa784cd87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f9ed6a8-5d') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:58:39 user nova-compute[73056]: DEBUG os_vif [None req-5054b983-9ad0-415e-a3dd-5b6c03ef8a1f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:f8:f3,bridge_name='br-int',has_traffic_filtering=True,id=2f9ed6a8-5d92-4e63-9c4e-2658d1cec310,network=Network(20384d1d-92c0-4ac7-a993-956fa784cd87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f9ed6a8-5d') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:58:39 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:39 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f9ed6a8-5d, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:58:39 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:39 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:58:39 user nova-compute[73056]: INFO os_vif [None req-5054b983-9ad0-415e-a3dd-5b6c03ef8a1f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:f8:f3,bridge_name='br-int',has_traffic_filtering=True,id=2f9ed6a8-5d92-4e63-9c4e-2658d1cec310,network=Network(20384d1d-92c0-4ac7-a993-956fa784cd87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f9ed6a8-5d')
Aug 14 16:58:39 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-5054b983-9ad0-415e-a3dd-5b6c03ef8a1f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Deleting instance files /opt/stack/data/nova/instances/e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3_del
Aug 14 16:58:39 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-5054b983-9ad0-415e-a3dd-5b6c03ef8a1f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Deletion of /opt/stack/data/nova/instances/e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3_del complete
Aug 14 16:58:39 user nova-compute[73056]: DEBUG nova.compute.manager [req-1af9b3ef-39ca-4425-a708-3e177bb3acec req-8598d1af-2918-4620-af73-34a0371ba804 service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Received event network-changed-2f9ed6a8-5d92-4e63-9c4e-2658d1cec310 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:58:39 user nova-compute[73056]: DEBUG nova.compute.manager [req-1af9b3ef-39ca-4425-a708-3e177bb3acec req-8598d1af-2918-4620-af73-34a0371ba804 service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Refreshing instance network info cache due to event network-changed-2f9ed6a8-5d92-4e63-9c4e-2658d1cec310. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:58:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1af9b3ef-39ca-4425-a708-3e177bb3acec req-8598d1af-2918-4620-af73-34a0371ba804 service nova] Acquiring lock "refresh_cache-e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:58:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1af9b3ef-39ca-4425-a708-3e177bb3acec req-8598d1af-2918-4620-af73-34a0371ba804 service nova] Acquired lock "refresh_cache-e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:58:39 user nova-compute[73056]: DEBUG nova.network.neutron [req-1af9b3ef-39ca-4425-a708-3e177bb3acec req-8598d1af-2918-4620-af73-34a0371ba804 service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Refreshing network info cache for port 2f9ed6a8-5d92-4e63-9c4e-2658d1cec310 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:58:39 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-5054b983-9ad0-415e-a3dd-5b6c03ef8a1f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Deleted allocations for instance e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3
Aug 14 16:58:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5054b983-9ad0-415e-a3dd-5b6c03ef8a1f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:58:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5054b983-9ad0-415e-a3dd-5b6c03ef8a1f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:58:39 user nova-compute[73056]: DEBUG nova.objects.instance [None req-5054b983-9ad0-415e-a3dd-5b6c03ef8a1f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lazy-loading 'numa_topology' on Instance uuid e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:58:39 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-5054b983-9ad0-415e-a3dd-5b6c03ef8a1f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:58:39 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-5054b983-9ad0-415e-a3dd-5b6c03ef8a1f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:58:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5054b983-9ad0-415e-a3dd-5b6c03ef8a1f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:58:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5054b983-9ad0-415e-a3dd-5b6c03ef8a1f tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.018s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:58:40 user nova-compute[73056]: DEBUG nova.network.neutron [req-1af9b3ef-39ca-4425-a708-3e177bb3acec req-8598d1af-2918-4620-af73-34a0371ba804 service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Updated VIF entry in instance network info cache for port 2f9ed6a8-5d92-4e63-9c4e-2658d1cec310. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:58:40 user nova-compute[73056]: DEBUG nova.network.neutron [req-1af9b3ef-39ca-4425-a708-3e177bb3acec req-8598d1af-2918-4620-af73-34a0371ba804 service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Updating instance_info_cache with network_info: [{"id": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "address": "fa:16:3e:24:f8:f3", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap2f9ed6a8-5d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:58:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1af9b3ef-39ca-4425-a708-3e177bb3acec req-8598d1af-2918-4620-af73-34a0371ba804 service nova] Releasing lock "refresh_cache-e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG nova.compute.manager [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 16:58:42 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Creating image(s)
Aug 14 16:58:42 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Did not create local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Ensure instance console log exists: /opt/stack/data/nova/instances/fb1a193b-73b7-4690-8571-be9af04b3b14/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Start _get_guest_xml network_info=[{"id": "852ab20a-9a1b-47c5-b85e-52a44fff3e36", "address": "fa:16:3e:32:95:fb", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852ab20a-9a", "ovs_interfaceid": "852ab20a-9a1b-47c5-b85e-52a44fff3e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gCIxQLbZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fb1a193b-73b7-4690-8571-be9af04b3b14', 'attached_at': '', 'detached_at': '', 'volume_id': 'f47dbb29-89e5-4391-b050-a7773b4ca93e', 'serial': 'f47dbb29-89e5-4391-b050-a7773b4ca93e'}, 'attachment_id': '49f04eed-a58d-4b66-97f2-f48e0e2b809f', 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 16:58:42 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:58:42 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:58:42 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gCIxQLbZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:58:42 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:58:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:58:42 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:58:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:58:42 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 16:58:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c6669d-2df0-4af5-9bda-4d21180797b6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 16:58:42 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb76d269-c63d-4958-8eaf-b06756449143]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e] added
Aug 14 16:58:42 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[19da2c67-dfa5-4064-85a3-e233237e7709]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee5e9a1-2833-49e5-93ba-a9423aaefcdf]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gCIxQLbZ {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gCIxQLbZ" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[217edc9f-58a8-4618-8153-b234c1669209]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gCIxQLbZ'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad419134-a440-4f6b-a6aa-70b6c5f37f65]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[03279ac2-f819-4394-9435-9051caf23e2c]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:58:42 user nova-compute[73056]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446 (non-flash)
Aug 14 16:58:42 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:58:42 user nova-compute[73056]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446 (non-flash)
Aug 14 16:58:42 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e7918d-2b6b-4b30-8d49-287974211d50]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e, portal: 172.16.0.220,3260]
Aug 14 16:58:42 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e, portal: 172.16.0.220,3260] successful.
Aug 14 16:58:42 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ab015b-45b7-4dfa-b6fc-decd8108d2b2]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[620a672e-5fea-439c-9513-2baf2dd30d11]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:58:42 user nova-compute[73056]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446 (non-flash)
Aug 14 16:58:42 user nova-compute[73056]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 16:58:42 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:58:42 user nova-compute[73056]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446 (non-flash)
Aug 14 16:58:42 user nova-compute[73056]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 16:58:42 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[33abe303-b102-4ef8-94db-0d5530b4d3f4]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 16:58:42 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gCIxQLbZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 16:58:43 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:58:43 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '26161663262313736', 'path': '/dev/sdd'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:58:43 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161663262313736', 'path': '/dev/sdd'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 16:58:43 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:58:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-981830137',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-981830137',id=43,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a56fc678888b4653802e94ac6b47f95d',ramdisk_id='',reservation_id='r-j55o6yqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-572642883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:58:28Z,user_data=None,user_id='958f0c79efdc4352b35874e6c6f940d8',uuid=fb1a193b-73b7-4690-8571-be9af04b3b14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "852ab20a-9a1b-47c5-b85e-52a44fff3e36", "address": "fa:16:3e:32:95:fb", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852ab20a-9a", "ovs_interfaceid": "852ab20a-9a1b-47c5-b85e-52a44fff3e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 16:58:43 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Converting VIF {"id": "852ab20a-9a1b-47c5-b85e-52a44fff3e36", "address": "fa:16:3e:32:95:fb", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852ab20a-9a", "ovs_interfaceid": "852ab20a-9a1b-47c5-b85e-52a44fff3e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:58:43 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:95:fb,bridge_name='br-int',has_traffic_filtering=True,id=852ab20a-9a1b-47c5-b85e-52a44fff3e36,network=Network(ac2d700d-98d2-4459-8da8-a4858cda8864),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap852ab20a-9a') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:58:43 user nova-compute[73056]: DEBUG nova.objects.instance [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lazy-loading 'pci_devices' on Instance uuid fb1a193b-73b7-4690-8571-be9af04b3b14 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:58:43 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] End _get_guest_xml xml=<domain type="kvm">
Aug 14 16:58:43 user nova-compute[73056]:   <uuid>fb1a193b-73b7-4690-8571-be9af04b3b14</uuid>
Aug 14 16:58:43 user nova-compute[73056]:   <name>instance-0000002b</name>
Aug 14 16:58:43 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 16:58:43 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 16:58:43 user nova-compute[73056]:   <metadata>
Aug 14 16:58:43 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 16:58:43 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 16:58:43 user nova-compute[73056]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-981830137</nova:name>
Aug 14 16:58:43 user nova-compute[73056]:       <nova:creationTime>2023-08-14 16:58:42</nova:creationTime>
Aug 14 16:58:43 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 16:58:43 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 16:58:43 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 16:58:43 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 16:58:43 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 16:58:43 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 16:58:43 user nova-compute[73056]:       </nova:flavor>
Aug 14 16:58:43 user nova-compute[73056]:       <nova:owner>
Aug 14 16:58:43 user nova-compute[73056]:         <nova:user uuid="958f0c79efdc4352b35874e6c6f940d8">tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member</nova:user>
Aug 14 16:58:43 user nova-compute[73056]:         <nova:project uuid="a56fc678888b4653802e94ac6b47f95d">tempest-ServerBootFromVolumeStableRescueTest-572642883</nova:project>
Aug 14 16:58:43 user nova-compute[73056]:       </nova:owner>
Aug 14 16:58:43 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 16:58:43 user nova-compute[73056]:       <nova:ports>
Aug 14 16:58:43 user nova-compute[73056]:         <nova:port uuid="852ab20a-9a1b-47c5-b85e-52a44fff3e36">
Aug 14 16:58:43 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 14 16:58:43 user nova-compute[73056]:         </nova:port>
Aug 14 16:58:43 user nova-compute[73056]:       </nova:ports>
Aug 14 16:58:43 user nova-compute[73056]:     </nova:instance>
Aug 14 16:58:43 user nova-compute[73056]:   </metadata>
Aug 14 16:58:43 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 16:58:43 user nova-compute[73056]:     <system>
Aug 14 16:58:43 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 16:58:43 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 16:58:43 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 16:58:43 user nova-compute[73056]:       <entry name="serial">fb1a193b-73b7-4690-8571-be9af04b3b14</entry>
Aug 14 16:58:43 user nova-compute[73056]:       <entry name="uuid">fb1a193b-73b7-4690-8571-be9af04b3b14</entry>
Aug 14 16:58:43 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 16:58:43 user nova-compute[73056]:     </system>
Aug 14 16:58:43 user nova-compute[73056]:   </sysinfo>
Aug 14 16:58:43 user nova-compute[73056]:   <os>
Aug 14 16:58:43 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 16:58:43 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 16:58:43 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 16:58:43 user nova-compute[73056]:   </os>
Aug 14 16:58:43 user nova-compute[73056]:   <features>
Aug 14 16:58:43 user nova-compute[73056]:     <acpi/>
Aug 14 16:58:43 user nova-compute[73056]:     <apic/>
Aug 14 16:58:43 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 16:58:43 user nova-compute[73056]:   </features>
Aug 14 16:58:43 user nova-compute[73056]:   <clock offset="utc">
Aug 14 16:58:43 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 16:58:43 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 16:58:43 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 16:58:43 user nova-compute[73056]:   </clock>
Aug 14 16:58:43 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 16:58:43 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 16:58:43 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 16:58:43 user nova-compute[73056]:   </cpu>
Aug 14 16:58:43 user nova-compute[73056]:   <devices>
Aug 14 16:58:43 user nova-compute[73056]:     <disk type="block" device="disk">
Aug 14 16:58:43 user nova-compute[73056]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 16:58:43 user nova-compute[73056]:       <source dev="/dev/sdd"/>
Aug 14 16:58:43 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 16:58:43 user nova-compute[73056]:       <serial>f47dbb29-89e5-4391-b050-a7773b4ca93e</serial>
Aug 14 16:58:43 user nova-compute[73056]:     </disk>
Aug 14 16:58:43 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 16:58:43 user nova-compute[73056]:       <mac address="fa:16:3e:32:95:fb"/>
Aug 14 16:58:43 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:58:43 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 16:58:43 user nova-compute[73056]:       <target dev="tap852ab20a-9a"/>
Aug 14 16:58:43 user nova-compute[73056]:     </interface>
Aug 14 16:58:43 user nova-compute[73056]:     <serial type="pty">
Aug 14 16:58:43 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/fb1a193b-73b7-4690-8571-be9af04b3b14/console.log" append="off"/>
Aug 14 16:58:43 user nova-compute[73056]:     </serial>
Aug 14 16:58:43 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 16:58:43 user nova-compute[73056]:     <video>
Aug 14 16:58:43 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 16:58:43 user nova-compute[73056]:     </video>
Aug 14 16:58:43 user nova-compute[73056]:     <rng model="virtio">
Aug 14 16:58:43 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 16:58:43 user nova-compute[73056]:     </rng>
Aug 14 16:58:43 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 16:58:43 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 16:58:43 user nova-compute[73056]:       <stats period="10"/>
Aug 14 16:58:43 user nova-compute[73056]:     </memballoon>
Aug 14 16:58:43 user nova-compute[73056]:   </devices>
Aug 14 16:58:43 user nova-compute[73056]: </domain>
Aug 14 16:58:43 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 16:58:43 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:58:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-981830137',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-981830137',id=43,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a56fc678888b4653802e94ac6b47f95d',ramdisk_id='',reservation_id='r-j55o6yqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-572642883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:58:28Z,user_data=None,user_id='958f0c79efdc4352b35874e6c6f940d8',uuid=fb1a193b-73b7-4690-8571-be9af04b3b14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "852ab20a-9a1b-47c5-b85e-52a44fff3e36", "address": "fa:16:3e:32:95:fb", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852ab20a-9a", "ovs_interfaceid": "852ab20a-9a1b-47c5-b85e-52a44fff3e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 16:58:43 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Converting VIF {"id": "852ab20a-9a1b-47c5-b85e-52a44fff3e36", "address": "fa:16:3e:32:95:fb", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852ab20a-9a", "ovs_interfaceid": "852ab20a-9a1b-47c5-b85e-52a44fff3e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:58:43 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:95:fb,bridge_name='br-int',has_traffic_filtering=True,id=852ab20a-9a1b-47c5-b85e-52a44fff3e36,network=Network(ac2d700d-98d2-4459-8da8-a4858cda8864),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap852ab20a-9a') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:58:43 user nova-compute[73056]: DEBUG os_vif [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:95:fb,bridge_name='br-int',has_traffic_filtering=True,id=852ab20a-9a1b-47c5-b85e-52a44fff3e36,network=Network(ac2d700d-98d2-4459-8da8-a4858cda8864),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap852ab20a-9a') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 16:58:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:58:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 16:58:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap852ab20a-9a, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:58:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap852ab20a-9a, col_values=(('external_ids', {'iface-id': '852ab20a-9a1b-47c5-b85e-52a44fff3e36', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:95:fb', 'vm-uuid': 'fb1a193b-73b7-4690-8571-be9af04b3b14'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:58:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:58:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:43 user nova-compute[73056]: INFO os_vif [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:95:fb,bridge_name='br-int',has_traffic_filtering=True,id=852ab20a-9a1b-47c5-b85e-52a44fff3e36,network=Network(ac2d700d-98d2-4459-8da8-a4858cda8864),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap852ab20a-9a')
Aug 14 16:58:43 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 16:58:43 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] No VIF found with MAC fa:16:3e:32:95:fb, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 16:58:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:45 user nova-compute[73056]: DEBUG nova.compute.manager [req-6a7ba108-f9b5-45f1-be11-2ea3756aa536 req-cf68064c-3061-4ba3-92ef-b5f2de650820 service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Received event network-vif-plugged-852ab20a-9a1b-47c5-b85e-52a44fff3e36 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:58:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6a7ba108-f9b5-45f1-be11-2ea3756aa536 req-cf68064c-3061-4ba3-92ef-b5f2de650820 service nova] Acquiring lock "fb1a193b-73b7-4690-8571-be9af04b3b14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:58:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6a7ba108-f9b5-45f1-be11-2ea3756aa536 req-cf68064c-3061-4ba3-92ef-b5f2de650820 service nova] Lock "fb1a193b-73b7-4690-8571-be9af04b3b14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:58:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6a7ba108-f9b5-45f1-be11-2ea3756aa536 req-cf68064c-3061-4ba3-92ef-b5f2de650820 service nova] Lock "fb1a193b-73b7-4690-8571-be9af04b3b14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:58:45 user nova-compute[73056]: DEBUG nova.compute.manager [req-6a7ba108-f9b5-45f1-be11-2ea3756aa536 req-cf68064c-3061-4ba3-92ef-b5f2de650820 service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] No waiting events found dispatching network-vif-plugged-852ab20a-9a1b-47c5-b85e-52a44fff3e36 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:58:45 user nova-compute[73056]: WARNING nova.compute.manager [req-6a7ba108-f9b5-45f1-be11-2ea3756aa536 req-cf68064c-3061-4ba3-92ef-b5f2de650820 service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Received unexpected event network-vif-plugged-852ab20a-9a1b-47c5-b85e-52a44fff3e36 for instance with vm_state building and task_state spawning.
Aug 14 16:58:47 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692032327.3079216, fb1a193b-73b7-4690-8571-be9af04b3b14 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:58:47 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] VM Resumed (Lifecycle Event)
Aug 14 16:58:47 user nova-compute[73056]: DEBUG nova.compute.manager [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 16:58:47 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 16:58:47 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Instance spawned successfully.
Aug 14 16:58:47 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 16:58:47 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:58:47 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:58:47 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:58:47 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:58:47 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:58:47 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:58:47 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:58:47 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 16:58:47 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:58:47 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692032327.3120139, fb1a193b-73b7-4690-8571-be9af04b3b14 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:58:47 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] VM Started (Lifecycle Event)
Aug 14 16:58:47 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:58:47 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 16:58:47 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 16:58:47 user nova-compute[73056]: INFO nova.compute.manager [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Took 5.04 seconds to spawn the instance on the hypervisor.
Aug 14 16:58:47 user nova-compute[73056]: DEBUG nova.compute.manager [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:58:47 user nova-compute[73056]: INFO nova.compute.manager [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Took 20.08 seconds to build instance.
Aug 14 16:58:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-65d9fe5f-eba5-4907-8681-c49c2f7504fc tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "fb1a193b-73b7-4690-8571-be9af04b3b14" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.174s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:58:47 user nova-compute[73056]: DEBUG nova.compute.manager [req-fe62da8a-5de6-48d4-9695-72ef7e9ff657 req-00c5a853-614c-4397-bb9d-48c43d0b6416 service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Received event network-vif-plugged-852ab20a-9a1b-47c5-b85e-52a44fff3e36 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:58:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-fe62da8a-5de6-48d4-9695-72ef7e9ff657 req-00c5a853-614c-4397-bb9d-48c43d0b6416 service nova] Acquiring lock "fb1a193b-73b7-4690-8571-be9af04b3b14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:58:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-fe62da8a-5de6-48d4-9695-72ef7e9ff657 req-00c5a853-614c-4397-bb9d-48c43d0b6416 service nova] Lock "fb1a193b-73b7-4690-8571-be9af04b3b14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:58:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-fe62da8a-5de6-48d4-9695-72ef7e9ff657 req-00c5a853-614c-4397-bb9d-48c43d0b6416 service nova] Lock "fb1a193b-73b7-4690-8571-be9af04b3b14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:58:47 user nova-compute[73056]: DEBUG nova.compute.manager [req-fe62da8a-5de6-48d4-9695-72ef7e9ff657 req-00c5a853-614c-4397-bb9d-48c43d0b6416 service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] No waiting events found dispatching network-vif-plugged-852ab20a-9a1b-47c5-b85e-52a44fff3e36 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:58:47 user nova-compute[73056]: WARNING nova.compute.manager [req-fe62da8a-5de6-48d4-9695-72ef7e9ff657 req-00c5a853-614c-4397-bb9d-48c43d0b6416 service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Received unexpected event network-vif-plugged-852ab20a-9a1b-47c5-b85e-52a44fff3e36 for instance with vm_state active and task_state None.
Aug 14 16:58:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:49 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692032314.7216842, e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:58:49 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] VM Stopped (Lifecycle Event)
Aug 14 16:58:49 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5b6e14e0-8be8-4214-9382-c90221181ad8 None None] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:58:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:58:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:58:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:58:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 16:58:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 16:58:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 16:58:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:59:03 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:59:03 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 16:59:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:59:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:59:04 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:59:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-06e61f3f-5850-4ecf-8e07-d7f9f9d3f996 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:59:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-06e61f3f-5850-4ecf-8e07-d7f9f9d3f996 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:59:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-06e61f3f-5850-4ecf-8e07-d7f9f9d3f996 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:59:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-06e61f3f-5850-4ecf-8e07-d7f9f9d3f996 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:59:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-06e61f3f-5850-4ecf-8e07-d7f9f9d3f996 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:59:05 user nova-compute[73056]: INFO nova.compute.manager [None req-06e61f3f-5850-4ecf-8e07-d7f9f9d3f996 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Terminating instance
Aug 14 16:59:05 user nova-compute[73056]: DEBUG nova.compute.manager [None req-06e61f3f-5850-4ecf-8e07-d7f9f9d3f996 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 16:59:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:59:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:59:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:59:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:59:06 user nova-compute[73056]: DEBUG nova.compute.manager [req-5310def9-e4cb-400f-9d97-1945e3fe62b2 req-f6169027-c3a5-46ad-9307-c0e8a3932788 service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Received event network-vif-unplugged-c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:59:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-5310def9-e4cb-400f-9d97-1945e3fe62b2 req-f6169027-c3a5-46ad-9307-c0e8a3932788 service nova] Acquiring lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:59:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-5310def9-e4cb-400f-9d97-1945e3fe62b2 req-f6169027-c3a5-46ad-9307-c0e8a3932788 service nova] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:59:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-5310def9-e4cb-400f-9d97-1945e3fe62b2 req-f6169027-c3a5-46ad-9307-c0e8a3932788 service nova] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:59:06 user nova-compute[73056]: DEBUG nova.compute.manager [req-5310def9-e4cb-400f-9d97-1945e3fe62b2 req-f6169027-c3a5-46ad-9307-c0e8a3932788 service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] No waiting events found dispatching network-vif-unplugged-c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:59:06 user nova-compute[73056]: DEBUG nova.compute.manager [req-5310def9-e4cb-400f-9d97-1945e3fe62b2 req-f6169027-c3a5-46ad-9307-c0e8a3932788 service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Received event network-vif-unplugged-c9eb236b-5c65-4108-9527-dbf9550cf01f for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:59:06 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Instance destroyed successfully.
Aug 14 16:59:06 user nova-compute[73056]: DEBUG nova.objects.instance [None req-06e61f3f-5850-4ecf-8e07-d7f9f9d3f996 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lazy-loading 'resources' on Instance uuid 5914b70b-665a-4ce0-ab4e-11db2b8bc057 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:59:06 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-06e61f3f-5850-4ecf-8e07-d7f9f9d3f996 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:52:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1952339710',display_name='tempest-ServerRescueNegativeTestJSON-server-1952339710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1952339710',id=37,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAp0LikYCQHNfSYD4UvT4Zxh43XbzRmqoiU2ZnOfp1CYD0BrAg4r5J/RAcQQuADIA2Ho1aSstdK7xXiTXNXXMeOhkn7JZ7x8dywIzuMsJtJLPFvrAuj2FTi45iY+XI0yxg==',key_name='tempest-keypair-1806914521',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:54:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09b7b0f153a945ac9ce96fe462b17fd5',ramdisk_id='',reservation_id='r-7dv7kuyc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-201205905',owner_user_name='tempest-ServerRescueNegativeTestJSON-201205905-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:56:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9f89462f2734ec48d78921ab3d654b2',uuid=5914b70b-665a-4ce0-ab4e-11db2b8bc057,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9eb236b-5c65-4108-9527-dbf9550cf01f", "address": "fa:16:3e:af:d2:e8", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9eb236b-5c", "ovs_interfaceid": "c9eb236b-5c65-4108-9527-dbf9550cf01f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:59:06 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-06e61f3f-5850-4ecf-8e07-d7f9f9d3f996 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Converting VIF {"id": "c9eb236b-5c65-4108-9527-dbf9550cf01f", "address": "fa:16:3e:af:d2:e8", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9eb236b-5c", "ovs_interfaceid": "c9eb236b-5c65-4108-9527-dbf9550cf01f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:59:06 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-06e61f3f-5850-4ecf-8e07-d7f9f9d3f996 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:d2:e8,bridge_name='br-int',has_traffic_filtering=True,id=c9eb236b-5c65-4108-9527-dbf9550cf01f,network=Network(9f4305e9-4b75-4f5d-b1b2-f1184c408739),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9eb236b-5c') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:59:06 user nova-compute[73056]: DEBUG os_vif [None req-06e61f3f-5850-4ecf-8e07-d7f9f9d3f996 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:d2:e8,bridge_name='br-int',has_traffic_filtering=True,id=c9eb236b-5c65-4108-9527-dbf9550cf01f,network=Network(9f4305e9-4b75-4f5d-b1b2-f1184c408739),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9eb236b-5c') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:59:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:59:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9eb236b-5c, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:59:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:59:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:59:06 user nova-compute[73056]: INFO os_vif [None req-06e61f3f-5850-4ecf-8e07-d7f9f9d3f996 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:d2:e8,bridge_name='br-int',has_traffic_filtering=True,id=c9eb236b-5c65-4108-9527-dbf9550cf01f,network=Network(9f4305e9-4b75-4f5d-b1b2-f1184c408739),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9eb236b-5c')
Aug 14 16:59:06 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-06e61f3f-5850-4ecf-8e07-d7f9f9d3f996 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Deleting instance files /opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057_del
Aug 14 16:59:06 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-06e61f3f-5850-4ecf-8e07-d7f9f9d3f996 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Deletion of /opt/stack/data/nova/instances/5914b70b-665a-4ce0-ab4e-11db2b8bc057_del complete
Aug 14 16:59:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:59:06 user nova-compute[73056]: INFO nova.compute.manager [None req-06e61f3f-5850-4ecf-8e07-d7f9f9d3f996 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 14 16:59:06 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-06e61f3f-5850-4ecf-8e07-d7f9f9d3f996 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 16:59:06 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 16:59:06 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 16:59:07 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:59:07 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Took 0.96 seconds to deallocate network for instance.
Aug 14 16:59:07 user nova-compute[73056]: DEBUG nova.compute.manager [req-6603dbdf-3001-4569-b69b-af607fb3be1d req-7d20e48a-6a80-4b34-97e3-f142b118192d service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Received event network-vif-deleted-c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:59:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-06e61f3f-5850-4ecf-8e07-d7f9f9d3f996 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:59:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-06e61f3f-5850-4ecf-8e07-d7f9f9d3f996 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:59:07 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-06e61f3f-5850-4ecf-8e07-d7f9f9d3f996 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:59:07 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-06e61f3f-5850-4ecf-8e07-d7f9f9d3f996 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:59:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-06e61f3f-5850-4ecf-8e07-d7f9f9d3f996 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.266s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:59:07 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-06e61f3f-5850-4ecf-8e07-d7f9f9d3f996 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Deleted allocations for instance 5914b70b-665a-4ce0-ab4e-11db2b8bc057
Aug 14 16:59:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-06e61f3f-5850-4ecf-8e07-d7f9f9d3f996 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.247s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:59:08 user nova-compute[73056]: DEBUG nova.compute.manager [req-3fa441a7-c698-43ca-98cf-f890295b5035 req-77635b62-06e1-4e27-b166-8354e2e23e03 service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Received event network-vif-plugged-c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:59:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3fa441a7-c698-43ca-98cf-f890295b5035 req-77635b62-06e1-4e27-b166-8354e2e23e03 service nova] Acquiring lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:59:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3fa441a7-c698-43ca-98cf-f890295b5035 req-77635b62-06e1-4e27-b166-8354e2e23e03 service nova] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:59:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3fa441a7-c698-43ca-98cf-f890295b5035 req-77635b62-06e1-4e27-b166-8354e2e23e03 service nova] Lock "5914b70b-665a-4ce0-ab4e-11db2b8bc057-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:59:08 user nova-compute[73056]: DEBUG nova.compute.manager [req-3fa441a7-c698-43ca-98cf-f890295b5035 req-77635b62-06e1-4e27-b166-8354e2e23e03 service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] No waiting events found dispatching network-vif-plugged-c9eb236b-5c65-4108-9527-dbf9550cf01f {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:59:08 user nova-compute[73056]: WARNING nova.compute.manager [req-3fa441a7-c698-43ca-98cf-f890295b5035 req-77635b62-06e1-4e27-b166-8354e2e23e03 service nova] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Received unexpected event network-vif-plugged-c9eb236b-5c65-4108-9527-dbf9550cf01f for instance with vm_state deleted and task_state None.
Aug 14 16:59:09 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:59:09 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:59:09 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 16:59:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-6c9ce215-9006-468d-998d-a18df5bf4222" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:59:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-6c9ce215-9006-468d-998d-a18df5bf4222" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:59:09 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 16:59:09 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Updating instance_info_cache with network_info: [{"id": "09f698e2-41d7-4329-92b1-9a80dc461259", "address": "fa:16:3e:dc:48:7c", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f698e2-41", "ovs_interfaceid": "09f698e2-41d7-4329-92b1-9a80dc461259", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:59:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-6c9ce215-9006-468d-998d-a18df5bf4222" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:59:09 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 16:59:11 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:59:11 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:59:11 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:59:13 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:59:13 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:59:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:59:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:59:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:59:13 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 16:59:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:59:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:59:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:59:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:59:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:59:13 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:59:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:59:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:59:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:59:14 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:59:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:59:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:59:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:59:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:59:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:59:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:59:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:59:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:59:15 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 16:59:15 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:59:15 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:59:15 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=8229MB free_disk=25.246044158935547GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 16:59:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:59:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:59:15 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance b580e3d0-88b5-42a3-a953-84b94c088f41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:59:15 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 92c34cf0-fd39-49fc-9244-4da8ccae6eec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:59:15 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 6c9ce215-9006-468d-998d-a18df5bf4222 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:59:15 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 5191b082-a6f3-467c-b28b-fda85e15f330 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:59:15 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance a8757bd2-d48f-4fde-93be-1f32f25dee8a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:59:15 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance fb1a193b-73b7-4690-8571-be9af04b3b14 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 16:59:15 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 16:59:15 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 16:59:15 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:59:15 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:59:15 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 16:59:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.338s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:59:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:59:16 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:59:21 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692032346.3858485, 5914b70b-665a-4ce0-ab4e-11db2b8bc057 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:59:21 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] VM Stopped (Lifecycle Event)
Aug 14 16:59:21 user nova-compute[73056]: DEBUG nova.compute.manager [None req-1da4690f-68cf-4903-b4c9-bdc7820d6d6d None None] [instance: 5914b70b-665a-4ce0-ab4e-11db2b8bc057] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:59:21 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:59:26 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:59:31 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:59:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:59:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:59:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:59:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:59:46 user nova-compute[73056]: DEBUG nova.compute.manager [req-069bc905-ce61-4d4d-a61d-dad98456b73e req-fae21523-6538-40a5-8a31-9d55eb364570 service nova] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Received event network-changed-91e720d2-bdc5-4f49-93ab-2384a12ae22a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:59:46 user nova-compute[73056]: DEBUG nova.compute.manager [req-069bc905-ce61-4d4d-a61d-dad98456b73e req-fae21523-6538-40a5-8a31-9d55eb364570 service nova] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Refreshing instance network info cache due to event network-changed-91e720d2-bdc5-4f49-93ab-2384a12ae22a. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:59:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-069bc905-ce61-4d4d-a61d-dad98456b73e req-fae21523-6538-40a5-8a31-9d55eb364570 service nova] Acquiring lock "refresh_cache-a8757bd2-d48f-4fde-93be-1f32f25dee8a" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:59:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-069bc905-ce61-4d4d-a61d-dad98456b73e req-fae21523-6538-40a5-8a31-9d55eb364570 service nova] Acquired lock "refresh_cache-a8757bd2-d48f-4fde-93be-1f32f25dee8a" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:59:46 user nova-compute[73056]: DEBUG nova.network.neutron [req-069bc905-ce61-4d4d-a61d-dad98456b73e req-fae21523-6538-40a5-8a31-9d55eb364570 service nova] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Refreshing network info cache for port 91e720d2-bdc5-4f49-93ab-2384a12ae22a {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:59:47 user nova-compute[73056]: DEBUG nova.network.neutron [req-069bc905-ce61-4d4d-a61d-dad98456b73e req-fae21523-6538-40a5-8a31-9d55eb364570 service nova] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Updated VIF entry in instance network info cache for port 91e720d2-bdc5-4f49-93ab-2384a12ae22a. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:59:47 user nova-compute[73056]: DEBUG nova.network.neutron [req-069bc905-ce61-4d4d-a61d-dad98456b73e req-fae21523-6538-40a5-8a31-9d55eb364570 service nova] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Updating instance_info_cache with network_info: [{"id": "91e720d2-bdc5-4f49-93ab-2384a12ae22a", "address": "fa:16:3e:f0:e9:20", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e720d2-bd", "ovs_interfaceid": "91e720d2-bdc5-4f49-93ab-2384a12ae22a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:59:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-069bc905-ce61-4d4d-a61d-dad98456b73e req-fae21523-6538-40a5-8a31-9d55eb364570 service nova] Releasing lock "refresh_cache-a8757bd2-d48f-4fde-93be-1f32f25dee8a" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:59:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:59:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "a8757bd2-d48f-4fde-93be-1f32f25dee8a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:59:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "a8757bd2-d48f-4fde-93be-1f32f25dee8a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:59:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "a8757bd2-d48f-4fde-93be-1f32f25dee8a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:59:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "a8757bd2-d48f-4fde-93be-1f32f25dee8a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:59:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "a8757bd2-d48f-4fde-93be-1f32f25dee8a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:59:48 user nova-compute[73056]: INFO nova.compute.manager [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Terminating instance
Aug 14 16:59:48 user nova-compute[73056]: DEBUG nova.compute.manager [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 16:59:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:59:48 user nova-compute[73056]: DEBUG nova.compute.manager [req-5a724fa1-392b-43ae-a4d8-4224802debfe req-5b4ca1dc-6496-46c0-8076-3ad7f4183dde service nova] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Received event network-changed-91e720d2-bdc5-4f49-93ab-2384a12ae22a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:59:48 user nova-compute[73056]: DEBUG nova.compute.manager [req-5a724fa1-392b-43ae-a4d8-4224802debfe req-5b4ca1dc-6496-46c0-8076-3ad7f4183dde service nova] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Refreshing instance network info cache due to event network-changed-91e720d2-bdc5-4f49-93ab-2384a12ae22a. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:59:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-5a724fa1-392b-43ae-a4d8-4224802debfe req-5b4ca1dc-6496-46c0-8076-3ad7f4183dde service nova] Acquiring lock "refresh_cache-a8757bd2-d48f-4fde-93be-1f32f25dee8a" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:59:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-5a724fa1-392b-43ae-a4d8-4224802debfe req-5b4ca1dc-6496-46c0-8076-3ad7f4183dde service nova] Acquired lock "refresh_cache-a8757bd2-d48f-4fde-93be-1f32f25dee8a" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:59:48 user nova-compute[73056]: DEBUG nova.network.neutron [req-5a724fa1-392b-43ae-a4d8-4224802debfe req-5b4ca1dc-6496-46c0-8076-3ad7f4183dde service nova] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Refreshing network info cache for port 91e720d2-bdc5-4f49-93ab-2384a12ae22a {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:59:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:59:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:59:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG nova.network.neutron [req-5a724fa1-392b-43ae-a4d8-4224802debfe req-5b4ca1dc-6496-46c0-8076-3ad7f4183dde service nova] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Updated VIF entry in instance network info cache for port 91e720d2-bdc5-4f49-93ab-2384a12ae22a. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG nova.network.neutron [req-5a724fa1-392b-43ae-a4d8-4224802debfe req-5b4ca1dc-6496-46c0-8076-3ad7f4183dde service nova] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Updating instance_info_cache with network_info: [{"id": "91e720d2-bdc5-4f49-93ab-2384a12ae22a", "address": "fa:16:3e:f0:e9:20", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e720d2-bd", "ovs_interfaceid": "91e720d2-bdc5-4f49-93ab-2384a12ae22a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:59:49 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Instance destroyed successfully.
Aug 14 16:59:49 user nova-compute[73056]: DEBUG nova.objects.instance [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lazy-loading 'resources' on Instance uuid a8757bd2-d48f-4fde-93be-1f32f25dee8a {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-712496658',display_name='tempest-TestVolumeBootPattern-server-712496658',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-712496658',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBF9UVFrNwhQEMB/CeZfBoQaAoJOYsqM67ncFaZmWIdIzJd1Na96dOaZXAGstQENK3pBtGzJ44fKFGGhrlwWzWMk9Hm8I+KfAGKsRBWs7QP0LhARS9gNshqYVaA6cOdig==',key_name='tempest-TestVolumeBootPattern-829376797',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:58:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cffb5203b9284500b8add8a6586cad49',ramdisk_id='',reservation_id='r-h0iqmuh9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1676214558',owner_user_name='tempest-TestVolumeBootPattern-1676214558-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:58:10Z,user_data=None,user_id='2be1b098ca9f4232bd198b515630f6ad',uuid=a8757bd2-d48f-4fde-93be-1f32f25dee8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91e720d2-bdc5-4f49-93ab-2384a12ae22a", "address": "fa:16:3e:f0:e9:20", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e720d2-bd", "ovs_interfaceid": "91e720d2-bdc5-4f49-93ab-2384a12ae22a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Converting VIF {"id": "91e720d2-bdc5-4f49-93ab-2384a12ae22a", "address": "fa:16:3e:f0:e9:20", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e720d2-bd", "ovs_interfaceid": "91e720d2-bdc5-4f49-93ab-2384a12ae22a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:e9:20,bridge_name='br-int',has_traffic_filtering=True,id=91e720d2-bdc5-4f49-93ab-2384a12ae22a,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91e720d2-bd') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG os_vif [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:e9:20,bridge_name='br-int',has_traffic_filtering=True,id=91e720d2-bdc5-4f49-93ab-2384a12ae22a,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91e720d2-bd') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91e720d2-bd, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:59:49 user nova-compute[73056]: INFO os_vif [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:e9:20,bridge_name='br-int',has_traffic_filtering=True,id=91e720d2-bdc5-4f49-93ab-2384a12ae22a,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91e720d2-bd')
Aug 14 16:59:49 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NcGdmwej', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:59:49 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:59:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d0a223-9564-412a-adb5-3c6c02c7d9a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2015e98-9ebd-41de-85f4-db2d7235830f]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:59:49 user nova-compute[73056]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446 (non-flash)
Aug 14 16:59:49 user nova-compute[73056]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 16:59:49 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 16:59:49 user nova-compute[73056]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446 (non-flash)
Aug 14 16:59:49 user nova-compute[73056]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 16:59:49 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3002012d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446'): ({'sdb'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Removing single pathed devices sdb {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-5a724fa1-392b-43ae-a4d8-4224802debfe req-5b4ca1dc-6496-46c0-8076-3ad7f4183dde service nova] Releasing lock "refresh_cache-a8757bd2-d48f-4fde-93be-1f32f25dee8a" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38b9c9c-8417-4392-bf17-58061bd43587]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d21322-5349-466f-a161-a356359baf6a]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Flushing IO for device /dev/sdb {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80d851d-e6a2-4667-a441-02472d13798d]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e27495c-4837-4c94-947c-830bf29b2e34]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] SCSI volumes sdb have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_1f408b95', '/dev/disk/by-id/scsi-1SCST_BIO1f408b95-afc4b3a59e49f697', '/dev/disk/by-id/scsi-26166633462336135') {{(pid=83519) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84f3877-b099-4450-a5c1-64d97e149bd9]: (4, None) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[97770196-ced9-49bf-9792-744bcb49da6b]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446 -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed04f41-c046-4bf4-8ead-63dedec28b40]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446, portal: 172.16.0.220,3260]
Aug 14 16:59:49 user nova-compute[73056]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446, portal: 172.16.0.220,3260] successful.
Aug 14 16:59:49 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446 -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57f885a0-24ca-4f5f-97f8-4d543ea30446 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[559c9c6c-858a-4f02-86eb-acb2427fece2]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] <== disconnect_volume: return (296ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:59:49 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Deleting instance files /opt/stack/data/nova/instances/a8757bd2-d48f-4fde-93be-1f32f25dee8a_del
Aug 14 16:59:49 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Deletion of /opt/stack/data/nova/instances/a8757bd2-d48f-4fde-93be-1f32f25dee8a_del complete
Aug 14 16:59:49 user nova-compute[73056]: INFO nova.compute.manager [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 14 16:59:49 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 16:59:49 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 16:59:50 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:59:50 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Took 0.82 seconds to deallocate network for instance.
Aug 14 16:59:50 user nova-compute[73056]: DEBUG nova.compute.manager [req-956511fd-074a-4e66-b43f-f8dc28e8b332 req-c7a45f6d-7e2e-4b8d-b758-d5100253a0d6 service nova] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Received event network-vif-unplugged-91e720d2-bdc5-4f49-93ab-2384a12ae22a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:59:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-956511fd-074a-4e66-b43f-f8dc28e8b332 req-c7a45f6d-7e2e-4b8d-b758-d5100253a0d6 service nova] Acquiring lock "a8757bd2-d48f-4fde-93be-1f32f25dee8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:59:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-956511fd-074a-4e66-b43f-f8dc28e8b332 req-c7a45f6d-7e2e-4b8d-b758-d5100253a0d6 service nova] Lock "a8757bd2-d48f-4fde-93be-1f32f25dee8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:59:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-956511fd-074a-4e66-b43f-f8dc28e8b332 req-c7a45f6d-7e2e-4b8d-b758-d5100253a0d6 service nova] Lock "a8757bd2-d48f-4fde-93be-1f32f25dee8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:59:50 user nova-compute[73056]: DEBUG nova.compute.manager [req-956511fd-074a-4e66-b43f-f8dc28e8b332 req-c7a45f6d-7e2e-4b8d-b758-d5100253a0d6 service nova] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] No waiting events found dispatching network-vif-unplugged-91e720d2-bdc5-4f49-93ab-2384a12ae22a {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:59:50 user nova-compute[73056]: DEBUG nova.compute.manager [req-956511fd-074a-4e66-b43f-f8dc28e8b332 req-c7a45f6d-7e2e-4b8d-b758-d5100253a0d6 service nova] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Received event network-vif-unplugged-91e720d2-bdc5-4f49-93ab-2384a12ae22a for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:59:50 user nova-compute[73056]: DEBUG nova.compute.manager [req-956511fd-074a-4e66-b43f-f8dc28e8b332 req-c7a45f6d-7e2e-4b8d-b758-d5100253a0d6 service nova] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Received event network-vif-plugged-91e720d2-bdc5-4f49-93ab-2384a12ae22a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:59:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-956511fd-074a-4e66-b43f-f8dc28e8b332 req-c7a45f6d-7e2e-4b8d-b758-d5100253a0d6 service nova] Acquiring lock "a8757bd2-d48f-4fde-93be-1f32f25dee8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:59:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-956511fd-074a-4e66-b43f-f8dc28e8b332 req-c7a45f6d-7e2e-4b8d-b758-d5100253a0d6 service nova] Lock "a8757bd2-d48f-4fde-93be-1f32f25dee8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:59:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-956511fd-074a-4e66-b43f-f8dc28e8b332 req-c7a45f6d-7e2e-4b8d-b758-d5100253a0d6 service nova] Lock "a8757bd2-d48f-4fde-93be-1f32f25dee8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:59:50 user nova-compute[73056]: DEBUG nova.compute.manager [req-956511fd-074a-4e66-b43f-f8dc28e8b332 req-c7a45f6d-7e2e-4b8d-b758-d5100253a0d6 service nova] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] No waiting events found dispatching network-vif-plugged-91e720d2-bdc5-4f49-93ab-2384a12ae22a {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:59:50 user nova-compute[73056]: WARNING nova.compute.manager [req-956511fd-074a-4e66-b43f-f8dc28e8b332 req-c7a45f6d-7e2e-4b8d-b758-d5100253a0d6 service nova] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Received unexpected event network-vif-plugged-91e720d2-bdc5-4f49-93ab-2384a12ae22a for instance with vm_state active and task_state deleting.
Aug 14 16:59:50 user nova-compute[73056]: DEBUG nova.compute.manager [req-956511fd-074a-4e66-b43f-f8dc28e8b332 req-c7a45f6d-7e2e-4b8d-b758-d5100253a0d6 service nova] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Received event network-vif-deleted-91e720d2-bdc5-4f49-93ab-2384a12ae22a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:59:51 user nova-compute[73056]: INFO nova.compute.manager [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Took 0.81 seconds to detach 1 volumes for instance.
Aug 14 16:59:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:59:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:59:51 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:59:51 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:59:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.220s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:59:51 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Deleted allocations for instance a8757bd2-d48f-4fde-93be-1f32f25dee8a
Aug 14 16:59:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0b23814d-eb9f-48d8-ba6b-d60d365598d4 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "a8757bd2-d48f-4fde-93be-1f32f25dee8a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.200s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:59:54 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:59:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:04 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:00:04 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:00:04 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 17:00:04 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692032389.3802853, a8757bd2-d48f-4fde-93be-1f32f25dee8a => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:00:04 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] VM Stopped (Lifecycle Event)
Aug 14 17:00:04 user nova-compute[73056]: DEBUG nova.compute.manager [None req-31080f7d-ef1c-454a-be42-c7594b06ef63 None None] [instance: a8757bd2-d48f-4fde-93be-1f32f25dee8a] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:00:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c9b808a6-efec-4a56-a1d9-9f379ac7c805 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:00:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c9b808a6-efec-4a56-a1d9-9f379ac7c805 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:00:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c9b808a6-efec-4a56-a1d9-9f379ac7c805 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:00:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c9b808a6-efec-4a56-a1d9-9f379ac7c805 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:00:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c9b808a6-efec-4a56-a1d9-9f379ac7c805 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:00:08 user nova-compute[73056]: INFO nova.compute.manager [None req-c9b808a6-efec-4a56-a1d9-9f379ac7c805 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Terminating instance
Aug 14 17:00:08 user nova-compute[73056]: DEBUG nova.compute.manager [None req-c9b808a6-efec-4a56-a1d9-9f379ac7c805 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 17:00:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:09 user nova-compute[73056]: DEBUG nova.compute.manager [req-2c4b9705-6214-4889-a51f-4fbd20679cb1 req-e0f4ee07-2d3e-4bc7-bac5-e6a6f902ee5d service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Received event network-vif-unplugged-2a57f016-2b33-46f4-a885-51c4ac8658bb {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:00:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2c4b9705-6214-4889-a51f-4fbd20679cb1 req-e0f4ee07-2d3e-4bc7-bac5-e6a6f902ee5d service nova] Acquiring lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:00:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2c4b9705-6214-4889-a51f-4fbd20679cb1 req-e0f4ee07-2d3e-4bc7-bac5-e6a6f902ee5d service nova] Lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:00:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2c4b9705-6214-4889-a51f-4fbd20679cb1 req-e0f4ee07-2d3e-4bc7-bac5-e6a6f902ee5d service nova] Lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:00:09 user nova-compute[73056]: DEBUG nova.compute.manager [req-2c4b9705-6214-4889-a51f-4fbd20679cb1 req-e0f4ee07-2d3e-4bc7-bac5-e6a6f902ee5d service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] No waiting events found dispatching network-vif-unplugged-2a57f016-2b33-46f4-a885-51c4ac8658bb {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:00:09 user nova-compute[73056]: DEBUG nova.compute.manager [req-2c4b9705-6214-4889-a51f-4fbd20679cb1 req-e0f4ee07-2d3e-4bc7-bac5-e6a6f902ee5d service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Received event network-vif-unplugged-2a57f016-2b33-46f4-a885-51c4ac8658bb for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 17:00:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:09 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:00:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:09 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Instance destroyed successfully.
Aug 14 17:00:09 user nova-compute[73056]: DEBUG nova.objects.instance [None req-c9b808a6-efec-4a56-a1d9-9f379ac7c805 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lazy-loading 'resources' on Instance uuid 92c34cf0-fd39-49fc-9244-4da8ccae6eec {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:00:09 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-c9b808a6-efec-4a56-a1d9-9f379ac7c805 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:43:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1644142487',display_name='tempest-ServerRescueNegativeTestJSON-server-1644142487',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1644142487',id=23,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:45:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09b7b0f153a945ac9ce96fe462b17fd5',ramdisk_id='',reservation_id='r-sdr5vmlk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-201205905',owner_user_name='tempest-ServerRescueNegativeTestJSON-201205905-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:45:50Z,user_data=None,user_id='e9f89462f2734ec48d78921ab3d654b2',uuid=92c34cf0-fd39-49fc-9244-4da8ccae6eec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "2a57f016-2b33-46f4-a885-51c4ac8658bb", "address": "fa:16:3e:11:b2:3a", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a57f016-2b", "ovs_interfaceid": "2a57f016-2b33-46f4-a885-51c4ac8658bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 17:00:09 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-c9b808a6-efec-4a56-a1d9-9f379ac7c805 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Converting VIF {"id": "2a57f016-2b33-46f4-a885-51c4ac8658bb", "address": "fa:16:3e:11:b2:3a", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a57f016-2b", "ovs_interfaceid": "2a57f016-2b33-46f4-a885-51c4ac8658bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:00:09 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-c9b808a6-efec-4a56-a1d9-9f379ac7c805 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:b2:3a,bridge_name='br-int',has_traffic_filtering=True,id=2a57f016-2b33-46f4-a885-51c4ac8658bb,network=Network(9f4305e9-4b75-4f5d-b1b2-f1184c408739),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a57f016-2b') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:00:09 user nova-compute[73056]: DEBUG os_vif [None req-c9b808a6-efec-4a56-a1d9-9f379ac7c805 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:b2:3a,bridge_name='br-int',has_traffic_filtering=True,id=2a57f016-2b33-46f4-a885-51c4ac8658bb,network=Network(9f4305e9-4b75-4f5d-b1b2-f1184c408739),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a57f016-2b') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 17:00:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a57f016-2b, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:00:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:00:09 user nova-compute[73056]: INFO os_vif [None req-c9b808a6-efec-4a56-a1d9-9f379ac7c805 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:b2:3a,bridge_name='br-int',has_traffic_filtering=True,id=2a57f016-2b33-46f4-a885-51c4ac8658bb,network=Network(9f4305e9-4b75-4f5d-b1b2-f1184c408739),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a57f016-2b')
Aug 14 17:00:09 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-c9b808a6-efec-4a56-a1d9-9f379ac7c805 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Deleting instance files /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec_del
Aug 14 17:00:09 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-c9b808a6-efec-4a56-a1d9-9f379ac7c805 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Deletion of /opt/stack/data/nova/instances/92c34cf0-fd39-49fc-9244-4da8ccae6eec_del complete
Aug 14 17:00:09 user nova-compute[73056]: INFO nova.compute.manager [None req-c9b808a6-efec-4a56-a1d9-9f379ac7c805 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 14 17:00:09 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-c9b808a6-efec-4a56-a1d9-9f379ac7c805 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 17:00:09 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 17:00:09 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 17:00:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:10 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:00:10 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Took 0.68 seconds to deallocate network for instance.
Aug 14 17:00:10 user nova-compute[73056]: DEBUG nova.compute.manager [req-db1af46e-5d91-4fc5-9ac4-a38749cfb0dd req-4210ead8-5dfd-44ac-8332-d743cab284a2 service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Received event network-vif-deleted-2a57f016-2b33-46f4-a885-51c4ac8658bb {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:00:10 user nova-compute[73056]: INFO nova.compute.manager [req-db1af46e-5d91-4fc5-9ac4-a38749cfb0dd req-4210ead8-5dfd-44ac-8332-d743cab284a2 service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Neutron deleted interface 2a57f016-2b33-46f4-a885-51c4ac8658bb; detaching it from the instance and deleting it from the info cache
Aug 14 17:00:10 user nova-compute[73056]: DEBUG nova.network.neutron [req-db1af46e-5d91-4fc5-9ac4-a38749cfb0dd req-4210ead8-5dfd-44ac-8332-d743cab284a2 service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:00:10 user nova-compute[73056]: DEBUG nova.compute.manager [req-db1af46e-5d91-4fc5-9ac4-a38749cfb0dd req-4210ead8-5dfd-44ac-8332-d743cab284a2 service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Detach interface failed, port_id=2a57f016-2b33-46f4-a885-51c4ac8658bb, reason: Instance 92c34cf0-fd39-49fc-9244-4da8ccae6eec could not be found. {{(pid=73056) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 17:00:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c9b808a6-efec-4a56-a1d9-9f379ac7c805 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:00:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c9b808a6-efec-4a56-a1d9-9f379ac7c805 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:00:10 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-c9b808a6-efec-4a56-a1d9-9f379ac7c805 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:00:10 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-c9b808a6-efec-4a56-a1d9-9f379ac7c805 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:00:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c9b808a6-efec-4a56-a1d9-9f379ac7c805 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.214s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:00:10 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-c9b808a6-efec-4a56-a1d9-9f379ac7c805 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Deleted allocations for instance 92c34cf0-fd39-49fc-9244-4da8ccae6eec
Aug 14 17:00:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c9b808a6-efec-4a56-a1d9-9f379ac7c805 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.961s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:00:11 user nova-compute[73056]: DEBUG nova.compute.manager [req-2829fbd3-fbbd-4788-9069-937bec64bf33 req-104b9f5e-ab76-4c2e-a55b-70e9794bc678 service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Received event network-vif-plugged-2a57f016-2b33-46f4-a885-51c4ac8658bb {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:00:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2829fbd3-fbbd-4788-9069-937bec64bf33 req-104b9f5e-ab76-4c2e-a55b-70e9794bc678 service nova] Acquiring lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:00:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2829fbd3-fbbd-4788-9069-937bec64bf33 req-104b9f5e-ab76-4c2e-a55b-70e9794bc678 service nova] Lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:00:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2829fbd3-fbbd-4788-9069-937bec64bf33 req-104b9f5e-ab76-4c2e-a55b-70e9794bc678 service nova] Lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:00:11 user nova-compute[73056]: DEBUG nova.compute.manager [req-2829fbd3-fbbd-4788-9069-937bec64bf33 req-104b9f5e-ab76-4c2e-a55b-70e9794bc678 service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] No waiting events found dispatching network-vif-plugged-2a57f016-2b33-46f4-a885-51c4ac8658bb {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:00:11 user nova-compute[73056]: WARNING nova.compute.manager [req-2829fbd3-fbbd-4788-9069-937bec64bf33 req-104b9f5e-ab76-4c2e-a55b-70e9794bc678 service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Received unexpected event network-vif-plugged-2a57f016-2b33-46f4-a885-51c4ac8658bb for instance with vm_state deleted and task_state None.
Aug 14 17:00:11 user nova-compute[73056]: DEBUG nova.compute.manager [req-2829fbd3-fbbd-4788-9069-937bec64bf33 req-104b9f5e-ab76-4c2e-a55b-70e9794bc678 service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Received event network-vif-plugged-2a57f016-2b33-46f4-a885-51c4ac8658bb {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:00:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2829fbd3-fbbd-4788-9069-937bec64bf33 req-104b9f5e-ab76-4c2e-a55b-70e9794bc678 service nova] Acquiring lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:00:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2829fbd3-fbbd-4788-9069-937bec64bf33 req-104b9f5e-ab76-4c2e-a55b-70e9794bc678 service nova] Lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:00:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2829fbd3-fbbd-4788-9069-937bec64bf33 req-104b9f5e-ab76-4c2e-a55b-70e9794bc678 service nova] Lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:00:11 user nova-compute[73056]: DEBUG nova.compute.manager [req-2829fbd3-fbbd-4788-9069-937bec64bf33 req-104b9f5e-ab76-4c2e-a55b-70e9794bc678 service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] No waiting events found dispatching network-vif-plugged-2a57f016-2b33-46f4-a885-51c4ac8658bb {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:00:11 user nova-compute[73056]: WARNING nova.compute.manager [req-2829fbd3-fbbd-4788-9069-937bec64bf33 req-104b9f5e-ab76-4c2e-a55b-70e9794bc678 service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Received unexpected event network-vif-plugged-2a57f016-2b33-46f4-a885-51c4ac8658bb for instance with vm_state deleted and task_state None.
Aug 14 17:00:11 user nova-compute[73056]: DEBUG nova.compute.manager [req-2829fbd3-fbbd-4788-9069-937bec64bf33 req-104b9f5e-ab76-4c2e-a55b-70e9794bc678 service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Received event network-vif-plugged-2a57f016-2b33-46f4-a885-51c4ac8658bb {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:00:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2829fbd3-fbbd-4788-9069-937bec64bf33 req-104b9f5e-ab76-4c2e-a55b-70e9794bc678 service nova] Acquiring lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:00:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2829fbd3-fbbd-4788-9069-937bec64bf33 req-104b9f5e-ab76-4c2e-a55b-70e9794bc678 service nova] Lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:00:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2829fbd3-fbbd-4788-9069-937bec64bf33 req-104b9f5e-ab76-4c2e-a55b-70e9794bc678 service nova] Lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:00:11 user nova-compute[73056]: DEBUG nova.compute.manager [req-2829fbd3-fbbd-4788-9069-937bec64bf33 req-104b9f5e-ab76-4c2e-a55b-70e9794bc678 service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] No waiting events found dispatching network-vif-plugged-2a57f016-2b33-46f4-a885-51c4ac8658bb {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:00:11 user nova-compute[73056]: WARNING nova.compute.manager [req-2829fbd3-fbbd-4788-9069-937bec64bf33 req-104b9f5e-ab76-4c2e-a55b-70e9794bc678 service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Received unexpected event network-vif-plugged-2a57f016-2b33-46f4-a885-51c4ac8658bb for instance with vm_state deleted and task_state None.
Aug 14 17:00:11 user nova-compute[73056]: DEBUG nova.compute.manager [req-2829fbd3-fbbd-4788-9069-937bec64bf33 req-104b9f5e-ab76-4c2e-a55b-70e9794bc678 service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Received event network-vif-unplugged-2a57f016-2b33-46f4-a885-51c4ac8658bb {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:00:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2829fbd3-fbbd-4788-9069-937bec64bf33 req-104b9f5e-ab76-4c2e-a55b-70e9794bc678 service nova] Acquiring lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:00:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2829fbd3-fbbd-4788-9069-937bec64bf33 req-104b9f5e-ab76-4c2e-a55b-70e9794bc678 service nova] Lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:00:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2829fbd3-fbbd-4788-9069-937bec64bf33 req-104b9f5e-ab76-4c2e-a55b-70e9794bc678 service nova] Lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:00:11 user nova-compute[73056]: DEBUG nova.compute.manager [req-2829fbd3-fbbd-4788-9069-937bec64bf33 req-104b9f5e-ab76-4c2e-a55b-70e9794bc678 service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] No waiting events found dispatching network-vif-unplugged-2a57f016-2b33-46f4-a885-51c4ac8658bb {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:00:11 user nova-compute[73056]: WARNING nova.compute.manager [req-2829fbd3-fbbd-4788-9069-937bec64bf33 req-104b9f5e-ab76-4c2e-a55b-70e9794bc678 service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Received unexpected event network-vif-unplugged-2a57f016-2b33-46f4-a885-51c4ac8658bb for instance with vm_state deleted and task_state None.
Aug 14 17:00:11 user nova-compute[73056]: DEBUG nova.compute.manager [req-2829fbd3-fbbd-4788-9069-937bec64bf33 req-104b9f5e-ab76-4c2e-a55b-70e9794bc678 service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Received event network-vif-plugged-2a57f016-2b33-46f4-a885-51c4ac8658bb {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:00:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2829fbd3-fbbd-4788-9069-937bec64bf33 req-104b9f5e-ab76-4c2e-a55b-70e9794bc678 service nova] Acquiring lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:00:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2829fbd3-fbbd-4788-9069-937bec64bf33 req-104b9f5e-ab76-4c2e-a55b-70e9794bc678 service nova] Lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:00:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2829fbd3-fbbd-4788-9069-937bec64bf33 req-104b9f5e-ab76-4c2e-a55b-70e9794bc678 service nova] Lock "92c34cf0-fd39-49fc-9244-4da8ccae6eec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:00:11 user nova-compute[73056]: DEBUG nova.compute.manager [req-2829fbd3-fbbd-4788-9069-937bec64bf33 req-104b9f5e-ab76-4c2e-a55b-70e9794bc678 service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] No waiting events found dispatching network-vif-plugged-2a57f016-2b33-46f4-a885-51c4ac8658bb {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:00:11 user nova-compute[73056]: WARNING nova.compute.manager [req-2829fbd3-fbbd-4788-9069-937bec64bf33 req-104b9f5e-ab76-4c2e-a55b-70e9794bc678 service nova] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Received unexpected event network-vif-plugged-2a57f016-2b33-46f4-a885-51c4ac8658bb for instance with vm_state deleted and task_state None.
Aug 14 17:00:11 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:00:11 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 17:00:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-5191b082-a6f3-467c-b28b-fda85e15f330" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:00:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-5191b082-a6f3-467c-b28b-fda85e15f330" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:00:11 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 17:00:11 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Updating instance_info_cache with network_info: [{"id": "dee958cc-5a62-479c-8429-4c503bef3672", "address": "fa:16:3e:3e:a3:b5", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee958cc-5a", "ovs_interfaceid": "dee958cc-5a62-479c-8429-4c503bef3672", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:00:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-5191b082-a6f3-467c-b28b-fda85e15f330" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:00:11 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 17:00:12 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:00:13 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:00:13 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:00:14 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:00:14 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:00:14 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:00:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:00:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:00:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:00:14 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 17:00:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:00:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:00:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:00:14 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:00:14 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 17:00:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:00:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:00:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:00:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:00:15 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 17:00:15 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:00:15 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:00:15 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=8427MB free_disk=25.272891998291016GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 17:00:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:00:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:00:15 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance b580e3d0-88b5-42a3-a953-84b94c088f41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:00:15 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 6c9ce215-9006-468d-998d-a18df5bf4222 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:00:15 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 5191b082-a6f3-467c-b28b-fda85e15f330 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:00:15 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance fb1a193b-73b7-4690-8571-be9af04b3b14 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:00:15 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 17:00:15 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 17:00:15 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:00:15 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:00:15 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 17:00:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.295s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:00:18 user nova-compute[73056]: INFO nova.compute.manager [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Rescuing
Aug 14 17:00:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "refresh_cache-fb1a193b-73b7-4690-8571-be9af04b3b14" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:00:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquired lock "refresh_cache-fb1a193b-73b7-4690-8571-be9af04b3b14" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:00:18 user nova-compute[73056]: DEBUG nova.network.neutron [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 17:00:18 user nova-compute[73056]: DEBUG nova.network.neutron [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Updating instance_info_cache with network_info: [{"id": "852ab20a-9a1b-47c5-b85e-52a44fff3e36", "address": "fa:16:3e:32:95:fb", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852ab20a-9a", "ovs_interfaceid": "852ab20a-9a1b-47c5-b85e-52a44fff3e36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:00:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Releasing lock "refresh_cache-fb1a193b-73b7-4690-8571-be9af04b3b14" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:00:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:18 user nova-compute[73056]: DEBUG nova.compute.manager [req-789d93b4-028b-4feb-a2d6-355656b7aae0 req-1e9e9a50-f4ad-4359-b5f9-2c9384e8f93f service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Received event network-vif-unplugged-852ab20a-9a1b-47c5-b85e-52a44fff3e36 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:00:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-789d93b4-028b-4feb-a2d6-355656b7aae0 req-1e9e9a50-f4ad-4359-b5f9-2c9384e8f93f service nova] Acquiring lock "fb1a193b-73b7-4690-8571-be9af04b3b14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:00:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-789d93b4-028b-4feb-a2d6-355656b7aae0 req-1e9e9a50-f4ad-4359-b5f9-2c9384e8f93f service nova] Lock "fb1a193b-73b7-4690-8571-be9af04b3b14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:00:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-789d93b4-028b-4feb-a2d6-355656b7aae0 req-1e9e9a50-f4ad-4359-b5f9-2c9384e8f93f service nova] Lock "fb1a193b-73b7-4690-8571-be9af04b3b14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:00:18 user nova-compute[73056]: DEBUG nova.compute.manager [req-789d93b4-028b-4feb-a2d6-355656b7aae0 req-1e9e9a50-f4ad-4359-b5f9-2c9384e8f93f service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] No waiting events found dispatching network-vif-unplugged-852ab20a-9a1b-47c5-b85e-52a44fff3e36 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:00:18 user nova-compute[73056]: WARNING nova.compute.manager [req-789d93b4-028b-4feb-a2d6-355656b7aae0 req-1e9e9a50-f4ad-4359-b5f9-2c9384e8f93f service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Received unexpected event network-vif-unplugged-852ab20a-9a1b-47c5-b85e-52a44fff3e36 for instance with vm_state active and task_state rescuing.
Aug 14 17:00:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:19 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Instance destroyed successfully.
Aug 14 17:00:19 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Attempting a stable device rescue
Aug 14 17:00:19 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73056) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 17:00:19 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Instance directory exists: not creating {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 17:00:19 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Creating image(s)
Aug 14 17:00:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "/opt/stack/data/nova/instances/fb1a193b-73b7-4690-8571-be9af04b3b14/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:00:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "/opt/stack/data/nova/instances/fb1a193b-73b7-4690-8571-be9af04b3b14/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:00:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "/opt/stack/data/nova/instances/fb1a193b-73b7-4690-8571-be9af04b3b14/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:00:19 user nova-compute[73056]: DEBUG nova.objects.instance [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lazy-loading 'trusted_certs' on Instance uuid fb1a193b-73b7-4690-8571-be9af04b3b14 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:00:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "44577b94195c4f51d4cbc3d97ab781320087609e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:00:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "44577b94195c4f51d4cbc3d97ab781320087609e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:00:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44577b94195c4f51d4cbc3d97ab781320087609e.part --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:00:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44577b94195c4f51d4cbc3d97ab781320087609e.part --force-share --output=json" returned: 0 in 0.171s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:00:21 user nova-compute[73056]: DEBUG nova.virt.images [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] 88caf15d-6940-49a6-8445-a8f6b8171653 was qcow2, converting to raw {{(pid=73056) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 17:00:21 user nova-compute[73056]: DEBUG nova.privsep.utils [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73056) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 17:00:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/44577b94195c4f51d4cbc3d97ab781320087609e.part /opt/stack/data/nova/instances/_base/44577b94195c4f51d4cbc3d97ab781320087609e.converted {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:00:21 user nova-compute[73056]: DEBUG nova.compute.manager [req-1e5eb1d2-e2e0-43de-83bf-f4a02fd42d7d req-19bd4fb5-05c6-48b7-96db-080b2dc09f6c service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Received event network-vif-plugged-852ab20a-9a1b-47c5-b85e-52a44fff3e36 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:00:21 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1e5eb1d2-e2e0-43de-83bf-f4a02fd42d7d req-19bd4fb5-05c6-48b7-96db-080b2dc09f6c service nova] Acquiring lock "fb1a193b-73b7-4690-8571-be9af04b3b14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:00:21 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1e5eb1d2-e2e0-43de-83bf-f4a02fd42d7d req-19bd4fb5-05c6-48b7-96db-080b2dc09f6c service nova] Lock "fb1a193b-73b7-4690-8571-be9af04b3b14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:00:21 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1e5eb1d2-e2e0-43de-83bf-f4a02fd42d7d req-19bd4fb5-05c6-48b7-96db-080b2dc09f6c service nova] Lock "fb1a193b-73b7-4690-8571-be9af04b3b14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:00:21 user nova-compute[73056]: DEBUG nova.compute.manager [req-1e5eb1d2-e2e0-43de-83bf-f4a02fd42d7d req-19bd4fb5-05c6-48b7-96db-080b2dc09f6c service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] No waiting events found dispatching network-vif-plugged-852ab20a-9a1b-47c5-b85e-52a44fff3e36 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:00:21 user nova-compute[73056]: WARNING nova.compute.manager [req-1e5eb1d2-e2e0-43de-83bf-f4a02fd42d7d req-19bd4fb5-05c6-48b7-96db-080b2dc09f6c service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Received unexpected event network-vif-plugged-852ab20a-9a1b-47c5-b85e-52a44fff3e36 for instance with vm_state active and task_state rescuing.
Aug 14 17:00:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/44577b94195c4f51d4cbc3d97ab781320087609e.part /opt/stack/data/nova/instances/_base/44577b94195c4f51d4cbc3d97ab781320087609e.converted" returned: 0 in 0.572s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:00:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44577b94195c4f51d4cbc3d97ab781320087609e.converted --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:00:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44577b94195c4f51d4cbc3d97ab781320087609e.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:00:21 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "44577b94195c4f51d4cbc3d97ab781320087609e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.331s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:00:21 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "44577b94195c4f51d4cbc3d97ab781320087609e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:00:21 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "44577b94195c4f51d4cbc3d97ab781320087609e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:00:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44577b94195c4f51d4cbc3d97ab781320087609e --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44577b94195c4f51d4cbc3d97ab781320087609e --force-share --output=json" returned: 0 in 0.172s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44577b94195c4f51d4cbc3d97ab781320087609e,backing_fmt=raw /opt/stack/data/nova/instances/fb1a193b-73b7-4690-8571-be9af04b3b14/disk.rescue {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44577b94195c4f51d4cbc3d97ab781320087609e,backing_fmt=raw /opt/stack/data/nova/instances/fb1a193b-73b7-4690-8571-be9af04b3b14/disk.rescue" returned: 0 in 0.046s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "44577b94195c4f51d4cbc3d97ab781320087609e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG nova.objects.instance [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lazy-loading 'migration_context' on Instance uuid fb1a193b-73b7-4690-8571-be9af04b3b14 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Start _get_guest_xml network_info=[{"id": "852ab20a-9a1b-47c5-b85e-52a44fff3e36", "address": "fa:16:3e:32:95:fb", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "vif_mac": "fa:16:3e:32:95:fb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852ab20a-9a", "ovs_interfaceid": "852ab20a-9a1b-47c5-b85e-52a44fff3e36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '88caf15d-6940-49a6-8445-a8f6b8171653', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gCIxQLbZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'fb1a193b-73b7-4690-8571-be9af04b3b14', 'attached_at': '', 'detached_at': '', 'volume_id': 'f47dbb29-89e5-4391-b050-a7773b4ca93e', 'serial': 'f47dbb29-89e5-4391-b050-a7773b4ca93e'}, 'attachment_id': '49f04eed-a58d-4b66-97f2-f48e0e2b809f', 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG nova.objects.instance [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lazy-loading 'resources' on Instance uuid fb1a193b-73b7-4690-8571-be9af04b3b14 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG nova.objects.instance [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lazy-loading 'numa_topology' on Instance uuid fb1a193b-73b7-4690-8571-be9af04b3b14 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:00:22 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:00:22 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:00:22 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG nova.objects.instance [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lazy-loading 'vcpu_model' on Instance uuid fb1a193b-73b7-4690-8571-be9af04b3b14 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gCIxQLbZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 17:00:22 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 17:00:22 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 17:00:22 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 17:00:22 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 17:00:22 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 17:00:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ed90c9-7cdb-4795-b0a0-99e9daaf2ae1]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = gCIxQLbZ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 14 17:00:22 user nova-compute[73056]: node.name = iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e
Aug 14 17:00:22 user nova-compute[73056]: node.tpgt = -1
Aug 14 17:00:22 user nova-compute[73056]: node.startup = automatic
Aug 14 17:00:22 user nova-compute[73056]: node.leading_login = No
Aug 14 17:00:22 user nova-compute[73056]: iface.iscsi_ifacename = default
Aug 14 17:00:22 user nova-compute[73056]: iface.net_ifacename = <empty>
Aug 14 17:00:22 user nova-compute[73056]: iface.ipaddress = <empty>
Aug 14 17:00:22 user nova-compute[73056]: iface.prefix_len = 0
Aug 14 17:00:22 user nova-compute[73056]: iface.hwaddress = <empty>
Aug 14 17:00:22 user nova-compute[73056]: iface.transport_name = tcp
Aug 14 17:00:22 user nova-compute[73056]: iface.initiatorname = <empty>
Aug 14 17:00:22 user nova-compute[73056]: iface.state = <empty>
Aug 14 17:00:22 user nova-compute[73056]: iface.vlan_id = 0
Aug 14 17:00:22 user nova-compute[73056]: iface.vlan_priority = 0
Aug 14 17:00:22 user nova-compute[73056]: iface.vlan_state = <empty>
Aug 14 17:00:22 user nova-compute[73056]: iface.iface_num = 0
Aug 14 17:00:22 user nova-compute[73056]: iface.mtu = 0
Aug 14 17:00:22 user nova-compute[73056]: iface.port = 0
Aug 14 17:00:22 user nova-compute[73056]: iface.bootproto = <empty>
Aug 14 17:00:22 user nova-compute[73056]: iface.subnet_mask = <empty>
Aug 14 17:00:22 user nova-compute[73056]: iface.gateway = <empty>
Aug 14 17:00:22 user nova-compute[73056]: iface.dhcp_alt_client_id_state = <empty>
Aug 14 17:00:22 user nova-compute[73056]: iface.dhcp_alt_client_id = <empty>
Aug 14 17:00:22 user nova-compute[73056]: iface.dhcp_dns = <empty>
Aug 14 17:00:22 user nova-compute[73056]: iface.dhcp_learn_iqn = <empty>
Aug 14 17:00:22 user nova-compute[73056]: iface.dhcp_req_vendor_id_state = <empty>
Aug 14 17:00:22 user nova-compute[73056]: iface.dhcp_vendor_id_state = <empty>
Aug 14 17:00:22 user nova-compute[73056]: iface.dhcp_vendor_id = <empty>
Aug 14 17:00:22 user nova-compute[73056]: iface.dhcp_slp_da = <empty>
Aug 14 17:00:22 user nova-compute[73056]: iface.fragmentation = <empty>
Aug 14 17:00:22 user nova-compute[73056]: iface.gratuitous_arp = <empty>
Aug 14 17:00:22 user nova-compute[73056]: iface.incoming_forwarding = <empty>
Aug 14 17:00:22 user nova-compute[73056]: iface.tos_state = <empty>
Aug 14 17:00:22 user nova-compute[73056]: iface.tos = 0
Aug 14 17:00:22 user nova-compute[73056]: iface.ttl = 0
Aug 14 17:00:22 user nova-compute[73056]: iface.delayed_ack = <empty>
Aug 14 17:00:22 user nova-compute[73056]: iface.tcp_nagle = <empty>
Aug 14 17:00:22 user nova-compute[73056]: iface.tcp_wsf_state = <empty>
Aug 14 17:00:22 user nova-compute[73056]: iface.tcp_wsf = 0
Aug 14 17:00:22 user nova-compute[73056]: iface.tcp_timer_scale = 0
Aug 14 17:00:22 user nova-compute[73056]: iface.tcp_timestamp = <empty>
Aug 14 17:00:22 user nova-compute[73056]: iface.redirect = <empty>
Aug 14 17:00:22 user nova-compute[73056]: iface.def_task_mgmt_timeout = 0
Aug 14 17:00:22 user nova-compute[73056]: iface.header_digest = <empty>
Aug 14 17:00:22 user nova-compute[73056]: iface.data_digest = <empty>
Aug 14 17:00:22 user nova-compute[73056]: iface.immediate_data = <empty>
Aug 14 17:00:22 user nova-compute[73056]: iface.initial_r2t = <empty>
Aug 14 17:00:22 user nova-compute[73056]: iface.data_seq_inorder = <empty>
Aug 14 17:00:22 user nova-compute[73056]: iface.data_pdu_inorder = <empty>
Aug 14 17:00:22 user nova-compute[73056]: iface.erl = 0
Aug 14 17:00:22 user nova-compute[73056]: iface.max_receive_data_len = 0
Aug 14 17:00:22 user nova-compute[73056]: iface.first_burst_len = 0
Aug 14 17:00:22 user nova-compute[73056]: iface.max_outstanding_r2t = 0
Aug 14 17:00:22 user nova-compute[73056]: iface.max_burst_len = 0
Aug 14 17:00:22 user nova-compute[73056]: iface.chap_auth = <empty>
Aug 14 17:00:22 user nova-compute[73056]: iface.bidi_chap = <empty>
Aug 14 17:00:22 user nova-compute[73056]: iface.strict_login_compliance = <empty>
Aug 14 17:00:22 user nova-compute[73056]: iface.discovery_auth = <empty>
Aug 14 17:00:22 user nova-compute[73056]: iface.discovery_logout = <empty>
Aug 14 17:00:22 user nova-compute[73056]: node.discovery_address = <empty>
Aug 14 17:00:22 user nova-compute[73056]: node.discovery_port = 0
Aug 14 17:00:22 user nova-compute[73056]: node.discovery_type = static
Aug 14 17:00:22 user nova-compute[73056]: node.session.initial_cmdsn = 0
Aug 14 17:00:22 user nova-compute[73056]: node.session.initial_login_retry_max = 8
Aug 14 17:00:22 user nova-compute[73056]: node.session.xmit_thread_priority = -20
Aug 14 17:00:22 user nova-compute[73056]: node.session.cmds_max = 128
Aug 14 17:00:22 user nova-compute[73056]: node.session.queue_depth = 32
Aug 14 17:00:22 user nova-compute[73056]: node.session.nr_sessions = 1
Aug 14 17:00:22 user nova-compute[73056]: node.session.auth.authmethod = CHAP
Aug 14 17:00:22 user nova-compute[73056]: node.session.auth.username = gCIxQLbZ
Aug 14 17:00:22 user nova-compute[73056]: node.session.auth.password = ***
Aug 14 17:00:22 user nova-compute[73056]: node.session.auth.username_in = <empty>
Aug 14 17:00:22 user nova-compute[73056]: node.session.auth.password_in = <empty>
Aug 14 17:00:22 user nova-compute[73056]: node.session.auth.chap_algs = MD5
Aug 14 17:00:22 user nova-compute[73056]: node.session.timeo.replacement_timeout = 120
Aug 14 17:00:22 user nova-compute[73056]: node.session.err_timeo.abort_timeout = 15
Aug 14 17:00:22 user nova-compute[73056]: node.session.err_timeo.lu_reset_timeout = 30
Aug 14 17:00:22 user nova-compute[73056]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 14 17:00:22 user nova-compute[73056]: node.session.err_timeo.host_reset_timeout = 60
Aug 14 17:00:22 user nova-compute[73056]: node.session.iscsi.FastAbort = Yes
Aug 14 17:00:22 user nova-compute[73056]: node.session.iscsi.InitialR2T = No
Aug 14 17:00:22 user nova-compute[73056]: node.session.iscsi.ImmediateData = Yes
Aug 14 17:00:22 user nova-compute[73056]: node.session.iscsi.FirstBurstLength = 262144
Aug 14 17:00:22 user nova-compute[73056]: node.session.iscsi.MaxBurstLength = 16776192
Aug 14 17:00:22 user nova-compute[73056]: node.session.iscsi.DefaultTime2Retain = 0
Aug 14 17:00:22 user nova-compute[73056]: node.session.iscsi.DefaultTime2Wait = 2
Aug 14 17:00:22 user nova-compute[73056]: node.session.iscsi.MaxConnections = 1
Aug 14 17:00:22 user nova-compute[73056]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 14 17:00:22 user nova-compute[73056]: node.session.iscsi.ERL = 0
Aug 14 17:00:22 user nova-compute[73056]: node.session.scan = manual
Aug 14 17:00:22 user nova-compute[73056]: node.session.reopen_max = 0
Aug 14 17:00:22 user nova-compute[73056]: node.conn[0].address = 172.16.0.220
Aug 14 17:00:22 user nova-compute[73056]: node.conn[0].port = 3260
Aug 14 17:00:22 user nova-compute[73056]: node.conn[0].startup = manual
Aug 14 17:00:22 user nova-compute[73056]: node.conn[0].tcp.window_size = 524288
Aug 14 17:00:22 user nova-compute[73056]: node.conn[0].tcp.type_of_service = 0
Aug 14 17:00:22 user nova-compute[73056]: node.conn[0].timeo.logout_timeout = 15
Aug 14 17:00:22 user nova-compute[73056]: node.conn[0].timeo.login_timeout = 15
Aug 14 17:00:22 user nova-compute[73056]: node.conn[0].timeo.auth_timeout = 45
Aug 14 17:00:22 user nova-compute[73056]: node.conn[0].timeo.noop_out_interval = 5
Aug 14 17:00:22 user nova-compute[73056]: node.conn[0].timeo.noop_out_timeout = 5
Aug 14 17:00:22 user nova-compute[73056]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 14 17:00:22 user nova-compute[73056]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 14 17:00:22 user nova-compute[73056]: node.conn[0].iscsi.HeaderDigest = None
Aug 14 17:00:22 user nova-compute[73056]: node.conn[0].iscsi.DataDigest = None
Aug 14 17:00:22 user nova-compute[73056]: node.conn[0].iscsi.IFMarker = No
Aug 14 17:00:22 user nova-compute[73056]: node.conn[0].iscsi.OFMarker = No
Aug 14 17:00:22 user nova-compute[73056]: # END RECORD
Aug 14 17:00:22 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab2a42d-b3f4-45ab-919a-1a1212940640]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56a6b2e-468e-43ec-9c5b-559d00bd75d9]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gCIxQLbZ {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gCIxQLbZ" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[83840504-1e87-4c7e-9abb-432e3a66185d]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gCIxQLbZ'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3854580-ab00-4f7b-8d1d-18ee7b22bae8]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae464878-864c-41f7-b13f-771b72ca2a0b]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 17:00:22 user nova-compute[73056]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 17:00:22 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 17:00:22 user nova-compute[73056]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 17:00:22 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.132s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] HCTL ('35', '0', '0', 0) found on session 47 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.013s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b14acd6-45c5-4b52-8889-78fa90fc1c09]: (4, ('0 0 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Searching for a device in session 47 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gCIxQLbZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.154s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] <== connect_volume: return (156ms) {'type': 'block', 'scsi_wwn': '26161663262313736', 'path': '/dev/sdd'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161663262313736', 'path': '/dev/sdd'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:58:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-981830137',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-981830137',id=43,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:58:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a56fc678888b4653802e94ac6b47f95d',ramdisk_id='',reservation_id='r-j55o6yqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-572642883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T16:58:47Z,user_data=None,user_id='958f0c79efdc4352b35874e6c6f940d8',uuid=fb1a193b-73b7-4690-8571-be9af04b3b14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "852ab20a-9a1b-47c5-b85e-52a44fff3e36", "address": "fa:16:3e:32:95:fb", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "vif_mac": "fa:16:3e:32:95:fb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852ab20a-9a", "ovs_interfaceid": "852ab20a-9a1b-47c5-b85e-52a44fff3e36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Converting VIF {"id": "852ab20a-9a1b-47c5-b85e-52a44fff3e36", "address": "fa:16:3e:32:95:fb", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "vif_mac": "fa:16:3e:32:95:fb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852ab20a-9a", "ovs_interfaceid": "852ab20a-9a1b-47c5-b85e-52a44fff3e36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:95:fb,bridge_name='br-int',has_traffic_filtering=True,id=852ab20a-9a1b-47c5-b85e-52a44fff3e36,network=Network(ac2d700d-98d2-4459-8da8-a4858cda8864),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap852ab20a-9a') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG nova.objects.instance [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lazy-loading 'pci_devices' on Instance uuid fb1a193b-73b7-4690-8571-be9af04b3b14 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] End _get_guest_xml xml=<domain type="kvm">
Aug 14 17:00:22 user nova-compute[73056]:   <uuid>fb1a193b-73b7-4690-8571-be9af04b3b14</uuid>
Aug 14 17:00:22 user nova-compute[73056]:   <name>instance-0000002b</name>
Aug 14 17:00:22 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 17:00:22 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 17:00:22 user nova-compute[73056]:   <metadata>
Aug 14 17:00:22 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 17:00:22 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 17:00:22 user nova-compute[73056]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-981830137</nova:name>
Aug 14 17:00:22 user nova-compute[73056]:       <nova:creationTime>2023-08-14 17:00:22</nova:creationTime>
Aug 14 17:00:22 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 17:00:22 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 17:00:22 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 17:00:22 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 17:00:22 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 17:00:22 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 17:00:22 user nova-compute[73056]:       </nova:flavor>
Aug 14 17:00:22 user nova-compute[73056]:       <nova:owner>
Aug 14 17:00:22 user nova-compute[73056]:         <nova:user uuid="958f0c79efdc4352b35874e6c6f940d8">tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member</nova:user>
Aug 14 17:00:22 user nova-compute[73056]:         <nova:project uuid="a56fc678888b4653802e94ac6b47f95d">tempest-ServerBootFromVolumeStableRescueTest-572642883</nova:project>
Aug 14 17:00:22 user nova-compute[73056]:       </nova:owner>
Aug 14 17:00:22 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 17:00:22 user nova-compute[73056]:       <nova:ports>
Aug 14 17:00:22 user nova-compute[73056]:         <nova:port uuid="852ab20a-9a1b-47c5-b85e-52a44fff3e36">
Aug 14 17:00:22 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 14 17:00:22 user nova-compute[73056]:         </nova:port>
Aug 14 17:00:22 user nova-compute[73056]:       </nova:ports>
Aug 14 17:00:22 user nova-compute[73056]:     </nova:instance>
Aug 14 17:00:22 user nova-compute[73056]:   </metadata>
Aug 14 17:00:22 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 17:00:22 user nova-compute[73056]:     <system>
Aug 14 17:00:22 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 17:00:22 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 17:00:22 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 17:00:22 user nova-compute[73056]:       <entry name="serial">fb1a193b-73b7-4690-8571-be9af04b3b14</entry>
Aug 14 17:00:22 user nova-compute[73056]:       <entry name="uuid">fb1a193b-73b7-4690-8571-be9af04b3b14</entry>
Aug 14 17:00:22 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 17:00:22 user nova-compute[73056]:     </system>
Aug 14 17:00:22 user nova-compute[73056]:   </sysinfo>
Aug 14 17:00:22 user nova-compute[73056]:   <os>
Aug 14 17:00:22 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 17:00:22 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 17:00:22 user nova-compute[73056]:   </os>
Aug 14 17:00:22 user nova-compute[73056]:   <features>
Aug 14 17:00:22 user nova-compute[73056]:     <acpi/>
Aug 14 17:00:22 user nova-compute[73056]:     <apic/>
Aug 14 17:00:22 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 17:00:22 user nova-compute[73056]:   </features>
Aug 14 17:00:22 user nova-compute[73056]:   <clock offset="utc">
Aug 14 17:00:22 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 17:00:22 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 17:00:22 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 17:00:22 user nova-compute[73056]:   </clock>
Aug 14 17:00:22 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 17:00:22 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 17:00:22 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 17:00:22 user nova-compute[73056]:   </cpu>
Aug 14 17:00:22 user nova-compute[73056]:   <devices>
Aug 14 17:00:22 user nova-compute[73056]:     <disk type="block" device="disk">
Aug 14 17:00:22 user nova-compute[73056]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 17:00:22 user nova-compute[73056]:       <source dev="/dev/sdd"/>
Aug 14 17:00:22 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 17:00:22 user nova-compute[73056]:       <serial>f47dbb29-89e5-4391-b050-a7773b4ca93e</serial>
Aug 14 17:00:22 user nova-compute[73056]:     </disk>
Aug 14 17:00:22 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 17:00:22 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 17:00:22 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/fb1a193b-73b7-4690-8571-be9af04b3b14/disk.rescue"/>
Aug 14 17:00:22 user nova-compute[73056]:       <target dev="vdb" bus="virtio"/>
Aug 14 17:00:22 user nova-compute[73056]:       <boot order="1"/>
Aug 14 17:00:22 user nova-compute[73056]:     </disk>
Aug 14 17:00:22 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 17:00:22 user nova-compute[73056]:       <mac address="fa:16:3e:32:95:fb"/>
Aug 14 17:00:22 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 17:00:22 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 17:00:22 user nova-compute[73056]:       <target dev="tap852ab20a-9a"/>
Aug 14 17:00:22 user nova-compute[73056]:     </interface>
Aug 14 17:00:22 user nova-compute[73056]:     <serial type="pty">
Aug 14 17:00:22 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/fb1a193b-73b7-4690-8571-be9af04b3b14/console.log" append="off"/>
Aug 14 17:00:22 user nova-compute[73056]:     </serial>
Aug 14 17:00:22 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 17:00:22 user nova-compute[73056]:     <video>
Aug 14 17:00:22 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 17:00:22 user nova-compute[73056]:     </video>
Aug 14 17:00:22 user nova-compute[73056]:     <rng model="virtio">
Aug 14 17:00:22 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 17:00:22 user nova-compute[73056]:     </rng>
Aug 14 17:00:22 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 17:00:22 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 17:00:22 user nova-compute[73056]:       <stats period="10"/>
Aug 14 17:00:22 user nova-compute[73056]:     </memballoon>
Aug 14 17:00:22 user nova-compute[73056]:   </devices>
Aug 14 17:00:22 user nova-compute[73056]: </domain>
Aug 14 17:00:22 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 17:00:22 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Instance destroyed successfully.
Aug 14 17:00:22 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 17:00:22 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] No VIF found with MAC fa:16:3e:32:95:fb, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 17:00:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:23 user nova-compute[73056]: DEBUG nova.compute.manager [req-ac3e6fec-a6a7-41ae-9d46-8c6ec14ab693 req-f8f270d1-ae44-4513-8583-d0c51060b33c service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Received event network-vif-plugged-852ab20a-9a1b-47c5-b85e-52a44fff3e36 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:00:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ac3e6fec-a6a7-41ae-9d46-8c6ec14ab693 req-f8f270d1-ae44-4513-8583-d0c51060b33c service nova] Acquiring lock "fb1a193b-73b7-4690-8571-be9af04b3b14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:00:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ac3e6fec-a6a7-41ae-9d46-8c6ec14ab693 req-f8f270d1-ae44-4513-8583-d0c51060b33c service nova] Lock "fb1a193b-73b7-4690-8571-be9af04b3b14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:00:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ac3e6fec-a6a7-41ae-9d46-8c6ec14ab693 req-f8f270d1-ae44-4513-8583-d0c51060b33c service nova] Lock "fb1a193b-73b7-4690-8571-be9af04b3b14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:00:23 user nova-compute[73056]: DEBUG nova.compute.manager [req-ac3e6fec-a6a7-41ae-9d46-8c6ec14ab693 req-f8f270d1-ae44-4513-8583-d0c51060b33c service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] No waiting events found dispatching network-vif-plugged-852ab20a-9a1b-47c5-b85e-52a44fff3e36 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:00:23 user nova-compute[73056]: WARNING nova.compute.manager [req-ac3e6fec-a6a7-41ae-9d46-8c6ec14ab693 req-f8f270d1-ae44-4513-8583-d0c51060b33c service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Received unexpected event network-vif-plugged-852ab20a-9a1b-47c5-b85e-52a44fff3e36 for instance with vm_state active and task_state rescuing.
Aug 14 17:00:24 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:24 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692032409.7016478, 92c34cf0-fd39-49fc-9244-4da8ccae6eec => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:00:24 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] VM Stopped (Lifecycle Event)
Aug 14 17:00:24 user nova-compute[73056]: DEBUG nova.compute.manager [None req-4c2223d0-165d-4bed-9311-a388bdcb337a None None] [instance: 92c34cf0-fd39-49fc-9244-4da8ccae6eec] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:00:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:26 user nova-compute[73056]: DEBUG nova.compute.manager [req-4df8a456-43c2-4edc-93ea-7db26b6bfc18 req-b8bb90fd-638b-4c8f-89c3-69502d57b430 service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Received event network-vif-plugged-852ab20a-9a1b-47c5-b85e-52a44fff3e36 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:00:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4df8a456-43c2-4edc-93ea-7db26b6bfc18 req-b8bb90fd-638b-4c8f-89c3-69502d57b430 service nova] Acquiring lock "fb1a193b-73b7-4690-8571-be9af04b3b14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:00:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4df8a456-43c2-4edc-93ea-7db26b6bfc18 req-b8bb90fd-638b-4c8f-89c3-69502d57b430 service nova] Lock "fb1a193b-73b7-4690-8571-be9af04b3b14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:00:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4df8a456-43c2-4edc-93ea-7db26b6bfc18 req-b8bb90fd-638b-4c8f-89c3-69502d57b430 service nova] Lock "fb1a193b-73b7-4690-8571-be9af04b3b14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:00:26 user nova-compute[73056]: DEBUG nova.compute.manager [req-4df8a456-43c2-4edc-93ea-7db26b6bfc18 req-b8bb90fd-638b-4c8f-89c3-69502d57b430 service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] No waiting events found dispatching network-vif-plugged-852ab20a-9a1b-47c5-b85e-52a44fff3e36 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:00:26 user nova-compute[73056]: WARNING nova.compute.manager [req-4df8a456-43c2-4edc-93ea-7db26b6bfc18 req-b8bb90fd-638b-4c8f-89c3-69502d57b430 service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Received unexpected event network-vif-plugged-852ab20a-9a1b-47c5-b85e-52a44fff3e36 for instance with vm_state active and task_state rescuing.
Aug 14 17:00:26 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Removed pending event for fb1a193b-73b7-4690-8571-be9af04b3b14 due to event {{(pid=73056) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 17:00:26 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692032426.1955144, fb1a193b-73b7-4690-8571-be9af04b3b14 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:00:26 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] VM Resumed (Lifecycle Event)
Aug 14 17:00:26 user nova-compute[73056]: DEBUG nova.compute.manager [None req-6956009c-069f-467b-b7b1-2d2008d49cd9 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:00:26 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:00:26 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 17:00:26 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 17:00:26 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692032426.1967175, fb1a193b-73b7-4690-8571-be9af04b3b14 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:00:26 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] VM Started (Lifecycle Event)
Aug 14 17:00:26 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:00:26 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 17:00:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:00:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:00:26 user nova-compute[73056]: INFO nova.compute.manager [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Unshelving
Aug 14 17:00:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:00:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:00:27 user nova-compute[73056]: DEBUG nova.objects.instance [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lazy-loading 'pci_requests' on Instance uuid e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:00:27 user nova-compute[73056]: DEBUG nova.objects.instance [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lazy-loading 'numa_topology' on Instance uuid e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:00:27 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 17:00:27 user nova-compute[73056]: INFO nova.compute.claims [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Claim successful on node user
Aug 14 17:00:27 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:00:27 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:00:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.307s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:00:27 user nova-compute[73056]: INFO nova.network.neutron [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Updating port 2f9ed6a8-5d92-4e63-9c4e-2658d1cec310 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 14 17:00:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "refresh_cache-e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:00:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquired lock "refresh_cache-e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:00:28 user nova-compute[73056]: DEBUG nova.network.neutron [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 17:00:28 user nova-compute[73056]: DEBUG nova.compute.manager [req-8c7fbfc6-0582-466d-8071-2d7976a6fe50 req-2bd568d6-ee83-4334-a373-460f4d06b858 service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Received event network-changed-2f9ed6a8-5d92-4e63-9c4e-2658d1cec310 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:00:28 user nova-compute[73056]: DEBUG nova.compute.manager [req-8c7fbfc6-0582-466d-8071-2d7976a6fe50 req-2bd568d6-ee83-4334-a373-460f4d06b858 service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Refreshing instance network info cache due to event network-changed-2f9ed6a8-5d92-4e63-9c4e-2658d1cec310. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 17:00:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8c7fbfc6-0582-466d-8071-2d7976a6fe50 req-2bd568d6-ee83-4334-a373-460f4d06b858 service nova] Acquiring lock "refresh_cache-e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:00:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:28 user nova-compute[73056]: DEBUG nova.network.neutron [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Updating instance_info_cache with network_info: [{"id": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "address": "fa:16:3e:24:f8:f3", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9ed6a8-5d", "ovs_interfaceid": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:00:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Releasing lock "refresh_cache-e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:00:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 17:00:28 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Creating image(s)
Aug 14 17:00:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "/opt/stack/data/nova/instances/e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:00:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "/opt/stack/data/nova/instances/e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:00:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "/opt/stack/data/nova/instances/e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:00:28 user nova-compute[73056]: DEBUG nova.objects.instance [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lazy-loading 'trusted_certs' on Instance uuid e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:00:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8c7fbfc6-0582-466d-8071-2d7976a6fe50 req-2bd568d6-ee83-4334-a373-460f4d06b858 service nova] Acquired lock "refresh_cache-e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:00:28 user nova-compute[73056]: DEBUG nova.network.neutron [req-8c7fbfc6-0582-466d-8071-2d7976a6fe50 req-2bd568d6-ee83-4334-a373-460f4d06b858 service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Refreshing network info cache for port 2f9ed6a8-5d92-4e63-9c4e-2658d1cec310 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 17:00:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "6ab1c310bc2ab3975874b79bc1015eb8539c4049" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:00:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "6ab1c310bc2ab3975874b79bc1015eb8539c4049" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:00:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ab1c310bc2ab3975874b79bc1015eb8539c4049.part --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:00:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ab1c310bc2ab3975874b79bc1015eb8539c4049.part --force-share --output=json" returned: 0 in 0.189s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:00:29 user nova-compute[73056]: DEBUG nova.virt.images [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] 13e3ca97-f3c2-40c8-b9f6-925232fa32d2 was qcow2, converting to raw {{(pid=73056) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 17:00:30 user nova-compute[73056]: DEBUG nova.privsep.utils [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73056) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 17:00:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6ab1c310bc2ab3975874b79bc1015eb8539c4049.part /opt/stack/data/nova/instances/_base/6ab1c310bc2ab3975874b79bc1015eb8539c4049.converted {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:00:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:30 user nova-compute[73056]: DEBUG nova.network.neutron [req-8c7fbfc6-0582-466d-8071-2d7976a6fe50 req-2bd568d6-ee83-4334-a373-460f4d06b858 service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Updated VIF entry in instance network info cache for port 2f9ed6a8-5d92-4e63-9c4e-2658d1cec310. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 17:00:30 user nova-compute[73056]: DEBUG nova.network.neutron [req-8c7fbfc6-0582-466d-8071-2d7976a6fe50 req-2bd568d6-ee83-4334-a373-460f4d06b858 service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Updating instance_info_cache with network_info: [{"id": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "address": "fa:16:3e:24:f8:f3", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9ed6a8-5d", "ovs_interfaceid": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:00:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8c7fbfc6-0582-466d-8071-2d7976a6fe50 req-2bd568d6-ee83-4334-a373-460f4d06b858 service nova] Releasing lock "refresh_cache-e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:00:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6ab1c310bc2ab3975874b79bc1015eb8539c4049.part /opt/stack/data/nova/instances/_base/6ab1c310bc2ab3975874b79bc1015eb8539c4049.converted" returned: 0 in 0.599s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:00:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ab1c310bc2ab3975874b79bc1015eb8539c4049.converted --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:00:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ab1c310bc2ab3975874b79bc1015eb8539c4049.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:00:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "6ab1c310bc2ab3975874b79bc1015eb8539c4049" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.130s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:00:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ab1c310bc2ab3975874b79bc1015eb8539c4049 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:00:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ab1c310bc2ab3975874b79bc1015eb8539c4049 --force-share --output=json" returned: 0 in 0.175s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:00:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "6ab1c310bc2ab3975874b79bc1015eb8539c4049" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:00:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "6ab1c310bc2ab3975874b79bc1015eb8539c4049" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:00:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ab1c310bc2ab3975874b79bc1015eb8539c4049 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:00:31 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ab1c310bc2ab3975874b79bc1015eb8539c4049 --force-share --output=json" returned: 0 in 0.173s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:00:31 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ab1c310bc2ab3975874b79bc1015eb8539c4049,backing_fmt=raw /opt/stack/data/nova/instances/e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:00:31 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ab1c310bc2ab3975874b79bc1015eb8539c4049,backing_fmt=raw /opt/stack/data/nova/instances/e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3/disk 1073741824" returned: 0 in 0.047s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:00:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "6ab1c310bc2ab3975874b79bc1015eb8539c4049" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:00:31 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ab1c310bc2ab3975874b79bc1015eb8539c4049 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:00:31 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ab1c310bc2ab3975874b79bc1015eb8539c4049 --force-share --output=json" returned: 0 in 0.178s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:00:31 user nova-compute[73056]: DEBUG nova.objects.instance [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lazy-loading 'migration_context' on Instance uuid e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:00:31 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Rebasing disk image.
Aug 14 17:00:31 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:00:31 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.179s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:00:31 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 -F raw /opt/stack/data/nova/instances/e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3/disk {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 -F raw /opt/stack/data/nova/instances/e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3/disk" returned: 0 in 2.274s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Ensure instance console log exists: /opt/stack/data/nova/instances/e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Start _get_guest_xml network_info=[{"id": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "address": "fa:16:3e:24:f8:f3", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9ed6a8-5d", "ovs_interfaceid": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='3dd78a3f4f1b033bae92e2f257d44d91',container_format='bare',created_at=2023-08-14T16:58:34Z,direct_url=<?>,disk_format='qcow2',id=13e3ca97-f3c2-40c8-b9f6-925232fa32d2,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-948039001-shelved',owner='c67a1c8fcd97416e90f6b5a50a886a75',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-14T16:58:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 17:00:33 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:00:33 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:00:33 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='3dd78a3f4f1b033bae92e2f257d44d91',container_format='bare',created_at=2023-08-14T16:58:34Z,direct_url=<?>,disk_format='qcow2',id=13e3ca97-f3c2-40c8-b9f6-925232fa32d2,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-948039001-shelved',owner='c67a1c8fcd97416e90f6b5a50a886a75',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-14T16:58:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG nova.objects.instance [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lazy-loading 'vcpu_model' on Instance uuid e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T16:56:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-948039001',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-948039001',id=41,image_ref='13e3ca97-f3c2-40c8-b9f6-925232fa32d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-707146351',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:56:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c67a1c8fcd97416e90f6b5a50a886a75',ramdisk_id='',reservation_id='r-p59njr5z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1935390723',owner_user_name='tempest-AttachVolumeShelveTestJSON-1935390723-project-member',shelved_at='2023-08-14T16:58:38.048169',shelved_host='user',shelved_image_id='13e3ca97-f3c2-40c8-b9f6-925232fa32d2'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T17:00:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a20dd4c88984674996e26fdcfa4f126',uuid=e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "address": "fa:16:3e:24:f8:f3", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9ed6a8-5d", "ovs_interfaceid": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Converting VIF {"id": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "address": "fa:16:3e:24:f8:f3", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9ed6a8-5d", "ovs_interfaceid": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:f8:f3,bridge_name='br-int',has_traffic_filtering=True,id=2f9ed6a8-5d92-4e63-9c4e-2658d1cec310,network=Network(20384d1d-92c0-4ac7-a993-956fa784cd87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f9ed6a8-5d') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG nova.objects.instance [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lazy-loading 'pci_devices' on Instance uuid e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] End _get_guest_xml xml=<domain type="kvm">
Aug 14 17:00:33 user nova-compute[73056]:   <uuid>e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3</uuid>
Aug 14 17:00:33 user nova-compute[73056]:   <name>instance-00000029</name>
Aug 14 17:00:33 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 17:00:33 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 17:00:33 user nova-compute[73056]:   <metadata>
Aug 14 17:00:33 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 17:00:33 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 17:00:33 user nova-compute[73056]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-948039001</nova:name>
Aug 14 17:00:33 user nova-compute[73056]:       <nova:creationTime>2023-08-14 17:00:33</nova:creationTime>
Aug 14 17:00:33 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 17:00:33 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 17:00:33 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 17:00:33 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 17:00:33 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 17:00:33 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 17:00:33 user nova-compute[73056]:       </nova:flavor>
Aug 14 17:00:33 user nova-compute[73056]:       <nova:owner>
Aug 14 17:00:33 user nova-compute[73056]:         <nova:user uuid="9a20dd4c88984674996e26fdcfa4f126">tempest-AttachVolumeShelveTestJSON-1935390723-project-member</nova:user>
Aug 14 17:00:33 user nova-compute[73056]:         <nova:project uuid="c67a1c8fcd97416e90f6b5a50a886a75">tempest-AttachVolumeShelveTestJSON-1935390723</nova:project>
Aug 14 17:00:33 user nova-compute[73056]:       </nova:owner>
Aug 14 17:00:33 user nova-compute[73056]:       <nova:root type="image" uuid="13e3ca97-f3c2-40c8-b9f6-925232fa32d2"/>
Aug 14 17:00:33 user nova-compute[73056]:       <nova:ports>
Aug 14 17:00:33 user nova-compute[73056]:         <nova:port uuid="2f9ed6a8-5d92-4e63-9c4e-2658d1cec310">
Aug 14 17:00:33 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 17:00:33 user nova-compute[73056]:         </nova:port>
Aug 14 17:00:33 user nova-compute[73056]:       </nova:ports>
Aug 14 17:00:33 user nova-compute[73056]:     </nova:instance>
Aug 14 17:00:33 user nova-compute[73056]:   </metadata>
Aug 14 17:00:33 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 17:00:33 user nova-compute[73056]:     <system>
Aug 14 17:00:33 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 17:00:33 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 17:00:33 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 17:00:33 user nova-compute[73056]:       <entry name="serial">e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3</entry>
Aug 14 17:00:33 user nova-compute[73056]:       <entry name="uuid">e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3</entry>
Aug 14 17:00:33 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 17:00:33 user nova-compute[73056]:     </system>
Aug 14 17:00:33 user nova-compute[73056]:   </sysinfo>
Aug 14 17:00:33 user nova-compute[73056]:   <os>
Aug 14 17:00:33 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 17:00:33 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 17:00:33 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 17:00:33 user nova-compute[73056]:   </os>
Aug 14 17:00:33 user nova-compute[73056]:   <features>
Aug 14 17:00:33 user nova-compute[73056]:     <acpi/>
Aug 14 17:00:33 user nova-compute[73056]:     <apic/>
Aug 14 17:00:33 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 17:00:33 user nova-compute[73056]:   </features>
Aug 14 17:00:33 user nova-compute[73056]:   <clock offset="utc">
Aug 14 17:00:33 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 17:00:33 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 17:00:33 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 17:00:33 user nova-compute[73056]:   </clock>
Aug 14 17:00:33 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 17:00:33 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 17:00:33 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 17:00:33 user nova-compute[73056]:   </cpu>
Aug 14 17:00:33 user nova-compute[73056]:   <devices>
Aug 14 17:00:33 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 17:00:33 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 17:00:33 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3/disk"/>
Aug 14 17:00:33 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 17:00:33 user nova-compute[73056]:     </disk>
Aug 14 17:00:33 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 17:00:33 user nova-compute[73056]:       <mac address="fa:16:3e:24:f8:f3"/>
Aug 14 17:00:33 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 17:00:33 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 17:00:33 user nova-compute[73056]:       <target dev="tap2f9ed6a8-5d"/>
Aug 14 17:00:33 user nova-compute[73056]:     </interface>
Aug 14 17:00:33 user nova-compute[73056]:     <serial type="pty">
Aug 14 17:00:33 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3/console.log" append="off"/>
Aug 14 17:00:33 user nova-compute[73056]:     </serial>
Aug 14 17:00:33 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 17:00:33 user nova-compute[73056]:     <video>
Aug 14 17:00:33 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 17:00:33 user nova-compute[73056]:     </video>
Aug 14 17:00:33 user nova-compute[73056]:     <rng model="virtio">
Aug 14 17:00:33 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 17:00:33 user nova-compute[73056]:     </rng>
Aug 14 17:00:33 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 17:00:33 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 17:00:33 user nova-compute[73056]:       <stats period="10"/>
Aug 14 17:00:33 user nova-compute[73056]:     </memballoon>
Aug 14 17:00:33 user nova-compute[73056]:   </devices>
Aug 14 17:00:33 user nova-compute[73056]: </domain>
Aug 14 17:00:33 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T16:56:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-948039001',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-948039001',id=41,image_ref='13e3ca97-f3c2-40c8-b9f6-925232fa32d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-707146351',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:56:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c67a1c8fcd97416e90f6b5a50a886a75',ramdisk_id='',reservation_id='r-p59njr5z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1935390723',owner_user_name='tempest-AttachVolumeShelveTestJSON-1935390723-project-member',shelved_at='2023-08-14T16:58:38.048169',shelved_host='user',shelved_image_id='13e3ca97-f3c2-40c8-b9f6-925232fa32d2'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T17:00:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a20dd4c88984674996e26fdcfa4f126',uuid=e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "address": "fa:16:3e:24:f8:f3", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9ed6a8-5d", "ovs_interfaceid": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Converting VIF {"id": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "address": "fa:16:3e:24:f8:f3", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9ed6a8-5d", "ovs_interfaceid": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:f8:f3,bridge_name='br-int',has_traffic_filtering=True,id=2f9ed6a8-5d92-4e63-9c4e-2658d1cec310,network=Network(20384d1d-92c0-4ac7-a993-956fa784cd87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f9ed6a8-5d') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG os_vif [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:f8:f3,bridge_name='br-int',has_traffic_filtering=True,id=2f9ed6a8-5d92-4e63-9c4e-2658d1cec310,network=Network(20384d1d-92c0-4ac7-a993-956fa784cd87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f9ed6a8-5d') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f9ed6a8-5d, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2f9ed6a8-5d, col_values=(('external_ids', {'iface-id': '2f9ed6a8-5d92-4e63-9c4e-2658d1cec310', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:f8:f3', 'vm-uuid': 'e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:00:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:33 user nova-compute[73056]: INFO os_vif [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:f8:f3,bridge_name='br-int',has_traffic_filtering=True,id=2f9ed6a8-5d92-4e63-9c4e-2658d1cec310,network=Network(20384d1d-92c0-4ac7-a993-956fa784cd87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f9ed6a8-5d')
Aug 14 17:00:34 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 17:00:34 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] No VIF found with MAC fa:16:3e:24:f8:f3, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 17:00:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:36 user nova-compute[73056]: DEBUG nova.compute.manager [req-eb1c4064-e8e2-4fb6-8c50-ff6021e6c310 req-1007a6ca-fb58-4cda-88d4-cf0b1ac198da service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Received event network-vif-plugged-2f9ed6a8-5d92-4e63-9c4e-2658d1cec310 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:00:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-eb1c4064-e8e2-4fb6-8c50-ff6021e6c310 req-1007a6ca-fb58-4cda-88d4-cf0b1ac198da service nova] Acquiring lock "e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:00:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-eb1c4064-e8e2-4fb6-8c50-ff6021e6c310 req-1007a6ca-fb58-4cda-88d4-cf0b1ac198da service nova] Lock "e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:00:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-eb1c4064-e8e2-4fb6-8c50-ff6021e6c310 req-1007a6ca-fb58-4cda-88d4-cf0b1ac198da service nova] Lock "e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:00:36 user nova-compute[73056]: DEBUG nova.compute.manager [req-eb1c4064-e8e2-4fb6-8c50-ff6021e6c310 req-1007a6ca-fb58-4cda-88d4-cf0b1ac198da service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] No waiting events found dispatching network-vif-plugged-2f9ed6a8-5d92-4e63-9c4e-2658d1cec310 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:00:36 user nova-compute[73056]: WARNING nova.compute.manager [req-eb1c4064-e8e2-4fb6-8c50-ff6021e6c310 req-1007a6ca-fb58-4cda-88d4-cf0b1ac198da service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Received unexpected event network-vif-plugged-2f9ed6a8-5d92-4e63-9c4e-2658d1cec310 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 17:00:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:38 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692032438.065632, e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:00:38 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] VM Resumed (Lifecycle Event)
Aug 14 17:00:38 user nova-compute[73056]: DEBUG nova.compute.manager [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 17:00:38 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 17:00:38 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:00:38 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Instance spawned successfully.
Aug 14 17:00:38 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 17:00:38 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 17:00:38 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692032438.0673926, e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:00:38 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] VM Started (Lifecycle Event)
Aug 14 17:00:38 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:00:38 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 17:00:38 user nova-compute[73056]: DEBUG nova.compute.manager [req-2a128d4f-3a8f-4409-9988-f36a979829e8 req-2b1f8c01-9666-42c1-8aea-582ac1f8c0c3 service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Received event network-vif-plugged-2f9ed6a8-5d92-4e63-9c4e-2658d1cec310 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:00:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2a128d4f-3a8f-4409-9988-f36a979829e8 req-2b1f8c01-9666-42c1-8aea-582ac1f8c0c3 service nova] Acquiring lock "e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:00:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2a128d4f-3a8f-4409-9988-f36a979829e8 req-2b1f8c01-9666-42c1-8aea-582ac1f8c0c3 service nova] Lock "e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:00:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2a128d4f-3a8f-4409-9988-f36a979829e8 req-2b1f8c01-9666-42c1-8aea-582ac1f8c0c3 service nova] Lock "e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:00:38 user nova-compute[73056]: DEBUG nova.compute.manager [req-2a128d4f-3a8f-4409-9988-f36a979829e8 req-2b1f8c01-9666-42c1-8aea-582ac1f8c0c3 service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] No waiting events found dispatching network-vif-plugged-2f9ed6a8-5d92-4e63-9c4e-2658d1cec310 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:00:38 user nova-compute[73056]: WARNING nova.compute.manager [req-2a128d4f-3a8f-4409-9988-f36a979829e8 req-2b1f8c01-9666-42c1-8aea-582ac1f8c0c3 service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Received unexpected event network-vif-plugged-2f9ed6a8-5d92-4e63-9c4e-2658d1cec310 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 17:00:38 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 17:00:38 user nova-compute[73056]: DEBUG nova.compute.manager [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:00:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-668c0530-be34-42ba-b5e6-1ab8c4cd81c3 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.489s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:00:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:50 user nova-compute[73056]: DEBUG nova.compute.manager [req-490542d6-802f-4838-a3ed-3f9c4c811f55 req-6b146ffb-2edf-4f73-9d8c-ff7e359ba8af service nova] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Received event network-changed-09f698e2-41d7-4329-92b1-9a80dc461259 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:00:50 user nova-compute[73056]: DEBUG nova.compute.manager [req-490542d6-802f-4838-a3ed-3f9c4c811f55 req-6b146ffb-2edf-4f73-9d8c-ff7e359ba8af service nova] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Refreshing instance network info cache due to event network-changed-09f698e2-41d7-4329-92b1-9a80dc461259. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 17:00:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-490542d6-802f-4838-a3ed-3f9c4c811f55 req-6b146ffb-2edf-4f73-9d8c-ff7e359ba8af service nova] Acquiring lock "refresh_cache-6c9ce215-9006-468d-998d-a18df5bf4222" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:00:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-490542d6-802f-4838-a3ed-3f9c4c811f55 req-6b146ffb-2edf-4f73-9d8c-ff7e359ba8af service nova] Acquired lock "refresh_cache-6c9ce215-9006-468d-998d-a18df5bf4222" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:00:50 user nova-compute[73056]: DEBUG nova.network.neutron [req-490542d6-802f-4838-a3ed-3f9c4c811f55 req-6b146ffb-2edf-4f73-9d8c-ff7e359ba8af service nova] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Refreshing network info cache for port 09f698e2-41d7-4329-92b1-9a80dc461259 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 17:00:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "6c9ce215-9006-468d-998d-a18df5bf4222" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:00:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "6c9ce215-9006-468d-998d-a18df5bf4222" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:00:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "6c9ce215-9006-468d-998d-a18df5bf4222-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:00:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "6c9ce215-9006-468d-998d-a18df5bf4222-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:00:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "6c9ce215-9006-468d-998d-a18df5bf4222-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:00:50 user nova-compute[73056]: INFO nova.compute.manager [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Terminating instance
Aug 14 17:00:50 user nova-compute[73056]: DEBUG nova.compute.manager [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 17:00:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:50 user nova-compute[73056]: DEBUG nova.compute.manager [req-b2e42125-186f-4f0e-9fe8-361dc7c33ecc req-b163c89f-a29c-4cc3-a3ca-de8b8b0b7b51 service nova] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Received event network-vif-unplugged-09f698e2-41d7-4329-92b1-9a80dc461259 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:00:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-b2e42125-186f-4f0e-9fe8-361dc7c33ecc req-b163c89f-a29c-4cc3-a3ca-de8b8b0b7b51 service nova] Acquiring lock "6c9ce215-9006-468d-998d-a18df5bf4222-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:00:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-b2e42125-186f-4f0e-9fe8-361dc7c33ecc req-b163c89f-a29c-4cc3-a3ca-de8b8b0b7b51 service nova] Lock "6c9ce215-9006-468d-998d-a18df5bf4222-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:00:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-b2e42125-186f-4f0e-9fe8-361dc7c33ecc req-b163c89f-a29c-4cc3-a3ca-de8b8b0b7b51 service nova] Lock "6c9ce215-9006-468d-998d-a18df5bf4222-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:00:50 user nova-compute[73056]: DEBUG nova.compute.manager [req-b2e42125-186f-4f0e-9fe8-361dc7c33ecc req-b163c89f-a29c-4cc3-a3ca-de8b8b0b7b51 service nova] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] No waiting events found dispatching network-vif-unplugged-09f698e2-41d7-4329-92b1-9a80dc461259 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:00:50 user nova-compute[73056]: DEBUG nova.compute.manager [req-b2e42125-186f-4f0e-9fe8-361dc7c33ecc req-b163c89f-a29c-4cc3-a3ca-de8b8b0b7b51 service nova] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Received event network-vif-unplugged-09f698e2-41d7-4329-92b1-9a80dc461259 for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 17:00:50 user nova-compute[73056]: DEBUG nova.network.neutron [req-490542d6-802f-4838-a3ed-3f9c4c811f55 req-6b146ffb-2edf-4f73-9d8c-ff7e359ba8af service nova] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Updated VIF entry in instance network info cache for port 09f698e2-41d7-4329-92b1-9a80dc461259. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 17:00:50 user nova-compute[73056]: DEBUG nova.network.neutron [req-490542d6-802f-4838-a3ed-3f9c4c811f55 req-6b146ffb-2edf-4f73-9d8c-ff7e359ba8af service nova] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Updating instance_info_cache with network_info: [{"id": "09f698e2-41d7-4329-92b1-9a80dc461259", "address": "fa:16:3e:dc:48:7c", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f698e2-41", "ovs_interfaceid": "09f698e2-41d7-4329-92b1-9a80dc461259", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:00:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-490542d6-802f-4838-a3ed-3f9c4c811f55 req-6b146ffb-2edf-4f73-9d8c-ff7e359ba8af service nova] Releasing lock "refresh_cache-6c9ce215-9006-468d-998d-a18df5bf4222" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:51 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Instance destroyed successfully.
Aug 14 17:00:51 user nova-compute[73056]: DEBUG nova.objects.instance [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lazy-loading 'resources' on Instance uuid 6c9ce215-9006-468d-998d-a18df5bf4222 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:55:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-935573900',display_name='tempest-TestVolumeBootPattern-server-935573900',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-935573900',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBF9UVFrNwhQEMB/CeZfBoQaAoJOYsqM67ncFaZmWIdIzJd1Na96dOaZXAGstQENK3pBtGzJ44fKFGGhrlwWzWMk9Hm8I+KfAGKsRBWs7QP0LhARS9gNshqYVaA6cOdig==',key_name='tempest-TestVolumeBootPattern-829376797',keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:55:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cffb5203b9284500b8add8a6586cad49',ramdisk_id='',reservation_id='r-60nmlk1u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1676214558',owner_user_name='tempest-TestVolumeBootPattern-1676214558-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:55:44Z,user_data=None,user_id='2be1b098ca9f4232bd198b515630f6ad',uuid=6c9ce215-9006-468d-998d-a18df5bf4222,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09f698e2-41d7-4329-92b1-9a80dc461259", "address": "fa:16:3e:dc:48:7c", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f698e2-41", "ovs_interfaceid": "09f698e2-41d7-4329-92b1-9a80dc461259", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Converting VIF {"id": "09f698e2-41d7-4329-92b1-9a80dc461259", "address": "fa:16:3e:dc:48:7c", "network": {"id": "85766937-c63f-42f6-87b4-3fac827c9e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1179842028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cffb5203b9284500b8add8a6586cad49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f698e2-41", "ovs_interfaceid": "09f698e2-41d7-4329-92b1-9a80dc461259", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:48:7c,bridge_name='br-int',has_traffic_filtering=True,id=09f698e2-41d7-4329-92b1-9a80dc461259,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f698e2-41') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG os_vif [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:48:7c,bridge_name='br-int',has_traffic_filtering=True,id=09f698e2-41d7-4329-92b1-9a80dc461259,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f698e2-41') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09f698e2-41, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:00:51 user nova-compute[73056]: INFO os_vif [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:48:7c,bridge_name='br-int',has_traffic_filtering=True,id=09f698e2-41d7-4329-92b1-9a80dc461259,network=Network(85766937-c63f-42f6-87b4-3fac827c9e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f698e2-41')
Aug 14 17:00:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbFahCRc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 17:00:51 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 17:00:51 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[642c3312-b759-4f91-84fc-ba6e822f9ce1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a57fac9-165c-4143-b6cb-ef1898859681]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 17:00:51 user nova-compute[73056]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 17:00:51 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 (non-flash)
Aug 14 17:00:51 user nova-compute[73056]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 17:00:51 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff32fc56cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297'): ({'sdc'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Removing single pathed devices sdc {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e30a5d9-dfb9-46d4-9610-1272904bb100]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[360411a9-9461-4708-8cf1-932d93df256e]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Flushing IO for device /dev/sdc {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c33b00e-6220-4e6b-a3e4-697e1cfee66e]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e8dd2d-b9a3-4eed-b571-6957c5daf00a]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] SCSI volumes sdc have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO2cdf61c9-01c991fb66e887d3', '/dev/disk/by-id/scsi-23031633939316662', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2cdf61c9') {{(pid=83519) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[77943579-2991-4765-b713-bd9383af456e]: (4, None) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9441a9e-9eb4-4b59-8c1f-8a8842944bac]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a677da-6860-4f2c-99db-51416ed66926]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297, portal: 172.16.0.220,3260]
Aug 14 17:00:51 user nova-compute[73056]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297, portal: 172.16.0.220,3260] successful.
Aug 14 17:00:51 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6491f97-549b-46cc-9de0-96a2ad50a297 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be42fdd-4aae-4fee-8111-78d20c66383a]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] <== disconnect_volume: return (293ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 17:00:51 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Deleting instance files /opt/stack/data/nova/instances/6c9ce215-9006-468d-998d-a18df5bf4222_del
Aug 14 17:00:51 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Deletion of /opt/stack/data/nova/instances/6c9ce215-9006-468d-998d-a18df5bf4222_del complete
Aug 14 17:00:51 user nova-compute[73056]: INFO nova.compute.manager [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Took 1.21 seconds to destroy the instance on the hypervisor.
Aug 14 17:00:51 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 17:00:51 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 17:00:52 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:00:52 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Took 0.53 seconds to deallocate network for instance.
Aug 14 17:00:52 user nova-compute[73056]: DEBUG nova.compute.manager [req-2014db55-7843-4d77-ae1e-294704fb9b9a req-b45cc9d9-bd13-4016-a5cf-7df7bce35bc9 service nova] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Received event network-vif-plugged-09f698e2-41d7-4329-92b1-9a80dc461259 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:00:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2014db55-7843-4d77-ae1e-294704fb9b9a req-b45cc9d9-bd13-4016-a5cf-7df7bce35bc9 service nova] Acquiring lock "6c9ce215-9006-468d-998d-a18df5bf4222-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:00:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2014db55-7843-4d77-ae1e-294704fb9b9a req-b45cc9d9-bd13-4016-a5cf-7df7bce35bc9 service nova] Lock "6c9ce215-9006-468d-998d-a18df5bf4222-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:00:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2014db55-7843-4d77-ae1e-294704fb9b9a req-b45cc9d9-bd13-4016-a5cf-7df7bce35bc9 service nova] Lock "6c9ce215-9006-468d-998d-a18df5bf4222-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:00:52 user nova-compute[73056]: DEBUG nova.compute.manager [req-2014db55-7843-4d77-ae1e-294704fb9b9a req-b45cc9d9-bd13-4016-a5cf-7df7bce35bc9 service nova] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] No waiting events found dispatching network-vif-plugged-09f698e2-41d7-4329-92b1-9a80dc461259 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:00:52 user nova-compute[73056]: WARNING nova.compute.manager [req-2014db55-7843-4d77-ae1e-294704fb9b9a req-b45cc9d9-bd13-4016-a5cf-7df7bce35bc9 service nova] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Received unexpected event network-vif-plugged-09f698e2-41d7-4329-92b1-9a80dc461259 for instance with vm_state active and task_state deleting.
Aug 14 17:00:52 user nova-compute[73056]: DEBUG nova.compute.manager [req-2014db55-7843-4d77-ae1e-294704fb9b9a req-b45cc9d9-bd13-4016-a5cf-7df7bce35bc9 service nova] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Received event network-vif-deleted-09f698e2-41d7-4329-92b1-9a80dc461259 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:00:52 user nova-compute[73056]: INFO nova.compute.manager [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Took 0.79 seconds to detach 1 volumes for instance.
Aug 14 17:00:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:00:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:00:53 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:00:53 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:00:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.208s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:00:53 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Deleted allocations for instance 6c9ce215-9006-468d-998d-a18df5bf4222
Aug 14 17:00:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-f2579f81-23c7-4e46-8901-dcd7d58230d9 tempest-TestVolumeBootPattern-1676214558 tempest-TestVolumeBootPattern-1676214558-project-member] Lock "6c9ce215-9006-468d-998d-a18df5bf4222" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.953s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:00:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:56 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-23a98285-864a-44fd-81df-62233dc0c052 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "b580e3d0-88b5-42a3-a953-84b94c088f41" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:00:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-23a98285-864a-44fd-81df-62233dc0c052 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "b580e3d0-88b5-42a3-a953-84b94c088f41" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:00:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-23a98285-864a-44fd-81df-62233dc0c052 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:00:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-23a98285-864a-44fd-81df-62233dc0c052 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:00:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-23a98285-864a-44fd-81df-62233dc0c052 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:00:59 user nova-compute[73056]: INFO nova.compute.manager [None req-23a98285-864a-44fd-81df-62233dc0c052 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Terminating instance
Aug 14 17:00:59 user nova-compute[73056]: DEBUG nova.compute.manager [None req-23a98285-864a-44fd-81df-62233dc0c052 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 17:00:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:00:59 user nova-compute[73056]: DEBUG nova.compute.manager [req-c53faf73-827b-448f-8965-9b0a1ca65988 req-45c3b62e-3aad-4f0d-9b53-44f4fcfb55bf service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Received event network-vif-unplugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:00:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c53faf73-827b-448f-8965-9b0a1ca65988 req-45c3b62e-3aad-4f0d-9b53-44f4fcfb55bf service nova] Acquiring lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:00:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c53faf73-827b-448f-8965-9b0a1ca65988 req-45c3b62e-3aad-4f0d-9b53-44f4fcfb55bf service nova] Lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:00:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c53faf73-827b-448f-8965-9b0a1ca65988 req-45c3b62e-3aad-4f0d-9b53-44f4fcfb55bf service nova] Lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:00:59 user nova-compute[73056]: DEBUG nova.compute.manager [req-c53faf73-827b-448f-8965-9b0a1ca65988 req-45c3b62e-3aad-4f0d-9b53-44f4fcfb55bf service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] No waiting events found dispatching network-vif-unplugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:00:59 user nova-compute[73056]: DEBUG nova.compute.manager [req-c53faf73-827b-448f-8965-9b0a1ca65988 req-45c3b62e-3aad-4f0d-9b53-44f4fcfb55bf service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Received event network-vif-unplugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 17:01:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:01:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:01:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:01:00 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Instance destroyed successfully.
Aug 14 17:01:00 user nova-compute[73056]: DEBUG nova.objects.instance [None req-23a98285-864a-44fd-81df-62233dc0c052 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lazy-loading 'resources' on Instance uuid b580e3d0-88b5-42a3-a953-84b94c088f41 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:01:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:01:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-23a98285-864a-44fd-81df-62233dc0c052 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:43:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1690624150',display_name='tempest-ServerRescueNegativeTestJSON-server-1690624150',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1690624150',id=22,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:48:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09b7b0f153a945ac9ce96fe462b17fd5',ramdisk_id='',reservation_id='r-s8wct4sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-201205905',owner_user_name='tempest-ServerRescueNegativeTestJSON-201205905-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:50:36Z,user_data=None,user_id='e9f89462f2734ec48d78921ab3d654b2',uuid=b580e3d0-88b5-42a3-a953-84b94c088f41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0", "address": "fa:16:3e:f9:ca:00", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb006576a-8b", "ovs_interfaceid": "b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 17:01:00 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-23a98285-864a-44fd-81df-62233dc0c052 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Converting VIF {"id": "b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0", "address": "fa:16:3e:f9:ca:00", "network": {"id": "9f4305e9-4b75-4f5d-b1b2-f1184c408739", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1037889092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b7b0f153a945ac9ce96fe462b17fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb006576a-8b", "ovs_interfaceid": "b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:01:00 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-23a98285-864a-44fd-81df-62233dc0c052 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:ca:00,bridge_name='br-int',has_traffic_filtering=True,id=b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0,network=Network(9f4305e9-4b75-4f5d-b1b2-f1184c408739),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb006576a-8b') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:01:00 user nova-compute[73056]: DEBUG os_vif [None req-23a98285-864a-44fd-81df-62233dc0c052 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:ca:00,bridge_name='br-int',has_traffic_filtering=True,id=b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0,network=Network(9f4305e9-4b75-4f5d-b1b2-f1184c408739),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb006576a-8b') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 17:01:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:01:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb006576a-8b, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:01:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:01:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:01:00 user nova-compute[73056]: INFO os_vif [None req-23a98285-864a-44fd-81df-62233dc0c052 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:ca:00,bridge_name='br-int',has_traffic_filtering=True,id=b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0,network=Network(9f4305e9-4b75-4f5d-b1b2-f1184c408739),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb006576a-8b')
Aug 14 17:01:00 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-23a98285-864a-44fd-81df-62233dc0c052 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Deleting instance files /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41_del
Aug 14 17:01:00 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-23a98285-864a-44fd-81df-62233dc0c052 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Deletion of /opt/stack/data/nova/instances/b580e3d0-88b5-42a3-a953-84b94c088f41_del complete
Aug 14 17:01:00 user nova-compute[73056]: INFO nova.compute.manager [None req-23a98285-864a-44fd-81df-62233dc0c052 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 14 17:01:00 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-23a98285-864a-44fd-81df-62233dc0c052 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 17:01:00 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 17:01:00 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 17:01:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:01:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:01:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:01:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:01:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:01:00 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:01:00 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Took 0.67 seconds to deallocate network for instance.
Aug 14 17:01:00 user nova-compute[73056]: DEBUG nova.compute.manager [req-0182b399-908f-44af-8d9e-7f23837cbba4 req-a7ca8b5d-2f4b-41fb-b993-f73f9da2ded1 service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Received event network-vif-deleted-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:01:00 user nova-compute[73056]: INFO nova.compute.manager [req-0182b399-908f-44af-8d9e-7f23837cbba4 req-a7ca8b5d-2f4b-41fb-b993-f73f9da2ded1 service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Neutron deleted interface b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0; detaching it from the instance and deleting it from the info cache
Aug 14 17:01:00 user nova-compute[73056]: DEBUG nova.network.neutron [req-0182b399-908f-44af-8d9e-7f23837cbba4 req-a7ca8b5d-2f4b-41fb-b993-f73f9da2ded1 service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:01:00 user nova-compute[73056]: DEBUG nova.compute.manager [req-0182b399-908f-44af-8d9e-7f23837cbba4 req-a7ca8b5d-2f4b-41fb-b993-f73f9da2ded1 service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Detach interface failed, port_id=b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0, reason: Instance b580e3d0-88b5-42a3-a953-84b94c088f41 could not be found. {{(pid=73056) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 17:01:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-23a98285-864a-44fd-81df-62233dc0c052 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:01:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-23a98285-864a-44fd-81df-62233dc0c052 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:01:01 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-23a98285-864a-44fd-81df-62233dc0c052 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:01:01 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-23a98285-864a-44fd-81df-62233dc0c052 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:01:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-23a98285-864a-44fd-81df-62233dc0c052 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.169s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:01:01 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-23a98285-864a-44fd-81df-62233dc0c052 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Deleted allocations for instance b580e3d0-88b5-42a3-a953-84b94c088f41
Aug 14 17:01:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-23a98285-864a-44fd-81df-62233dc0c052 tempest-ServerRescueNegativeTestJSON-201205905 tempest-ServerRescueNegativeTestJSON-201205905-project-member] Lock "b580e3d0-88b5-42a3-a953-84b94c088f41" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.873s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:01:01 user nova-compute[73056]: DEBUG nova.compute.manager [req-bc2646a4-3c2e-4562-b761-80180d4ea705 req-45fda54c-cee0-4426-b862-077cb3fff51e service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Received event network-vif-plugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:01:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-bc2646a4-3c2e-4562-b761-80180d4ea705 req-45fda54c-cee0-4426-b862-077cb3fff51e service nova] Acquiring lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:01:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-bc2646a4-3c2e-4562-b761-80180d4ea705 req-45fda54c-cee0-4426-b862-077cb3fff51e service nova] Lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:01:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-bc2646a4-3c2e-4562-b761-80180d4ea705 req-45fda54c-cee0-4426-b862-077cb3fff51e service nova] Lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:01:01 user nova-compute[73056]: DEBUG nova.compute.manager [req-bc2646a4-3c2e-4562-b761-80180d4ea705 req-45fda54c-cee0-4426-b862-077cb3fff51e service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] No waiting events found dispatching network-vif-plugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:01:01 user nova-compute[73056]: WARNING nova.compute.manager [req-bc2646a4-3c2e-4562-b761-80180d4ea705 req-45fda54c-cee0-4426-b862-077cb3fff51e service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Received unexpected event network-vif-plugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 for instance with vm_state deleted and task_state None.
Aug 14 17:01:01 user nova-compute[73056]: DEBUG nova.compute.manager [req-bc2646a4-3c2e-4562-b761-80180d4ea705 req-45fda54c-cee0-4426-b862-077cb3fff51e service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Received event network-vif-plugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:01:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-bc2646a4-3c2e-4562-b761-80180d4ea705 req-45fda54c-cee0-4426-b862-077cb3fff51e service nova] Acquiring lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:01:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-bc2646a4-3c2e-4562-b761-80180d4ea705 req-45fda54c-cee0-4426-b862-077cb3fff51e service nova] Lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:01:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-bc2646a4-3c2e-4562-b761-80180d4ea705 req-45fda54c-cee0-4426-b862-077cb3fff51e service nova] Lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:01:01 user nova-compute[73056]: DEBUG nova.compute.manager [req-bc2646a4-3c2e-4562-b761-80180d4ea705 req-45fda54c-cee0-4426-b862-077cb3fff51e service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] No waiting events found dispatching network-vif-plugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:01:01 user nova-compute[73056]: WARNING nova.compute.manager [req-bc2646a4-3c2e-4562-b761-80180d4ea705 req-45fda54c-cee0-4426-b862-077cb3fff51e service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Received unexpected event network-vif-plugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 for instance with vm_state deleted and task_state None.
Aug 14 17:01:01 user nova-compute[73056]: DEBUG nova.compute.manager [req-bc2646a4-3c2e-4562-b761-80180d4ea705 req-45fda54c-cee0-4426-b862-077cb3fff51e service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Received event network-vif-plugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:01:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-bc2646a4-3c2e-4562-b761-80180d4ea705 req-45fda54c-cee0-4426-b862-077cb3fff51e service nova] Acquiring lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:01:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-bc2646a4-3c2e-4562-b761-80180d4ea705 req-45fda54c-cee0-4426-b862-077cb3fff51e service nova] Lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:01:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-bc2646a4-3c2e-4562-b761-80180d4ea705 req-45fda54c-cee0-4426-b862-077cb3fff51e service nova] Lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:01:01 user nova-compute[73056]: DEBUG nova.compute.manager [req-bc2646a4-3c2e-4562-b761-80180d4ea705 req-45fda54c-cee0-4426-b862-077cb3fff51e service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] No waiting events found dispatching network-vif-plugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:01:01 user nova-compute[73056]: WARNING nova.compute.manager [req-bc2646a4-3c2e-4562-b761-80180d4ea705 req-45fda54c-cee0-4426-b862-077cb3fff51e service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Received unexpected event network-vif-plugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 for instance with vm_state deleted and task_state None.
Aug 14 17:01:01 user nova-compute[73056]: DEBUG nova.compute.manager [req-bc2646a4-3c2e-4562-b761-80180d4ea705 req-45fda54c-cee0-4426-b862-077cb3fff51e service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Received event network-vif-unplugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:01:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-bc2646a4-3c2e-4562-b761-80180d4ea705 req-45fda54c-cee0-4426-b862-077cb3fff51e service nova] Acquiring lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:01:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-bc2646a4-3c2e-4562-b761-80180d4ea705 req-45fda54c-cee0-4426-b862-077cb3fff51e service nova] Lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:01:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-bc2646a4-3c2e-4562-b761-80180d4ea705 req-45fda54c-cee0-4426-b862-077cb3fff51e service nova] Lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:01:01 user nova-compute[73056]: DEBUG nova.compute.manager [req-bc2646a4-3c2e-4562-b761-80180d4ea705 req-45fda54c-cee0-4426-b862-077cb3fff51e service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] No waiting events found dispatching network-vif-unplugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:01:01 user nova-compute[73056]: WARNING nova.compute.manager [req-bc2646a4-3c2e-4562-b761-80180d4ea705 req-45fda54c-cee0-4426-b862-077cb3fff51e service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Received unexpected event network-vif-unplugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 for instance with vm_state deleted and task_state None.
Aug 14 17:01:01 user nova-compute[73056]: DEBUG nova.compute.manager [req-bc2646a4-3c2e-4562-b761-80180d4ea705 req-45fda54c-cee0-4426-b862-077cb3fff51e service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Received event network-vif-plugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:01:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-bc2646a4-3c2e-4562-b761-80180d4ea705 req-45fda54c-cee0-4426-b862-077cb3fff51e service nova] Acquiring lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:01:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-bc2646a4-3c2e-4562-b761-80180d4ea705 req-45fda54c-cee0-4426-b862-077cb3fff51e service nova] Lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:01:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-bc2646a4-3c2e-4562-b761-80180d4ea705 req-45fda54c-cee0-4426-b862-077cb3fff51e service nova] Lock "b580e3d0-88b5-42a3-a953-84b94c088f41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:01:01 user nova-compute[73056]: DEBUG nova.compute.manager [req-bc2646a4-3c2e-4562-b761-80180d4ea705 req-45fda54c-cee0-4426-b862-077cb3fff51e service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] No waiting events found dispatching network-vif-plugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:01:01 user nova-compute[73056]: WARNING nova.compute.manager [req-bc2646a4-3c2e-4562-b761-80180d4ea705 req-45fda54c-cee0-4426-b862-077cb3fff51e service nova] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Received unexpected event network-vif-plugged-b006576a-8b4c-4e1a-8c43-7dddbb7b8fa0 for instance with vm_state deleted and task_state None.
Aug 14 17:01:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:01:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:01:05 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:01:05 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:01:05 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 17:01:06 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692032451.1309114, 6c9ce215-9006-468d-998d-a18df5bf4222 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:01:06 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] VM Stopped (Lifecycle Event)
Aug 14 17:01:06 user nova-compute[73056]: DEBUG nova.compute.manager [None req-b276687e-c817-4bc8-97c5-5ba2014cd8a6 None None] [instance: 6c9ce215-9006-468d-998d-a18df5bf4222] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:01:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:01:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:01:10 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:01:12 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:01:12 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 17:01:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:01:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:01:12 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 17:01:13 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Updating instance_info_cache with network_info: [{"id": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "address": "fa:16:3e:24:f8:f3", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9ed6a8-5d", "ovs_interfaceid": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:01:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:01:13 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 17:01:13 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:01:15 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692032460.182504, b580e3d0-88b5-42a3-a953-84b94c088f41 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:01:15 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] VM Stopped (Lifecycle Event)
Aug 14 17:01:15 user nova-compute[73056]: DEBUG nova.compute.manager [None req-9be8d8f9-5048-4648-a4f7-7d3714f53d03 None None] [instance: b580e3d0-88b5-42a3-a953-84b94c088f41] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:01:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:01:15 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:01:15 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:01:15 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:01:15 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:01:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:01:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:01:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:01:15 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 17:01:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:01:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:01:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:01:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:01:15 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 17:01:15 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb1a193b-73b7-4690-8571-be9af04b3b14/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:01:16 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb1a193b-73b7-4690-8571-be9af04b3b14/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:01:16 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb1a193b-73b7-4690-8571-be9af04b3b14/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:01:16 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb1a193b-73b7-4690-8571-be9af04b3b14/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:01:16 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:01:16 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:01:16 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:01:16 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:01:16 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:01:16 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:01:16 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=8341MB free_disk=25.162132263183594GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 17:01:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:01:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:01:17 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 5191b082-a6f3-467c-b28b-fda85e15f330 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:01:17 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance fb1a193b-73b7-4690-8571-be9af04b3b14 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:01:17 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:01:17 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 17:01:17 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 17:01:17 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:01:17 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:01:17 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 17:01:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.250s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:01:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:01:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:01:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:01:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:01:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:01:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:01:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:01:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:01:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:01:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:01:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:01:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:01:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:01:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:01:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:01:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:01:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:02:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:02:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:02:07 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:02:07 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:02:07 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 17:02:08 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:02:08 user nova-compute[73056]: INFO nova.compute.manager [None req-9d7b569e-9ee6-42dd-bdfd-f6af5a59294f tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Unrescuing
Aug 14 17:02:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9d7b569e-9ee6-42dd-bdfd-f6af5a59294f tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "refresh_cache-fb1a193b-73b7-4690-8571-be9af04b3b14" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:02:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9d7b569e-9ee6-42dd-bdfd-f6af5a59294f tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquired lock "refresh_cache-fb1a193b-73b7-4690-8571-be9af04b3b14" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:02:08 user nova-compute[73056]: DEBUG nova.network.neutron [None req-9d7b569e-9ee6-42dd-bdfd-f6af5a59294f tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 17:02:09 user nova-compute[73056]: DEBUG nova.network.neutron [None req-9d7b569e-9ee6-42dd-bdfd-f6af5a59294f tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Updating instance_info_cache with network_info: [{"id": "852ab20a-9a1b-47c5-b85e-52a44fff3e36", "address": "fa:16:3e:32:95:fb", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852ab20a-9a", "ovs_interfaceid": "852ab20a-9a1b-47c5-b85e-52a44fff3e36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:02:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9d7b569e-9ee6-42dd-bdfd-f6af5a59294f tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Releasing lock "refresh_cache-fb1a193b-73b7-4690-8571-be9af04b3b14" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:02:09 user nova-compute[73056]: DEBUG nova.objects.instance [None req-9d7b569e-9ee6-42dd-bdfd-f6af5a59294f tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lazy-loading 'flavor' on Instance uuid fb1a193b-73b7-4690-8571-be9af04b3b14 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:02:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:02:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:02:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:02:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:02:09 user nova-compute[73056]: DEBUG nova.compute.manager [req-24a2d8cc-2309-4514-9883-34dddc95db18 req-5caed0a4-f3a6-4e8e-91d4-3c82621330e5 service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Received event network-vif-unplugged-852ab20a-9a1b-47c5-b85e-52a44fff3e36 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:02:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-24a2d8cc-2309-4514-9883-34dddc95db18 req-5caed0a4-f3a6-4e8e-91d4-3c82621330e5 service nova] Acquiring lock "fb1a193b-73b7-4690-8571-be9af04b3b14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:02:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-24a2d8cc-2309-4514-9883-34dddc95db18 req-5caed0a4-f3a6-4e8e-91d4-3c82621330e5 service nova] Lock "fb1a193b-73b7-4690-8571-be9af04b3b14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:02:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-24a2d8cc-2309-4514-9883-34dddc95db18 req-5caed0a4-f3a6-4e8e-91d4-3c82621330e5 service nova] Lock "fb1a193b-73b7-4690-8571-be9af04b3b14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:02:09 user nova-compute[73056]: DEBUG nova.compute.manager [req-24a2d8cc-2309-4514-9883-34dddc95db18 req-5caed0a4-f3a6-4e8e-91d4-3c82621330e5 service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] No waiting events found dispatching network-vif-unplugged-852ab20a-9a1b-47c5-b85e-52a44fff3e36 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:02:09 user nova-compute[73056]: WARNING nova.compute.manager [req-24a2d8cc-2309-4514-9883-34dddc95db18 req-5caed0a4-f3a6-4e8e-91d4-3c82621330e5 service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Received unexpected event network-vif-unplugged-852ab20a-9a1b-47c5-b85e-52a44fff3e36 for instance with vm_state rescued and task_state unrescuing.
Aug 14 17:02:10 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Instance destroyed successfully.
Aug 14 17:02:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:02:10 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:02:11 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:02:11 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:02:11 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:02:11 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:02:11 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:02:11 user nova-compute[73056]: DEBUG nova.compute.manager [req-497a9c24-b4b6-42c7-8c11-744de9b79f2d req-a1bdfa38-f6bf-41ba-96e5-e249a6bca10b service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Received event network-vif-plugged-852ab20a-9a1b-47c5-b85e-52a44fff3e36 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:02:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-497a9c24-b4b6-42c7-8c11-744de9b79f2d req-a1bdfa38-f6bf-41ba-96e5-e249a6bca10b service nova] Acquiring lock "fb1a193b-73b7-4690-8571-be9af04b3b14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:02:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-497a9c24-b4b6-42c7-8c11-744de9b79f2d req-a1bdfa38-f6bf-41ba-96e5-e249a6bca10b service nova] Lock "fb1a193b-73b7-4690-8571-be9af04b3b14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:02:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-497a9c24-b4b6-42c7-8c11-744de9b79f2d req-a1bdfa38-f6bf-41ba-96e5-e249a6bca10b service nova] Lock "fb1a193b-73b7-4690-8571-be9af04b3b14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:02:12 user nova-compute[73056]: DEBUG nova.compute.manager [req-497a9c24-b4b6-42c7-8c11-744de9b79f2d req-a1bdfa38-f6bf-41ba-96e5-e249a6bca10b service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] No waiting events found dispatching network-vif-plugged-852ab20a-9a1b-47c5-b85e-52a44fff3e36 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:02:12 user nova-compute[73056]: WARNING nova.compute.manager [req-497a9c24-b4b6-42c7-8c11-744de9b79f2d req-a1bdfa38-f6bf-41ba-96e5-e249a6bca10b service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Received unexpected event network-vif-plugged-852ab20a-9a1b-47c5-b85e-52a44fff3e36 for instance with vm_state rescued and task_state unrescuing.
Aug 14 17:02:12 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:02:12 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 17:02:12 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Rebuilding the list of instances to heal {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 17:02:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-5191b082-a6f3-467c-b28b-fda85e15f330" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:02:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-5191b082-a6f3-467c-b28b-fda85e15f330" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:02:12 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 17:02:12 user nova-compute[73056]: DEBUG nova.objects.instance [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lazy-loading 'info_cache' on Instance uuid 5191b082-a6f3-467c-b28b-fda85e15f330 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:02:12 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Updating instance_info_cache with network_info: [{"id": "dee958cc-5a62-479c-8429-4c503bef3672", "address": "fa:16:3e:3e:a3:b5", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee958cc-5a", "ovs_interfaceid": "dee958cc-5a62-479c-8429-4c503bef3672", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:02:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-5191b082-a6f3-467c-b28b-fda85e15f330" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:02:12 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 17:02:12 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:02:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:02:13 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Removed pending event for fb1a193b-73b7-4690-8571-be9af04b3b14 due to event {{(pid=73056) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 17:02:13 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692032533.5310948, fb1a193b-73b7-4690-8571-be9af04b3b14 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:02:13 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] VM Resumed (Lifecycle Event)
Aug 14 17:02:13 user nova-compute[73056]: DEBUG nova.compute.manager [None req-9d7b569e-9ee6-42dd-bdfd-f6af5a59294f tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:02:13 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:02:13 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 17:02:13 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 17:02:13 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692032533.5324385, fb1a193b-73b7-4690-8571-be9af04b3b14 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:02:13 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] VM Started (Lifecycle Event)
Aug 14 17:02:13 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:02:13 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 17:02:14 user nova-compute[73056]: DEBUG nova.compute.manager [req-142107a8-f41f-4356-bafa-019272afaa26 req-02d188d9-9d6d-4110-b059-a19c6a8a06ae service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Received event network-vif-plugged-852ab20a-9a1b-47c5-b85e-52a44fff3e36 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:02:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-142107a8-f41f-4356-bafa-019272afaa26 req-02d188d9-9d6d-4110-b059-a19c6a8a06ae service nova] Acquiring lock "fb1a193b-73b7-4690-8571-be9af04b3b14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:02:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-142107a8-f41f-4356-bafa-019272afaa26 req-02d188d9-9d6d-4110-b059-a19c6a8a06ae service nova] Lock "fb1a193b-73b7-4690-8571-be9af04b3b14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:02:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-142107a8-f41f-4356-bafa-019272afaa26 req-02d188d9-9d6d-4110-b059-a19c6a8a06ae service nova] Lock "fb1a193b-73b7-4690-8571-be9af04b3b14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:02:14 user nova-compute[73056]: DEBUG nova.compute.manager [req-142107a8-f41f-4356-bafa-019272afaa26 req-02d188d9-9d6d-4110-b059-a19c6a8a06ae service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] No waiting events found dispatching network-vif-plugged-852ab20a-9a1b-47c5-b85e-52a44fff3e36 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:02:14 user nova-compute[73056]: WARNING nova.compute.manager [req-142107a8-f41f-4356-bafa-019272afaa26 req-02d188d9-9d6d-4110-b059-a19c6a8a06ae service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Received unexpected event network-vif-plugged-852ab20a-9a1b-47c5-b85e-52a44fff3e36 for instance with vm_state active and task_state None.
Aug 14 17:02:14 user nova-compute[73056]: DEBUG nova.compute.manager [req-142107a8-f41f-4356-bafa-019272afaa26 req-02d188d9-9d6d-4110-b059-a19c6a8a06ae service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Received event network-vif-plugged-852ab20a-9a1b-47c5-b85e-52a44fff3e36 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:02:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-142107a8-f41f-4356-bafa-019272afaa26 req-02d188d9-9d6d-4110-b059-a19c6a8a06ae service nova] Acquiring lock "fb1a193b-73b7-4690-8571-be9af04b3b14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:02:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-142107a8-f41f-4356-bafa-019272afaa26 req-02d188d9-9d6d-4110-b059-a19c6a8a06ae service nova] Lock "fb1a193b-73b7-4690-8571-be9af04b3b14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:02:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-142107a8-f41f-4356-bafa-019272afaa26 req-02d188d9-9d6d-4110-b059-a19c6a8a06ae service nova] Lock "fb1a193b-73b7-4690-8571-be9af04b3b14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:02:14 user nova-compute[73056]: DEBUG nova.compute.manager [req-142107a8-f41f-4356-bafa-019272afaa26 req-02d188d9-9d6d-4110-b059-a19c6a8a06ae service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] No waiting events found dispatching network-vif-plugged-852ab20a-9a1b-47c5-b85e-52a44fff3e36 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:02:14 user nova-compute[73056]: WARNING nova.compute.manager [req-142107a8-f41f-4356-bafa-019272afaa26 req-02d188d9-9d6d-4110-b059-a19c6a8a06ae service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Received unexpected event network-vif-plugged-852ab20a-9a1b-47c5-b85e-52a44fff3e36 for instance with vm_state active and task_state None.
Aug 14 17:02:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:02:15 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:02:16 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:02:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a7095062-4b4a-4223-91bd-c8ea67ad4440 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:02:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a7095062-4b4a-4223-91bd-c8ea67ad4440 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:02:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a7095062-4b4a-4223-91bd-c8ea67ad4440 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:02:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a7095062-4b4a-4223-91bd-c8ea67ad4440 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:02:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a7095062-4b4a-4223-91bd-c8ea67ad4440 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:02:17 user nova-compute[73056]: INFO nova.compute.manager [None req-a7095062-4b4a-4223-91bd-c8ea67ad4440 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Terminating instance
Aug 14 17:02:17 user nova-compute[73056]: DEBUG nova.compute.manager [None req-a7095062-4b4a-4223-91bd-c8ea67ad4440 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 17:02:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:02:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:02:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:02:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:02:17 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:02:17 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:02:17 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:02:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:02:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:02:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:02:17 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 17:02:17 user nova-compute[73056]: DEBUG nova.compute.manager [req-c23882c9-2e7e-4fc9-b0b2-741d3daade29 req-74028435-c2c4-4465-b721-d7d68030b90b service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Received event network-vif-unplugged-2f9ed6a8-5d92-4e63-9c4e-2658d1cec310 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:02:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c23882c9-2e7e-4fc9-b0b2-741d3daade29 req-74028435-c2c4-4465-b721-d7d68030b90b service nova] Acquiring lock "e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:02:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c23882c9-2e7e-4fc9-b0b2-741d3daade29 req-74028435-c2c4-4465-b721-d7d68030b90b service nova] Lock "e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:02:17 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-c23882c9-2e7e-4fc9-b0b2-741d3daade29 req-74028435-c2c4-4465-b721-d7d68030b90b service nova] Lock "e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:02:17 user nova-compute[73056]: DEBUG nova.compute.manager [req-c23882c9-2e7e-4fc9-b0b2-741d3daade29 req-74028435-c2c4-4465-b721-d7d68030b90b service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] No waiting events found dispatching network-vif-unplugged-2f9ed6a8-5d92-4e63-9c4e-2658d1cec310 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:02:17 user nova-compute[73056]: DEBUG nova.compute.manager [req-c23882c9-2e7e-4fc9-b0b2-741d3daade29 req-74028435-c2c4-4465-b721-d7d68030b90b service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Received event network-vif-unplugged-2f9ed6a8-5d92-4e63-9c4e-2658d1cec310 for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 17:02:17 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Instance destroyed successfully.
Aug 14 17:02:17 user nova-compute[73056]: DEBUG nova.objects.instance [None req-a7095062-4b4a-4223-91bd-c8ea67ad4440 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lazy-loading 'resources' on Instance uuid e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:02:17 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-a7095062-4b4a-4223-91bd-c8ea67ad4440 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T16:56:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-948039001',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-948039001',id=41,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHYNBfnC2ikOrzBY4cz5LLIum5X5oxpuFuwOJsgbUapOe+ZhLzeRuq82OuvfQs1nq2h3Js5eBhWIRwcRYkBy8csHsKYVKBxxR6b3mKZP/TEs4IfBOUR0BP2bP1OopKMnUA==',key_name='tempest-keypair-707146351',keypairs=<?>,launch_index=0,launched_at=2023-08-14T17:00:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c67a1c8fcd97416e90f6b5a50a886a75',ramdisk_id='',reservation_id='r-p59njr5z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1935390723',owner_user_name='tempest-AttachVolumeShelveTestJSON-1935390723-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T17:00:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a20dd4c88984674996e26fdcfa4f126',uuid=e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "address": "fa:16:3e:24:f8:f3", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9ed6a8-5d", "ovs_interfaceid": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 17:02:17 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-a7095062-4b4a-4223-91bd-c8ea67ad4440 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Converting VIF {"id": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "address": "fa:16:3e:24:f8:f3", "network": {"id": "20384d1d-92c0-4ac7-a993-956fa784cd87", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074151111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67a1c8fcd97416e90f6b5a50a886a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9ed6a8-5d", "ovs_interfaceid": "2f9ed6a8-5d92-4e63-9c4e-2658d1cec310", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:02:17 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-a7095062-4b4a-4223-91bd-c8ea67ad4440 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:f8:f3,bridge_name='br-int',has_traffic_filtering=True,id=2f9ed6a8-5d92-4e63-9c4e-2658d1cec310,network=Network(20384d1d-92c0-4ac7-a993-956fa784cd87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f9ed6a8-5d') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:02:17 user nova-compute[73056]: DEBUG os_vif [None req-a7095062-4b4a-4223-91bd-c8ea67ad4440 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:f8:f3,bridge_name='br-int',has_traffic_filtering=True,id=2f9ed6a8-5d92-4e63-9c4e-2658d1cec310,network=Network(20384d1d-92c0-4ac7-a993-956fa784cd87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f9ed6a8-5d') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 17:02:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:02:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f9ed6a8-5d, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:02:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:02:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:02:17 user nova-compute[73056]: INFO os_vif [None req-a7095062-4b4a-4223-91bd-c8ea67ad4440 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:f8:f3,bridge_name='br-int',has_traffic_filtering=True,id=2f9ed6a8-5d92-4e63-9c4e-2658d1cec310,network=Network(20384d1d-92c0-4ac7-a993-956fa784cd87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f9ed6a8-5d')
Aug 14 17:02:17 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-a7095062-4b4a-4223-91bd-c8ea67ad4440 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Deleting instance files /opt/stack/data/nova/instances/e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3_del
Aug 14 17:02:17 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-a7095062-4b4a-4223-91bd-c8ea67ad4440 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Deletion of /opt/stack/data/nova/instances/e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3_del complete
Aug 14 17:02:18 user nova-compute[73056]: INFO nova.compute.manager [None req-a7095062-4b4a-4223-91bd-c8ea67ad4440 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 14 17:02:18 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-a7095062-4b4a-4223-91bd-c8ea67ad4440 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 17:02:18 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 17:02:18 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 17:02:18 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Error from libvirt while getting description of instance-00000029: [Error Code 42] Domain not found: no domain with matching uuid 'e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3' (instance-00000029): libvirt.libvirtError: Domain not found: no domain with matching uuid 'e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3' (instance-00000029)
Aug 14 17:02:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 17:02:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:02:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:02:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:02:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:02:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:02:18 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:02:18 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:02:18 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=8592MB free_disk=25.152606964111328GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 17:02:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:02:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:02:18 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:02:19 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Took 0.97 seconds to deallocate network for instance.
Aug 14 17:02:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a7095062-4b4a-4223-91bd-c8ea67ad4440 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:02:19 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 5191b082-a6f3-467c-b28b-fda85e15f330 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:02:19 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance fb1a193b-73b7-4690-8571-be9af04b3b14 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:02:19 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:02:19 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 17:02:19 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 17:02:19 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:02:19 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:02:19 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 17:02:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.451s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:02:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a7095062-4b4a-4223-91bd-c8ea67ad4440 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.286s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:02:19 user nova-compute[73056]: DEBUG nova.compute.manager [req-a622927f-47ba-41e5-93f7-de638a9c389c req-e643dbef-2b25-4ca2-afb9-ff91c163df53 service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Received event network-vif-plugged-2f9ed6a8-5d92-4e63-9c4e-2658d1cec310 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:02:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a622927f-47ba-41e5-93f7-de638a9c389c req-e643dbef-2b25-4ca2-afb9-ff91c163df53 service nova] Acquiring lock "e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:02:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a622927f-47ba-41e5-93f7-de638a9c389c req-e643dbef-2b25-4ca2-afb9-ff91c163df53 service nova] Lock "e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:02:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a622927f-47ba-41e5-93f7-de638a9c389c req-e643dbef-2b25-4ca2-afb9-ff91c163df53 service nova] Lock "e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:02:19 user nova-compute[73056]: DEBUG nova.compute.manager [req-a622927f-47ba-41e5-93f7-de638a9c389c req-e643dbef-2b25-4ca2-afb9-ff91c163df53 service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] No waiting events found dispatching network-vif-plugged-2f9ed6a8-5d92-4e63-9c4e-2658d1cec310 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:02:19 user nova-compute[73056]: WARNING nova.compute.manager [req-a622927f-47ba-41e5-93f7-de638a9c389c req-e643dbef-2b25-4ca2-afb9-ff91c163df53 service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Received unexpected event network-vif-plugged-2f9ed6a8-5d92-4e63-9c4e-2658d1cec310 for instance with vm_state deleted and task_state None.
Aug 14 17:02:19 user nova-compute[73056]: DEBUG nova.compute.manager [req-a622927f-47ba-41e5-93f7-de638a9c389c req-e643dbef-2b25-4ca2-afb9-ff91c163df53 service nova] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Received event network-vif-deleted-2f9ed6a8-5d92-4e63-9c4e-2658d1cec310 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:02:19 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-a7095062-4b4a-4223-91bd-c8ea67ad4440 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:02:19 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-a7095062-4b4a-4223-91bd-c8ea67ad4440 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:02:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a7095062-4b4a-4223-91bd-c8ea67ad4440 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.159s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:02:19 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-a7095062-4b4a-4223-91bd-c8ea67ad4440 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Deleted allocations for instance e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3
Aug 14 17:02:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a7095062-4b4a-4223-91bd-c8ea67ad4440 tempest-AttachVolumeShelveTestJSON-1935390723 tempest-AttachVolumeShelveTestJSON-1935390723-project-member] Lock "e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.534s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:02:22 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:02:23 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:02:23 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73056) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 17:02:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:02:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:02:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:02:32 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692032537.8528287, e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:02:32 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] VM Stopped (Lifecycle Event)
Aug 14 17:02:32 user nova-compute[73056]: DEBUG nova.compute.manager [None req-2e9f2cf3-1933-46d3-8531-3f0a61cbcb43 None None] [instance: e984d6e2-1e2c-46ea-ab93-3c6fc7d208d3] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:02:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:02:37 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:02:38 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:02:38 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Cleaning up deleted instances {{(pid=73056) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 17:02:38 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] There are 0 instances to clean {{(pid=73056) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 17:02:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:02:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:02:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:02:52 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:02:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:02:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:03:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:03:06 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:03:06 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:03:06 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 17:03:06 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:03:06 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Triggering sync for uuid 5191b082-a6f3-467c-b28b-fda85e15f330 {{(pid=73056) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 17:03:06 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Triggering sync for uuid fb1a193b-73b7-4690-8571-be9af04b3b14 {{(pid=73056) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 17:03:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "5191b082-a6f3-467c-b28b-fda85e15f330" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:03:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "5191b082-a6f3-467c-b28b-fda85e15f330" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:03:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "fb1a193b-73b7-4690-8571-be9af04b3b14" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:03:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "fb1a193b-73b7-4690-8571-be9af04b3b14" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:03:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "5191b082-a6f3-467c-b28b-fda85e15f330" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:03:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "fb1a193b-73b7-4690-8571-be9af04b3b14" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:03:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:10 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:03:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:03:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:03:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:03:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:03:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:13 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:03:13 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 17:03:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-fb1a193b-73b7-4690-8571-be9af04b3b14" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:03:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-fb1a193b-73b7-4690-8571-be9af04b3b14" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:03:13 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 17:03:13 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Updating instance_info_cache with network_info: [{"id": "852ab20a-9a1b-47c5-b85e-52a44fff3e36", "address": "fa:16:3e:32:95:fb", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852ab20a-9a", "ovs_interfaceid": "852ab20a-9a1b-47c5-b85e-52a44fff3e36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:03:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-fb1a193b-73b7-4690-8571-be9af04b3b14" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:03:13 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 17:03:13 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:03:15 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:03:17 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:03:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:03:19 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:03:19 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:03:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:03:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:03:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:03:19 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 17:03:19 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 17:03:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:03:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:03:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:03:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:03:20 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:03:20 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:03:20 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=8622MB free_disk=25.17739486694336GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 17:03:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:03:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:03:20 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 5191b082-a6f3-467c-b28b-fda85e15f330 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:03:20 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance fb1a193b-73b7-4690-8571-be9af04b3b14 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:03:20 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 17:03:20 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 17:03:20 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Refreshing inventories for resource provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 17:03:20 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Updating ProviderTree inventory for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 17:03:20 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Updating inventory in ProviderTree for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 17:03:20 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Refreshing aggregate associations for resource provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b, aggregates: None {{(pid=73056) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 17:03:20 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Refreshing trait associations for resource provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=73056) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 17:03:20 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:03:20 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:03:20 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 17:03:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.363s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:03:22 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:31 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "57225bb2-dbce-4212-b363-8dc34af05cce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:03:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "57225bb2-dbce-4212-b363-8dc34af05cce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:03:34 user nova-compute[73056]: DEBUG nova.compute.manager [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 17:03:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:03:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:03:34 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 17:03:34 user nova-compute[73056]: INFO nova.compute.claims [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Claim successful on node user
Aug 14 17:03:34 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:03:34 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:03:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.270s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:03:34 user nova-compute[73056]: DEBUG nova.compute.manager [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 17:03:34 user nova-compute[73056]: DEBUG nova.compute.manager [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 17:03:34 user nova-compute[73056]: DEBUG nova.network.neutron [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 17:03:35 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 17:03:35 user nova-compute[73056]: DEBUG nova.compute.manager [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 17:03:35 user nova-compute[73056]: DEBUG nova.compute.manager [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 17:03:35 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 17:03:35 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Creating image(s)
Aug 14 17:03:35 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "/opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:03:35 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "/opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:03:35 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "/opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:03:35 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:03:35 user nova-compute[73056]: DEBUG nova.policy [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0bf4bfed609343c78b0d828db45d5ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415a7291b35546b5ac324280d37d50ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 17:03:35 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.188s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:03:35 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "c889592ab94cd0b0ce896f27a2af0323771db234" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:03:35 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:03:35 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:03:35 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.168s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:03:35 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:03:35 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk 1073741824" returned: 0 in 0.047s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:03:35 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:03:35 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:03:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.181s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:03:36 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Checking if we can resize image /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 17:03:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:03:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:03:36 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Cannot resize image /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 17:03:36 user nova-compute[73056]: DEBUG nova.objects.instance [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lazy-loading 'migration_context' on Instance uuid 57225bb2-dbce-4212-b363-8dc34af05cce {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:03:36 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 17:03:36 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Ensure instance console log exists: /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 17:03:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:03:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:03:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:03:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:36 user nova-compute[73056]: DEBUG nova.network.neutron [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Successfully created port: 2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG nova.network.neutron [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Successfully updated port: 2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "refresh_cache-57225bb2-dbce-4212-b363-8dc34af05cce" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquired lock "refresh_cache-57225bb2-dbce-4212-b363-8dc34af05cce" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG nova.network.neutron [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG nova.compute.manager [req-6ba6d5ad-c7de-4073-8a70-7c7e70392362 req-d3b4c427-da44-42a5-b144-6e5048772351 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received event network-changed-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG nova.compute.manager [req-6ba6d5ad-c7de-4073-8a70-7c7e70392362 req-d3b4c427-da44-42a5-b144-6e5048772351 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Refreshing instance network info cache due to event network-changed-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6ba6d5ad-c7de-4073-8a70-7c7e70392362 req-d3b4c427-da44-42a5-b144-6e5048772351 service nova] Acquiring lock "refresh_cache-57225bb2-dbce-4212-b363-8dc34af05cce" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG nova.network.neutron [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG nova.network.neutron [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Updating instance_info_cache with network_info: [{"id": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "address": "fa:16:3e:8c:b4:10", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4f4ff4-8e", "ovs_interfaceid": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Releasing lock "refresh_cache-57225bb2-dbce-4212-b363-8dc34af05cce" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG nova.compute.manager [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Instance network_info: |[{"id": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "address": "fa:16:3e:8c:b4:10", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4f4ff4-8e", "ovs_interfaceid": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6ba6d5ad-c7de-4073-8a70-7c7e70392362 req-d3b4c427-da44-42a5-b144-6e5048772351 service nova] Acquired lock "refresh_cache-57225bb2-dbce-4212-b363-8dc34af05cce" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG nova.network.neutron [req-6ba6d5ad-c7de-4073-8a70-7c7e70392362 req-d3b4c427-da44-42a5-b144-6e5048772351 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Refreshing network info cache for port 2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Start _get_guest_xml network_info=[{"id": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "address": "fa:16:3e:8c:b4:10", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4f4ff4-8e", "ovs_interfaceid": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 17:03:37 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:03:37 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:03:37 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T17:03:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1082884404',display_name='tempest-AttachVolumeTestJSON-server-1082884404',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1082884404',id=44,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPNPWJ92774fwNZF6PVgQpXcTKVtR5LMZz3xu6DLKvMpyOVFGtxgTJRS/WltAZEiJfd7Brr2rP/3+0iYPbiNk8IOQAitKjVnZlCsrC86QNIF45RYJq5300KRzpYOnBhVg==',key_name='tempest-keypair-1762591610',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='415a7291b35546b5ac324280d37d50ae',ramdisk_id='',reservation_id='r-vobfg0xl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-112776827',owner_user_name='tempest-AttachVolumeTestJSON-112776827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T17:03:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bf4bfed609343c78b0d828db45d5ab7',uuid=57225bb2-dbce-4212-b363-8dc34af05cce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "address": "fa:16:3e:8c:b4:10", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4f4ff4-8e", "ovs_interfaceid": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Converting VIF {"id": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "address": "fa:16:3e:8c:b4:10", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4f4ff4-8e", "ovs_interfaceid": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b4:10,bridge_name='br-int',has_traffic_filtering=True,id=2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a,network=Network(7e2ce9fb-4bdc-441f-ae4a-30224b2712e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4f4ff4-8e') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG nova.objects.instance [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lazy-loading 'pci_devices' on Instance uuid 57225bb2-dbce-4212-b363-8dc34af05cce {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] End _get_guest_xml xml=<domain type="kvm">
Aug 14 17:03:37 user nova-compute[73056]:   <uuid>57225bb2-dbce-4212-b363-8dc34af05cce</uuid>
Aug 14 17:03:37 user nova-compute[73056]:   <name>instance-0000002c</name>
Aug 14 17:03:37 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 17:03:37 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 17:03:37 user nova-compute[73056]:   <metadata>
Aug 14 17:03:37 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 17:03:37 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 17:03:37 user nova-compute[73056]:       <nova:name>tempest-AttachVolumeTestJSON-server-1082884404</nova:name>
Aug 14 17:03:37 user nova-compute[73056]:       <nova:creationTime>2023-08-14 17:03:37</nova:creationTime>
Aug 14 17:03:37 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 17:03:37 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 17:03:37 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 17:03:37 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 17:03:37 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 17:03:37 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 17:03:37 user nova-compute[73056]:       </nova:flavor>
Aug 14 17:03:37 user nova-compute[73056]:       <nova:owner>
Aug 14 17:03:37 user nova-compute[73056]:         <nova:user uuid="0bf4bfed609343c78b0d828db45d5ab7">tempest-AttachVolumeTestJSON-112776827-project-member</nova:user>
Aug 14 17:03:37 user nova-compute[73056]:         <nova:project uuid="415a7291b35546b5ac324280d37d50ae">tempest-AttachVolumeTestJSON-112776827</nova:project>
Aug 14 17:03:37 user nova-compute[73056]:       </nova:owner>
Aug 14 17:03:37 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 17:03:37 user nova-compute[73056]:       <nova:ports>
Aug 14 17:03:37 user nova-compute[73056]:         <nova:port uuid="2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a">
Aug 14 17:03:37 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 17:03:37 user nova-compute[73056]:         </nova:port>
Aug 14 17:03:37 user nova-compute[73056]:       </nova:ports>
Aug 14 17:03:37 user nova-compute[73056]:     </nova:instance>
Aug 14 17:03:37 user nova-compute[73056]:   </metadata>
Aug 14 17:03:37 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 17:03:37 user nova-compute[73056]:     <system>
Aug 14 17:03:37 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 17:03:37 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 17:03:37 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 17:03:37 user nova-compute[73056]:       <entry name="serial">57225bb2-dbce-4212-b363-8dc34af05cce</entry>
Aug 14 17:03:37 user nova-compute[73056]:       <entry name="uuid">57225bb2-dbce-4212-b363-8dc34af05cce</entry>
Aug 14 17:03:37 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 17:03:37 user nova-compute[73056]:     </system>
Aug 14 17:03:37 user nova-compute[73056]:   </sysinfo>
Aug 14 17:03:37 user nova-compute[73056]:   <os>
Aug 14 17:03:37 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 17:03:37 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 17:03:37 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 17:03:37 user nova-compute[73056]:   </os>
Aug 14 17:03:37 user nova-compute[73056]:   <features>
Aug 14 17:03:37 user nova-compute[73056]:     <acpi/>
Aug 14 17:03:37 user nova-compute[73056]:     <apic/>
Aug 14 17:03:37 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 17:03:37 user nova-compute[73056]:   </features>
Aug 14 17:03:37 user nova-compute[73056]:   <clock offset="utc">
Aug 14 17:03:37 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 17:03:37 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 17:03:37 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 17:03:37 user nova-compute[73056]:   </clock>
Aug 14 17:03:37 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 17:03:37 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 17:03:37 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 17:03:37 user nova-compute[73056]:   </cpu>
Aug 14 17:03:37 user nova-compute[73056]:   <devices>
Aug 14 17:03:37 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 17:03:37 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 17:03:37 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk"/>
Aug 14 17:03:37 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 17:03:37 user nova-compute[73056]:     </disk>
Aug 14 17:03:37 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 17:03:37 user nova-compute[73056]:       <mac address="fa:16:3e:8c:b4:10"/>
Aug 14 17:03:37 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 17:03:37 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 17:03:37 user nova-compute[73056]:       <target dev="tap2e4f4ff4-8e"/>
Aug 14 17:03:37 user nova-compute[73056]:     </interface>
Aug 14 17:03:37 user nova-compute[73056]:     <serial type="pty">
Aug 14 17:03:37 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/console.log" append="off"/>
Aug 14 17:03:37 user nova-compute[73056]:     </serial>
Aug 14 17:03:37 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 17:03:37 user nova-compute[73056]:     <video>
Aug 14 17:03:37 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 17:03:37 user nova-compute[73056]:     </video>
Aug 14 17:03:37 user nova-compute[73056]:     <rng model="virtio">
Aug 14 17:03:37 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 17:03:37 user nova-compute[73056]:     </rng>
Aug 14 17:03:37 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 17:03:37 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 17:03:37 user nova-compute[73056]:       <stats period="10"/>
Aug 14 17:03:37 user nova-compute[73056]:     </memballoon>
Aug 14 17:03:37 user nova-compute[73056]:   </devices>
Aug 14 17:03:37 user nova-compute[73056]: </domain>
Aug 14 17:03:37 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T17:03:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1082884404',display_name='tempest-AttachVolumeTestJSON-server-1082884404',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1082884404',id=44,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPNPWJ92774fwNZF6PVgQpXcTKVtR5LMZz3xu6DLKvMpyOVFGtxgTJRS/WltAZEiJfd7Brr2rP/3+0iYPbiNk8IOQAitKjVnZlCsrC86QNIF45RYJq5300KRzpYOnBhVg==',key_name='tempest-keypair-1762591610',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='415a7291b35546b5ac324280d37d50ae',ramdisk_id='',reservation_id='r-vobfg0xl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-112776827',owner_user_name='tempest-AttachVolumeTestJSON-112776827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T17:03:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bf4bfed609343c78b0d828db45d5ab7',uuid=57225bb2-dbce-4212-b363-8dc34af05cce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "address": "fa:16:3e:8c:b4:10", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4f4ff4-8e", "ovs_interfaceid": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Converting VIF {"id": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "address": "fa:16:3e:8c:b4:10", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4f4ff4-8e", "ovs_interfaceid": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b4:10,bridge_name='br-int',has_traffic_filtering=True,id=2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a,network=Network(7e2ce9fb-4bdc-441f-ae4a-30224b2712e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4f4ff4-8e') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG os_vif [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b4:10,bridge_name='br-int',has_traffic_filtering=True,id=2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a,network=Network(7e2ce9fb-4bdc-441f-ae4a-30224b2712e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4f4ff4-8e') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e4f4ff4-8e, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2e4f4ff4-8e, col_values=(('external_ids', {'iface-id': '2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:b4:10', 'vm-uuid': '57225bb2-dbce-4212-b363-8dc34af05cce'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:37 user nova-compute[73056]: INFO os_vif [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b4:10,bridge_name='br-int',has_traffic_filtering=True,id=2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a,network=Network(7e2ce9fb-4bdc-441f-ae4a-30224b2712e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4f4ff4-8e')
Aug 14 17:03:37 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 17:03:37 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] No VIF found with MAC fa:16:3e:8c:b4:10, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 17:03:38 user nova-compute[73056]: DEBUG nova.network.neutron [req-6ba6d5ad-c7de-4073-8a70-7c7e70392362 req-d3b4c427-da44-42a5-b144-6e5048772351 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Updated VIF entry in instance network info cache for port 2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 17:03:38 user nova-compute[73056]: DEBUG nova.network.neutron [req-6ba6d5ad-c7de-4073-8a70-7c7e70392362 req-d3b4c427-da44-42a5-b144-6e5048772351 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Updating instance_info_cache with network_info: [{"id": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "address": "fa:16:3e:8c:b4:10", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4f4ff4-8e", "ovs_interfaceid": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:03:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6ba6d5ad-c7de-4073-8a70-7c7e70392362 req-d3b4c427-da44-42a5-b144-6e5048772351 service nova] Releasing lock "refresh_cache-57225bb2-dbce-4212-b363-8dc34af05cce" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:03:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:39 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:39 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:39 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:39 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:39 user nova-compute[73056]: DEBUG nova.compute.manager [req-5a817bc7-c732-4a47-b95f-79ef09430f01 req-accbffbf-d79e-48e3-bd10-3c1eb2669415 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received event network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:03:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-5a817bc7-c732-4a47-b95f-79ef09430f01 req-accbffbf-d79e-48e3-bd10-3c1eb2669415 service nova] Acquiring lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:03:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-5a817bc7-c732-4a47-b95f-79ef09430f01 req-accbffbf-d79e-48e3-bd10-3c1eb2669415 service nova] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:03:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-5a817bc7-c732-4a47-b95f-79ef09430f01 req-accbffbf-d79e-48e3-bd10-3c1eb2669415 service nova] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:03:39 user nova-compute[73056]: DEBUG nova.compute.manager [req-5a817bc7-c732-4a47-b95f-79ef09430f01 req-accbffbf-d79e-48e3-bd10-3c1eb2669415 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] No waiting events found dispatching network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:03:39 user nova-compute[73056]: WARNING nova.compute.manager [req-5a817bc7-c732-4a47-b95f-79ef09430f01 req-accbffbf-d79e-48e3-bd10-3c1eb2669415 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received unexpected event network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a for instance with vm_state building and task_state spawning.
Aug 14 17:03:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:41 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692032621.507356, 57225bb2-dbce-4212-b363-8dc34af05cce => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:03:41 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] VM Resumed (Lifecycle Event)
Aug 14 17:03:41 user nova-compute[73056]: DEBUG nova.compute.manager [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 17:03:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 17:03:41 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Instance spawned successfully.
Aug 14 17:03:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 17:03:41 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:03:41 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 17:03:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:03:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:03:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:03:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:03:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:03:41 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:03:41 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 17:03:41 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692032621.5111825, 57225bb2-dbce-4212-b363-8dc34af05cce => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:03:41 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] VM Started (Lifecycle Event)
Aug 14 17:03:41 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:03:41 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 17:03:41 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 17:03:41 user nova-compute[73056]: INFO nova.compute.manager [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Took 6.15 seconds to spawn the instance on the hypervisor.
Aug 14 17:03:41 user nova-compute[73056]: DEBUG nova.compute.manager [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:03:41 user nova-compute[73056]: INFO nova.compute.manager [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Took 7.09 seconds to build instance.
Aug 14 17:03:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7b3d70e4-886e-467e-afa1-65723627502b tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "57225bb2-dbce-4212-b363-8dc34af05cce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.204s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:03:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:41 user nova-compute[73056]: DEBUG nova.compute.manager [req-7129d5b2-c336-4188-ad5d-f23de4413347 req-315a6d5b-86f8-44a1-8151-6453009aa145 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received event network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:03:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-7129d5b2-c336-4188-ad5d-f23de4413347 req-315a6d5b-86f8-44a1-8151-6453009aa145 service nova] Acquiring lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:03:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-7129d5b2-c336-4188-ad5d-f23de4413347 req-315a6d5b-86f8-44a1-8151-6453009aa145 service nova] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:03:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-7129d5b2-c336-4188-ad5d-f23de4413347 req-315a6d5b-86f8-44a1-8151-6453009aa145 service nova] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:03:41 user nova-compute[73056]: DEBUG nova.compute.manager [req-7129d5b2-c336-4188-ad5d-f23de4413347 req-315a6d5b-86f8-44a1-8151-6453009aa145 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] No waiting events found dispatching network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:03:41 user nova-compute[73056]: WARNING nova.compute.manager [req-7129d5b2-c336-4188-ad5d-f23de4413347 req-315a6d5b-86f8-44a1-8151-6453009aa145 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received unexpected event network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a for instance with vm_state active and task_state None.
Aug 14 17:03:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Acquiring lock "89132752-29cb-463d-aec4-07d8c145f4d9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:03:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lock "89132752-29cb-463d-aec4-07d8c145f4d9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:03:47 user nova-compute[73056]: DEBUG nova.compute.manager [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 17:03:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:03:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:03:47 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 17:03:47 user nova-compute[73056]: INFO nova.compute.claims [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Claim successful on node user
Aug 14 17:03:47 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:03:47 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:03:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.270s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:03:47 user nova-compute[73056]: DEBUG nova.compute.manager [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 17:03:47 user nova-compute[73056]: DEBUG nova.compute.manager [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 17:03:47 user nova-compute[73056]: DEBUG nova.network.neutron [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 17:03:47 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 17:03:47 user nova-compute[73056]: DEBUG nova.compute.manager [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 17:03:47 user nova-compute[73056]: DEBUG nova.policy [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ccbad4e550a4e549ca33f495c81472d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6067a4308576451784b4be7ba26c7c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 17:03:47 user nova-compute[73056]: DEBUG nova.compute.manager [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 17:03:47 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 17:03:47 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Creating image(s)
Aug 14 17:03:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Acquiring lock "/opt/stack/data/nova/instances/89132752-29cb-463d-aec4-07d8c145f4d9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:03:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lock "/opt/stack/data/nova/instances/89132752-29cb-463d-aec4-07d8c145f4d9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:03:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lock "/opt/stack/data/nova/instances/89132752-29cb-463d-aec4-07d8c145f4d9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:03:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:03:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.187s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:03:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Acquiring lock "c889592ab94cd0b0ce896f27a2af0323771db234" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:03:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:03:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:03:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.177s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:03:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/89132752-29cb-463d-aec4-07d8c145f4d9/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:03:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/89132752-29cb-463d-aec4-07d8c145f4d9/disk 1073741824" returned: 0 in 0.065s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:03:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:03:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:03:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.208s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:03:48 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Checking if we can resize image /opt/stack/data/nova/instances/89132752-29cb-463d-aec4-07d8c145f4d9/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 17:03:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89132752-29cb-463d-aec4-07d8c145f4d9/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:03:48 user nova-compute[73056]: DEBUG nova.network.neutron [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Successfully created port: 70c729e6-663f-401d-8265-4bfda2634d00 {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 17:03:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89132752-29cb-463d-aec4-07d8c145f4d9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:03:48 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Cannot resize image /opt/stack/data/nova/instances/89132752-29cb-463d-aec4-07d8c145f4d9/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 17:03:48 user nova-compute[73056]: DEBUG nova.objects.instance [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lazy-loading 'migration_context' on Instance uuid 89132752-29cb-463d-aec4-07d8c145f4d9 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:03:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 17:03:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Ensure instance console log exists: /opt/stack/data/nova/instances/89132752-29cb-463d-aec4-07d8c145f4d9/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 17:03:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:03:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:03:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:03:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG nova.network.neutron [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Successfully updated port: 70c729e6-663f-401d-8265-4bfda2634d00 {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Acquiring lock "refresh_cache-89132752-29cb-463d-aec4-07d8c145f4d9" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Acquired lock "refresh_cache-89132752-29cb-463d-aec4-07d8c145f4d9" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG nova.network.neutron [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG nova.compute.manager [req-442886cf-cad2-47ca-be2c-ab0b649322cf req-476a78ed-73f8-4754-92f5-d826d415d836 service nova] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Received event network-changed-70c729e6-663f-401d-8265-4bfda2634d00 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG nova.compute.manager [req-442886cf-cad2-47ca-be2c-ab0b649322cf req-476a78ed-73f8-4754-92f5-d826d415d836 service nova] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Refreshing instance network info cache due to event network-changed-70c729e6-663f-401d-8265-4bfda2634d00. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-442886cf-cad2-47ca-be2c-ab0b649322cf req-476a78ed-73f8-4754-92f5-d826d415d836 service nova] Acquiring lock "refresh_cache-89132752-29cb-463d-aec4-07d8c145f4d9" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG nova.network.neutron [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG nova.network.neutron [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Updating instance_info_cache with network_info: [{"id": "70c729e6-663f-401d-8265-4bfda2634d00", "address": "fa:16:3e:2a:5d:a0", "network": {"id": "cd0faadc-916c-43e7-bc06-21c25481110a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-646602137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6067a4308576451784b4be7ba26c7c8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70c729e6-66", "ovs_interfaceid": "70c729e6-663f-401d-8265-4bfda2634d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Releasing lock "refresh_cache-89132752-29cb-463d-aec4-07d8c145f4d9" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG nova.compute.manager [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Instance network_info: |[{"id": "70c729e6-663f-401d-8265-4bfda2634d00", "address": "fa:16:3e:2a:5d:a0", "network": {"id": "cd0faadc-916c-43e7-bc06-21c25481110a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-646602137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6067a4308576451784b4be7ba26c7c8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70c729e6-66", "ovs_interfaceid": "70c729e6-663f-401d-8265-4bfda2634d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-442886cf-cad2-47ca-be2c-ab0b649322cf req-476a78ed-73f8-4754-92f5-d826d415d836 service nova] Acquired lock "refresh_cache-89132752-29cb-463d-aec4-07d8c145f4d9" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG nova.network.neutron [req-442886cf-cad2-47ca-be2c-ab0b649322cf req-476a78ed-73f8-4754-92f5-d826d415d836 service nova] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Refreshing network info cache for port 70c729e6-663f-401d-8265-4bfda2634d00 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Start _get_guest_xml network_info=[{"id": "70c729e6-663f-401d-8265-4bfda2634d00", "address": "fa:16:3e:2a:5d:a0", "network": {"id": "cd0faadc-916c-43e7-bc06-21c25481110a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-646602137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6067a4308576451784b4be7ba26c7c8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70c729e6-66", "ovs_interfaceid": "70c729e6-663f-401d-8265-4bfda2634d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 17:03:49 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:03:49 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:03:49 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T17:03:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-403548302',display_name='tempest-TestServerVolumeAttachmentScenario-server-403548302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-403548302',id=45,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbgz1+0na/YkvVTYKuerdBmCYYdUSRqeIXXQRDZiW2lzky0R4HqHEtW9m9GlP05NWQsIjyZzDAediTbWge7k/UMi6aGYvsMk6CmWC82UBrFVvHm7JzJVPWcc/AyEB0VJw==',key_name='tempest-keypair-497808649',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6067a4308576451784b4be7ba26c7c8b',ramdisk_id='',reservation_id='r-rvld6j6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1720243738',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1720243738-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T17:03:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ccbad4e550a4e549ca33f495c81472d',uuid=89132752-29cb-463d-aec4-07d8c145f4d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70c729e6-663f-401d-8265-4bfda2634d00", "address": "fa:16:3e:2a:5d:a0", "network": {"id": "cd0faadc-916c-43e7-bc06-21c25481110a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-646602137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6067a4308576451784b4be7ba26c7c8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70c729e6-66", "ovs_interfaceid": "70c729e6-663f-401d-8265-4bfda2634d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Converting VIF {"id": "70c729e6-663f-401d-8265-4bfda2634d00", "address": "fa:16:3e:2a:5d:a0", "network": {"id": "cd0faadc-916c-43e7-bc06-21c25481110a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-646602137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6067a4308576451784b4be7ba26c7c8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70c729e6-66", "ovs_interfaceid": "70c729e6-663f-401d-8265-4bfda2634d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:5d:a0,bridge_name='br-int',has_traffic_filtering=True,id=70c729e6-663f-401d-8265-4bfda2634d00,network=Network(cd0faadc-916c-43e7-bc06-21c25481110a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70c729e6-66') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG nova.objects.instance [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lazy-loading 'pci_devices' on Instance uuid 89132752-29cb-463d-aec4-07d8c145f4d9 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] End _get_guest_xml xml=<domain type="kvm">
Aug 14 17:03:49 user nova-compute[73056]:   <uuid>89132752-29cb-463d-aec4-07d8c145f4d9</uuid>
Aug 14 17:03:49 user nova-compute[73056]:   <name>instance-0000002d</name>
Aug 14 17:03:49 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 17:03:49 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 17:03:49 user nova-compute[73056]:   <metadata>
Aug 14 17:03:49 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 17:03:49 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 17:03:49 user nova-compute[73056]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-403548302</nova:name>
Aug 14 17:03:49 user nova-compute[73056]:       <nova:creationTime>2023-08-14 17:03:49</nova:creationTime>
Aug 14 17:03:49 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 17:03:49 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 17:03:49 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 17:03:49 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 17:03:49 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 17:03:49 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 17:03:49 user nova-compute[73056]:       </nova:flavor>
Aug 14 17:03:49 user nova-compute[73056]:       <nova:owner>
Aug 14 17:03:49 user nova-compute[73056]:         <nova:user uuid="3ccbad4e550a4e549ca33f495c81472d">tempest-TestServerVolumeAttachmentScenario-1720243738-project-member</nova:user>
Aug 14 17:03:49 user nova-compute[73056]:         <nova:project uuid="6067a4308576451784b4be7ba26c7c8b">tempest-TestServerVolumeAttachmentScenario-1720243738</nova:project>
Aug 14 17:03:49 user nova-compute[73056]:       </nova:owner>
Aug 14 17:03:49 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 17:03:49 user nova-compute[73056]:       <nova:ports>
Aug 14 17:03:49 user nova-compute[73056]:         <nova:port uuid="70c729e6-663f-401d-8265-4bfda2634d00">
Aug 14 17:03:49 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 17:03:49 user nova-compute[73056]:         </nova:port>
Aug 14 17:03:49 user nova-compute[73056]:       </nova:ports>
Aug 14 17:03:49 user nova-compute[73056]:     </nova:instance>
Aug 14 17:03:49 user nova-compute[73056]:   </metadata>
Aug 14 17:03:49 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 17:03:49 user nova-compute[73056]:     <system>
Aug 14 17:03:49 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 17:03:49 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 17:03:49 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 17:03:49 user nova-compute[73056]:       <entry name="serial">89132752-29cb-463d-aec4-07d8c145f4d9</entry>
Aug 14 17:03:49 user nova-compute[73056]:       <entry name="uuid">89132752-29cb-463d-aec4-07d8c145f4d9</entry>
Aug 14 17:03:49 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 17:03:49 user nova-compute[73056]:     </system>
Aug 14 17:03:49 user nova-compute[73056]:   </sysinfo>
Aug 14 17:03:49 user nova-compute[73056]:   <os>
Aug 14 17:03:49 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 17:03:49 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 17:03:49 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 17:03:49 user nova-compute[73056]:   </os>
Aug 14 17:03:49 user nova-compute[73056]:   <features>
Aug 14 17:03:49 user nova-compute[73056]:     <acpi/>
Aug 14 17:03:49 user nova-compute[73056]:     <apic/>
Aug 14 17:03:49 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 17:03:49 user nova-compute[73056]:   </features>
Aug 14 17:03:49 user nova-compute[73056]:   <clock offset="utc">
Aug 14 17:03:49 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 17:03:49 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 17:03:49 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 17:03:49 user nova-compute[73056]:   </clock>
Aug 14 17:03:49 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 17:03:49 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 17:03:49 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 17:03:49 user nova-compute[73056]:   </cpu>
Aug 14 17:03:49 user nova-compute[73056]:   <devices>
Aug 14 17:03:49 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 17:03:49 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 17:03:49 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/89132752-29cb-463d-aec4-07d8c145f4d9/disk"/>
Aug 14 17:03:49 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 17:03:49 user nova-compute[73056]:     </disk>
Aug 14 17:03:49 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 17:03:49 user nova-compute[73056]:       <mac address="fa:16:3e:2a:5d:a0"/>
Aug 14 17:03:49 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 17:03:49 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 17:03:49 user nova-compute[73056]:       <target dev="tap70c729e6-66"/>
Aug 14 17:03:49 user nova-compute[73056]:     </interface>
Aug 14 17:03:49 user nova-compute[73056]:     <serial type="pty">
Aug 14 17:03:49 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/89132752-29cb-463d-aec4-07d8c145f4d9/console.log" append="off"/>
Aug 14 17:03:49 user nova-compute[73056]:     </serial>
Aug 14 17:03:49 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 17:03:49 user nova-compute[73056]:     <video>
Aug 14 17:03:49 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 17:03:49 user nova-compute[73056]:     </video>
Aug 14 17:03:49 user nova-compute[73056]:     <rng model="virtio">
Aug 14 17:03:49 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 17:03:49 user nova-compute[73056]:     </rng>
Aug 14 17:03:49 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 17:03:49 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 17:03:49 user nova-compute[73056]:       <stats period="10"/>
Aug 14 17:03:49 user nova-compute[73056]:     </memballoon>
Aug 14 17:03:49 user nova-compute[73056]:   </devices>
Aug 14 17:03:49 user nova-compute[73056]: </domain>
Aug 14 17:03:49 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T17:03:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-403548302',display_name='tempest-TestServerVolumeAttachmentScenario-server-403548302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-403548302',id=45,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbgz1+0na/YkvVTYKuerdBmCYYdUSRqeIXXQRDZiW2lzky0R4HqHEtW9m9GlP05NWQsIjyZzDAediTbWge7k/UMi6aGYvsMk6CmWC82UBrFVvHm7JzJVPWcc/AyEB0VJw==',key_name='tempest-keypair-497808649',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6067a4308576451784b4be7ba26c7c8b',ramdisk_id='',reservation_id='r-rvld6j6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1720243738',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1720243738-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T17:03:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ccbad4e550a4e549ca33f495c81472d',uuid=89132752-29cb-463d-aec4-07d8c145f4d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70c729e6-663f-401d-8265-4bfda2634d00", "address": "fa:16:3e:2a:5d:a0", "network": {"id": "cd0faadc-916c-43e7-bc06-21c25481110a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-646602137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6067a4308576451784b4be7ba26c7c8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70c729e6-66", "ovs_interfaceid": "70c729e6-663f-401d-8265-4bfda2634d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Converting VIF {"id": "70c729e6-663f-401d-8265-4bfda2634d00", "address": "fa:16:3e:2a:5d:a0", "network": {"id": "cd0faadc-916c-43e7-bc06-21c25481110a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-646602137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6067a4308576451784b4be7ba26c7c8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70c729e6-66", "ovs_interfaceid": "70c729e6-663f-401d-8265-4bfda2634d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:5d:a0,bridge_name='br-int',has_traffic_filtering=True,id=70c729e6-663f-401d-8265-4bfda2634d00,network=Network(cd0faadc-916c-43e7-bc06-21c25481110a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70c729e6-66') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG os_vif [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:5d:a0,bridge_name='br-int',has_traffic_filtering=True,id=70c729e6-663f-401d-8265-4bfda2634d00,network=Network(cd0faadc-916c-43e7-bc06-21c25481110a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70c729e6-66') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70c729e6-66, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap70c729e6-66, col_values=(('external_ids', {'iface-id': '70c729e6-663f-401d-8265-4bfda2634d00', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:5d:a0', 'vm-uuid': '89132752-29cb-463d-aec4-07d8c145f4d9'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:49 user nova-compute[73056]: INFO os_vif [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:5d:a0,bridge_name='br-int',has_traffic_filtering=True,id=70c729e6-663f-401d-8265-4bfda2634d00,network=Network(cd0faadc-916c-43e7-bc06-21c25481110a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70c729e6-66')
Aug 14 17:03:49 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 17:03:49 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] No VIF found with MAC fa:16:3e:2a:5d:a0, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 17:03:50 user nova-compute[73056]: DEBUG nova.network.neutron [req-442886cf-cad2-47ca-be2c-ab0b649322cf req-476a78ed-73f8-4754-92f5-d826d415d836 service nova] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Updated VIF entry in instance network info cache for port 70c729e6-663f-401d-8265-4bfda2634d00. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 17:03:50 user nova-compute[73056]: DEBUG nova.network.neutron [req-442886cf-cad2-47ca-be2c-ab0b649322cf req-476a78ed-73f8-4754-92f5-d826d415d836 service nova] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Updating instance_info_cache with network_info: [{"id": "70c729e6-663f-401d-8265-4bfda2634d00", "address": "fa:16:3e:2a:5d:a0", "network": {"id": "cd0faadc-916c-43e7-bc06-21c25481110a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-646602137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6067a4308576451784b4be7ba26c7c8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70c729e6-66", "ovs_interfaceid": "70c729e6-663f-401d-8265-4bfda2634d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:03:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-442886cf-cad2-47ca-be2c-ab0b649322cf req-476a78ed-73f8-4754-92f5-d826d415d836 service nova] Releasing lock "refresh_cache-89132752-29cb-463d-aec4-07d8c145f4d9" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:03:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-f62f620b-c086-4915-9920-fd41f72d08dc req-37ebc0a2-2808-4af7-bebd-bdc1c44942f3 service nova] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Received event network-vif-plugged-70c729e6-663f-401d-8265-4bfda2634d00 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:03:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f62f620b-c086-4915-9920-fd41f72d08dc req-37ebc0a2-2808-4af7-bebd-bdc1c44942f3 service nova] Acquiring lock "89132752-29cb-463d-aec4-07d8c145f4d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:03:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f62f620b-c086-4915-9920-fd41f72d08dc req-37ebc0a2-2808-4af7-bebd-bdc1c44942f3 service nova] Lock "89132752-29cb-463d-aec4-07d8c145f4d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:03:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f62f620b-c086-4915-9920-fd41f72d08dc req-37ebc0a2-2808-4af7-bebd-bdc1c44942f3 service nova] Lock "89132752-29cb-463d-aec4-07d8c145f4d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:03:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-f62f620b-c086-4915-9920-fd41f72d08dc req-37ebc0a2-2808-4af7-bebd-bdc1c44942f3 service nova] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] No waiting events found dispatching network-vif-plugged-70c729e6-663f-401d-8265-4bfda2634d00 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:03:51 user nova-compute[73056]: WARNING nova.compute.manager [req-f62f620b-c086-4915-9920-fd41f72d08dc req-37ebc0a2-2808-4af7-bebd-bdc1c44942f3 service nova] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Received unexpected event network-vif-plugged-70c729e6-663f-401d-8265-4bfda2634d00 for instance with vm_state building and task_state spawning.
Aug 14 17:03:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:53 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692032633.1111548, 89132752-29cb-463d-aec4-07d8c145f4d9 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:03:53 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] VM Resumed (Lifecycle Event)
Aug 14 17:03:53 user nova-compute[73056]: DEBUG nova.compute.manager [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 17:03:53 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 17:03:53 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Instance spawned successfully.
Aug 14 17:03:53 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 17:03:53 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:03:53 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 17:03:53 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:03:53 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:03:53 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:03:53 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:03:53 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:03:53 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:03:53 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 17:03:53 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692032633.114571, 89132752-29cb-463d-aec4-07d8c145f4d9 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:03:53 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] VM Started (Lifecycle Event)
Aug 14 17:03:53 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:03:53 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 17:03:53 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 17:03:53 user nova-compute[73056]: INFO nova.compute.manager [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Took 5.56 seconds to spawn the instance on the hypervisor.
Aug 14 17:03:53 user nova-compute[73056]: DEBUG nova.compute.manager [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:03:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-7b7ccb68-58e7-4018-835a-763567454422 req-4e4e652d-db09-494b-8a8a-3d155ee81eca service nova] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Received event network-vif-plugged-70c729e6-663f-401d-8265-4bfda2634d00 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:03:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-7b7ccb68-58e7-4018-835a-763567454422 req-4e4e652d-db09-494b-8a8a-3d155ee81eca service nova] Acquiring lock "89132752-29cb-463d-aec4-07d8c145f4d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:03:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-7b7ccb68-58e7-4018-835a-763567454422 req-4e4e652d-db09-494b-8a8a-3d155ee81eca service nova] Lock "89132752-29cb-463d-aec4-07d8c145f4d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:03:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-7b7ccb68-58e7-4018-835a-763567454422 req-4e4e652d-db09-494b-8a8a-3d155ee81eca service nova] Lock "89132752-29cb-463d-aec4-07d8c145f4d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:03:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-7b7ccb68-58e7-4018-835a-763567454422 req-4e4e652d-db09-494b-8a8a-3d155ee81eca service nova] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] No waiting events found dispatching network-vif-plugged-70c729e6-663f-401d-8265-4bfda2634d00 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:03:53 user nova-compute[73056]: WARNING nova.compute.manager [req-7b7ccb68-58e7-4018-835a-763567454422 req-4e4e652d-db09-494b-8a8a-3d155ee81eca service nova] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Received unexpected event network-vif-plugged-70c729e6-663f-401d-8265-4bfda2634d00 for instance with vm_state building and task_state spawning.
Aug 14 17:03:53 user nova-compute[73056]: INFO nova.compute.manager [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Took 6.19 seconds to build instance.
Aug 14 17:03:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-25b8bf89-d294-4ee2-ac79-4aea5e78d108 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lock "89132752-29cb-463d-aec4-07d8c145f4d9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.286s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:03:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:54 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:03:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:04:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "090405b6-77e0-4f28-bd8d-e7fccfa894b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:04:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "090405b6-77e0-4f28-bd8d-e7fccfa894b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:04:01 user nova-compute[73056]: DEBUG nova.compute.manager [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 17:04:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:04:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:04:01 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 17:04:01 user nova-compute[73056]: INFO nova.compute.claims [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Claim successful on node user
Aug 14 17:04:01 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:04:01 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:04:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.259s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:04:01 user nova-compute[73056]: DEBUG nova.compute.manager [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 17:04:01 user nova-compute[73056]: DEBUG nova.compute.manager [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 17:04:01 user nova-compute[73056]: DEBUG nova.network.neutron [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 17:04:01 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 17:04:01 user nova-compute[73056]: DEBUG nova.compute.manager [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 17:04:01 user nova-compute[73056]: DEBUG nova.policy [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '958f0c79efdc4352b35874e6c6f940d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56fc678888b4653802e94ac6b47f95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 17:04:01 user nova-compute[73056]: DEBUG nova.compute.manager [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 17:04:01 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 17:04:01 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Creating image(s)
Aug 14 17:04:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "/opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:04:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "/opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:04:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "/opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:04:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:04:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.189s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:04:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "c889592ab94cd0b0ce896f27a2af0323771db234" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:04:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:04:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:04:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.184s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:04:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:04:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk 1073741824" returned: 0 in 0.057s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:04:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:04:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:04:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.175s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:04:02 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Checking if we can resize image /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 17:04:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:04:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:04:02 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Cannot resize image /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 17:04:02 user nova-compute[73056]: DEBUG nova.objects.instance [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lazy-loading 'migration_context' on Instance uuid 090405b6-77e0-4f28-bd8d-e7fccfa894b8 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:04:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 17:04:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Ensure instance console log exists: /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 17:04:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:04:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:04:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:04:02 user nova-compute[73056]: DEBUG nova.network.neutron [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Successfully created port: 4273f76f-d31b-48bc-92b5-3997783ef4d6 {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 17:04:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:04:03 user nova-compute[73056]: DEBUG nova.network.neutron [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Successfully updated port: 4273f76f-d31b-48bc-92b5-3997783ef4d6 {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 17:04:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "refresh_cache-090405b6-77e0-4f28-bd8d-e7fccfa894b8" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:04:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquired lock "refresh_cache-090405b6-77e0-4f28-bd8d-e7fccfa894b8" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:04:03 user nova-compute[73056]: DEBUG nova.network.neutron [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 17:04:03 user nova-compute[73056]: DEBUG nova.compute.manager [req-b82e91e9-1184-44c4-bf84-9d2926ad51e4 req-6a3fe651-157c-475f-ab95-e357a6154018 service nova] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Received event network-changed-4273f76f-d31b-48bc-92b5-3997783ef4d6 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:04:03 user nova-compute[73056]: DEBUG nova.compute.manager [req-b82e91e9-1184-44c4-bf84-9d2926ad51e4 req-6a3fe651-157c-475f-ab95-e357a6154018 service nova] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Refreshing instance network info cache due to event network-changed-4273f76f-d31b-48bc-92b5-3997783ef4d6. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 17:04:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-b82e91e9-1184-44c4-bf84-9d2926ad51e4 req-6a3fe651-157c-475f-ab95-e357a6154018 service nova] Acquiring lock "refresh_cache-090405b6-77e0-4f28-bd8d-e7fccfa894b8" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG nova.network.neutron [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG nova.network.neutron [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Updating instance_info_cache with network_info: [{"id": "4273f76f-d31b-48bc-92b5-3997783ef4d6", "address": "fa:16:3e:8b:46:5c", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4273f76f-d3", "ovs_interfaceid": "4273f76f-d31b-48bc-92b5-3997783ef4d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Releasing lock "refresh_cache-090405b6-77e0-4f28-bd8d-e7fccfa894b8" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG nova.compute.manager [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Instance network_info: |[{"id": "4273f76f-d31b-48bc-92b5-3997783ef4d6", "address": "fa:16:3e:8b:46:5c", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4273f76f-d3", "ovs_interfaceid": "4273f76f-d31b-48bc-92b5-3997783ef4d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-b82e91e9-1184-44c4-bf84-9d2926ad51e4 req-6a3fe651-157c-475f-ab95-e357a6154018 service nova] Acquired lock "refresh_cache-090405b6-77e0-4f28-bd8d-e7fccfa894b8" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG nova.network.neutron [req-b82e91e9-1184-44c4-bf84-9d2926ad51e4 req-6a3fe651-157c-475f-ab95-e357a6154018 service nova] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Refreshing network info cache for port 4273f76f-d31b-48bc-92b5-3997783ef4d6 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Start _get_guest_xml network_info=[{"id": "4273f76f-d31b-48bc-92b5-3997783ef4d6", "address": "fa:16:3e:8b:46:5c", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4273f76f-d3", "ovs_interfaceid": "4273f76f-d31b-48bc-92b5-3997783ef4d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:04:04 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:04:04 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:04:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T17:04:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1395318398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1395318398',id=46,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a56fc678888b4653802e94ac6b47f95d',ramdisk_id='',reservation_id='r-k8ieucl6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-572642883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T17:04:02Z,user_data=None,user_id='958f0c79efdc4352b35874e6c6f940d8',uuid=090405b6-77e0-4f28-bd8d-e7fccfa894b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4273f76f-d31b-48bc-92b5-3997783ef4d6", "address": "fa:16:3e:8b:46:5c", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4273f76f-d3", "ovs_interfaceid": "4273f76f-d31b-48bc-92b5-3997783ef4d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Converting VIF {"id": "4273f76f-d31b-48bc-92b5-3997783ef4d6", "address": "fa:16:3e:8b:46:5c", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4273f76f-d3", "ovs_interfaceid": "4273f76f-d31b-48bc-92b5-3997783ef4d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:46:5c,bridge_name='br-int',has_traffic_filtering=True,id=4273f76f-d31b-48bc-92b5-3997783ef4d6,network=Network(ac2d700d-98d2-4459-8da8-a4858cda8864),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4273f76f-d3') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG nova.objects.instance [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lazy-loading 'pci_devices' on Instance uuid 090405b6-77e0-4f28-bd8d-e7fccfa894b8 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] End _get_guest_xml xml=<domain type="kvm">
Aug 14 17:04:04 user nova-compute[73056]:   <uuid>090405b6-77e0-4f28-bd8d-e7fccfa894b8</uuid>
Aug 14 17:04:04 user nova-compute[73056]:   <name>instance-0000002e</name>
Aug 14 17:04:04 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 17:04:04 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 17:04:04 user nova-compute[73056]:   <metadata>
Aug 14 17:04:04 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 17:04:04 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 17:04:04 user nova-compute[73056]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1395318398</nova:name>
Aug 14 17:04:04 user nova-compute[73056]:       <nova:creationTime>2023-08-14 17:04:04</nova:creationTime>
Aug 14 17:04:04 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 17:04:04 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 17:04:04 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 17:04:04 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 17:04:04 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 17:04:04 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 17:04:04 user nova-compute[73056]:       </nova:flavor>
Aug 14 17:04:04 user nova-compute[73056]:       <nova:owner>
Aug 14 17:04:04 user nova-compute[73056]:         <nova:user uuid="958f0c79efdc4352b35874e6c6f940d8">tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member</nova:user>
Aug 14 17:04:04 user nova-compute[73056]:         <nova:project uuid="a56fc678888b4653802e94ac6b47f95d">tempest-ServerBootFromVolumeStableRescueTest-572642883</nova:project>
Aug 14 17:04:04 user nova-compute[73056]:       </nova:owner>
Aug 14 17:04:04 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 17:04:04 user nova-compute[73056]:       <nova:ports>
Aug 14 17:04:04 user nova-compute[73056]:         <nova:port uuid="4273f76f-d31b-48bc-92b5-3997783ef4d6">
Aug 14 17:04:04 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 17:04:04 user nova-compute[73056]:         </nova:port>
Aug 14 17:04:04 user nova-compute[73056]:       </nova:ports>
Aug 14 17:04:04 user nova-compute[73056]:     </nova:instance>
Aug 14 17:04:04 user nova-compute[73056]:   </metadata>
Aug 14 17:04:04 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 17:04:04 user nova-compute[73056]:     <system>
Aug 14 17:04:04 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 17:04:04 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 17:04:04 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 17:04:04 user nova-compute[73056]:       <entry name="serial">090405b6-77e0-4f28-bd8d-e7fccfa894b8</entry>
Aug 14 17:04:04 user nova-compute[73056]:       <entry name="uuid">090405b6-77e0-4f28-bd8d-e7fccfa894b8</entry>
Aug 14 17:04:04 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 17:04:04 user nova-compute[73056]:     </system>
Aug 14 17:04:04 user nova-compute[73056]:   </sysinfo>
Aug 14 17:04:04 user nova-compute[73056]:   <os>
Aug 14 17:04:04 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 17:04:04 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 17:04:04 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 17:04:04 user nova-compute[73056]:   </os>
Aug 14 17:04:04 user nova-compute[73056]:   <features>
Aug 14 17:04:04 user nova-compute[73056]:     <acpi/>
Aug 14 17:04:04 user nova-compute[73056]:     <apic/>
Aug 14 17:04:04 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 17:04:04 user nova-compute[73056]:   </features>
Aug 14 17:04:04 user nova-compute[73056]:   <clock offset="utc">
Aug 14 17:04:04 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 17:04:04 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 17:04:04 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 17:04:04 user nova-compute[73056]:   </clock>
Aug 14 17:04:04 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 17:04:04 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 17:04:04 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 17:04:04 user nova-compute[73056]:   </cpu>
Aug 14 17:04:04 user nova-compute[73056]:   <devices>
Aug 14 17:04:04 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 17:04:04 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 17:04:04 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk"/>
Aug 14 17:04:04 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 17:04:04 user nova-compute[73056]:     </disk>
Aug 14 17:04:04 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 17:04:04 user nova-compute[73056]:       <mac address="fa:16:3e:8b:46:5c"/>
Aug 14 17:04:04 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 17:04:04 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 17:04:04 user nova-compute[73056]:       <target dev="tap4273f76f-d3"/>
Aug 14 17:04:04 user nova-compute[73056]:     </interface>
Aug 14 17:04:04 user nova-compute[73056]:     <serial type="pty">
Aug 14 17:04:04 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/console.log" append="off"/>
Aug 14 17:04:04 user nova-compute[73056]:     </serial>
Aug 14 17:04:04 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 17:04:04 user nova-compute[73056]:     <video>
Aug 14 17:04:04 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 17:04:04 user nova-compute[73056]:     </video>
Aug 14 17:04:04 user nova-compute[73056]:     <rng model="virtio">
Aug 14 17:04:04 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 17:04:04 user nova-compute[73056]:     </rng>
Aug 14 17:04:04 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 17:04:04 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 17:04:04 user nova-compute[73056]:       <stats period="10"/>
Aug 14 17:04:04 user nova-compute[73056]:     </memballoon>
Aug 14 17:04:04 user nova-compute[73056]:   </devices>
Aug 14 17:04:04 user nova-compute[73056]: </domain>
Aug 14 17:04:04 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T17:04:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1395318398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1395318398',id=46,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a56fc678888b4653802e94ac6b47f95d',ramdisk_id='',reservation_id='r-k8ieucl6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-572642883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T17:04:02Z,user_data=None,user_id='958f0c79efdc4352b35874e6c6f940d8',uuid=090405b6-77e0-4f28-bd8d-e7fccfa894b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4273f76f-d31b-48bc-92b5-3997783ef4d6", "address": "fa:16:3e:8b:46:5c", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4273f76f-d3", "ovs_interfaceid": "4273f76f-d31b-48bc-92b5-3997783ef4d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Converting VIF {"id": "4273f76f-d31b-48bc-92b5-3997783ef4d6", "address": "fa:16:3e:8b:46:5c", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4273f76f-d3", "ovs_interfaceid": "4273f76f-d31b-48bc-92b5-3997783ef4d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:46:5c,bridge_name='br-int',has_traffic_filtering=True,id=4273f76f-d31b-48bc-92b5-3997783ef4d6,network=Network(ac2d700d-98d2-4459-8da8-a4858cda8864),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4273f76f-d3') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG os_vif [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:46:5c,bridge_name='br-int',has_traffic_filtering=True,id=4273f76f-d31b-48bc-92b5-3997783ef4d6,network=Network(ac2d700d-98d2-4459-8da8-a4858cda8864),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4273f76f-d3') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4273f76f-d3, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4273f76f-d3, col_values=(('external_ids', {'iface-id': '4273f76f-d31b-48bc-92b5-3997783ef4d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:46:5c', 'vm-uuid': '090405b6-77e0-4f28-bd8d-e7fccfa894b8'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:04:04 user nova-compute[73056]: INFO os_vif [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:46:5c,bridge_name='br-int',has_traffic_filtering=True,id=4273f76f-d31b-48bc-92b5-3997783ef4d6,network=Network(ac2d700d-98d2-4459-8da8-a4858cda8864),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4273f76f-d3')
Aug 14 17:04:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 17:04:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] No VIF found with MAC fa:16:3e:8b:46:5c, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 17:04:05 user nova-compute[73056]: DEBUG nova.network.neutron [req-b82e91e9-1184-44c4-bf84-9d2926ad51e4 req-6a3fe651-157c-475f-ab95-e357a6154018 service nova] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Updated VIF entry in instance network info cache for port 4273f76f-d31b-48bc-92b5-3997783ef4d6. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 17:04:05 user nova-compute[73056]: DEBUG nova.network.neutron [req-b82e91e9-1184-44c4-bf84-9d2926ad51e4 req-6a3fe651-157c-475f-ab95-e357a6154018 service nova] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Updating instance_info_cache with network_info: [{"id": "4273f76f-d31b-48bc-92b5-3997783ef4d6", "address": "fa:16:3e:8b:46:5c", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4273f76f-d3", "ovs_interfaceid": "4273f76f-d31b-48bc-92b5-3997783ef4d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:04:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-b82e91e9-1184-44c4-bf84-9d2926ad51e4 req-6a3fe651-157c-475f-ab95-e357a6154018 service nova] Releasing lock "refresh_cache-090405b6-77e0-4f28-bd8d-e7fccfa894b8" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:04:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:04:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:04:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:04:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:04:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:04:06 user nova-compute[73056]: DEBUG nova.compute.manager [req-655decf6-cbea-4a54-b885-eee858c38b1a req-d6af8ad6-890a-4e56-a5b3-90fe7d3cb358 service nova] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Received event network-vif-plugged-4273f76f-d31b-48bc-92b5-3997783ef4d6 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:04:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-655decf6-cbea-4a54-b885-eee858c38b1a req-d6af8ad6-890a-4e56-a5b3-90fe7d3cb358 service nova] Acquiring lock "090405b6-77e0-4f28-bd8d-e7fccfa894b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:04:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-655decf6-cbea-4a54-b885-eee858c38b1a req-d6af8ad6-890a-4e56-a5b3-90fe7d3cb358 service nova] Lock "090405b6-77e0-4f28-bd8d-e7fccfa894b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:04:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-655decf6-cbea-4a54-b885-eee858c38b1a req-d6af8ad6-890a-4e56-a5b3-90fe7d3cb358 service nova] Lock "090405b6-77e0-4f28-bd8d-e7fccfa894b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:04:06 user nova-compute[73056]: DEBUG nova.compute.manager [req-655decf6-cbea-4a54-b885-eee858c38b1a req-d6af8ad6-890a-4e56-a5b3-90fe7d3cb358 service nova] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] No waiting events found dispatching network-vif-plugged-4273f76f-d31b-48bc-92b5-3997783ef4d6 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:04:06 user nova-compute[73056]: WARNING nova.compute.manager [req-655decf6-cbea-4a54-b885-eee858c38b1a req-d6af8ad6-890a-4e56-a5b3-90fe7d3cb358 service nova] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Received unexpected event network-vif-plugged-4273f76f-d31b-48bc-92b5-3997783ef4d6 for instance with vm_state building and task_state spawning.
Aug 14 17:04:07 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:04:07 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:04:07 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 17:04:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:04:08 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692032648.7920375, 090405b6-77e0-4f28-bd8d-e7fccfa894b8 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:04:08 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] VM Resumed (Lifecycle Event)
Aug 14 17:04:08 user nova-compute[73056]: DEBUG nova.compute.manager [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 17:04:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 17:04:08 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Instance spawned successfully.
Aug 14 17:04:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 17:04:08 user nova-compute[73056]: DEBUG nova.compute.manager [req-3f3a3e39-e65a-4814-b9df-81ab64aff6dc req-7676ab0d-6969-4cc3-84f1-27bdaf747ccc service nova] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Received event network-vif-plugged-4273f76f-d31b-48bc-92b5-3997783ef4d6 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:04:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3f3a3e39-e65a-4814-b9df-81ab64aff6dc req-7676ab0d-6969-4cc3-84f1-27bdaf747ccc service nova] Acquiring lock "090405b6-77e0-4f28-bd8d-e7fccfa894b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:04:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3f3a3e39-e65a-4814-b9df-81ab64aff6dc req-7676ab0d-6969-4cc3-84f1-27bdaf747ccc service nova] Lock "090405b6-77e0-4f28-bd8d-e7fccfa894b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:04:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3f3a3e39-e65a-4814-b9df-81ab64aff6dc req-7676ab0d-6969-4cc3-84f1-27bdaf747ccc service nova] Lock "090405b6-77e0-4f28-bd8d-e7fccfa894b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:04:08 user nova-compute[73056]: DEBUG nova.compute.manager [req-3f3a3e39-e65a-4814-b9df-81ab64aff6dc req-7676ab0d-6969-4cc3-84f1-27bdaf747ccc service nova] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] No waiting events found dispatching network-vif-plugged-4273f76f-d31b-48bc-92b5-3997783ef4d6 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:04:08 user nova-compute[73056]: WARNING nova.compute.manager [req-3f3a3e39-e65a-4814-b9df-81ab64aff6dc req-7676ab0d-6969-4cc3-84f1-27bdaf747ccc service nova] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Received unexpected event network-vif-plugged-4273f76f-d31b-48bc-92b5-3997783ef4d6 for instance with vm_state building and task_state spawning.
Aug 14 17:04:08 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:04:08 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 17:04:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:04:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:04:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:04:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:04:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:04:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:04:08 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 17:04:08 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692032648.7965477, 090405b6-77e0-4f28-bd8d-e7fccfa894b8 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:04:08 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] VM Started (Lifecycle Event)
Aug 14 17:04:08 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:04:08 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 17:04:08 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 17:04:08 user nova-compute[73056]: INFO nova.compute.manager [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Took 7.29 seconds to spawn the instance on the hypervisor.
Aug 14 17:04:08 user nova-compute[73056]: DEBUG nova.compute.manager [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:04:09 user nova-compute[73056]: INFO nova.compute.manager [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Took 7.95 seconds to build instance.
Aug 14 17:04:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-12986acd-9855-428e-98e9-68c98e341db7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "090405b6-77e0-4f28-bd8d-e7fccfa894b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.046s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:04:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:04:11 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:04:13 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:04:13 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 17:04:13 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Rebuilding the list of instances to heal {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 17:04:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-5191b082-a6f3-467c-b28b-fda85e15f330" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:04:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-5191b082-a6f3-467c-b28b-fda85e15f330" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:04:13 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 17:04:13 user nova-compute[73056]: DEBUG nova.objects.instance [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lazy-loading 'info_cache' on Instance uuid 5191b082-a6f3-467c-b28b-fda85e15f330 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:04:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:04:14 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Updating instance_info_cache with network_info: [{"id": "dee958cc-5a62-479c-8429-4c503bef3672", "address": "fa:16:3e:3e:a3:b5", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee958cc-5a", "ovs_interfaceid": "dee958cc-5a62-479c-8429-4c503bef3672", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:04:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-5191b082-a6f3-467c-b28b-fda85e15f330" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:04:14 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 17:04:14 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:04:15 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:04:16 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:04:18 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:04:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:04:19 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:04:19 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:04:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:04:20 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:04:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:04:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:04:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:04:20 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 17:04:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89132752-29cb-463d-aec4-07d8c145f4d9/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:04:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89132752-29cb-463d-aec4-07d8c145f4d9/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:04:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89132752-29cb-463d-aec4-07d8c145f4d9/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:04:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89132752-29cb-463d-aec4-07d8c145f4d9/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:04:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:04:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:04:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:04:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:04:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 17:04:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:04:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:04:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:04:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:04:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:04:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:04:21 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:04:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:04:22 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:04:22 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:04:22 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=8164MB free_disk=25.107383728027344GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 17:04:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:04:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:04:22 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 5191b082-a6f3-467c-b28b-fda85e15f330 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:04:22 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance fb1a193b-73b7-4690-8571-be9af04b3b14 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:04:22 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 57225bb2-dbce-4212-b363-8dc34af05cce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:04:22 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 89132752-29cb-463d-aec4-07d8c145f4d9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:04:22 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 090405b6-77e0-4f28-bd8d-e7fccfa894b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:04:22 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 17:04:22 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 17:04:22 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:04:22 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:04:22 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 17:04:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.311s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:04:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:04:24 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:04:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:04:29 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:04:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:04:34 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:04:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:04:39 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:04:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:04:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:04:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:04:54 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:04:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:05:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:05:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:05:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:05:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:05:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:05:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:05:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:05:09 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:05:09 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:05:09 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 17:05:11 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:05:13 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:05:13 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 17:05:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-fb1a193b-73b7-4690-8571-be9af04b3b14" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:05:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-fb1a193b-73b7-4690-8571-be9af04b3b14" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:05:13 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 17:05:13 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Updating instance_info_cache with network_info: [{"id": "852ab20a-9a1b-47c5-b85e-52a44fff3e36", "address": "fa:16:3e:32:95:fb", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852ab20a-9a", "ovs_interfaceid": "852ab20a-9a1b-47c5-b85e-52a44fff3e36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:05:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-fb1a193b-73b7-4690-8571-be9af04b3b14" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:05:13 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 17:05:14 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:05:16 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:05:18 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:05:18 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:05:19 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:05:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:05:22 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:05:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:05:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:05:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:05:22 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 17:05:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89132752-29cb-463d-aec4-07d8c145f4d9/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89132752-29cb-463d-aec4-07d8c145f4d9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89132752-29cb-463d-aec4-07d8c145f4d9/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89132752-29cb-463d-aec4-07d8c145f4d9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 17:05:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:24 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:05:24 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:05:24 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=8384MB free_disk=25.078369140625GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 17:05:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:05:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:05:24 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 5191b082-a6f3-467c-b28b-fda85e15f330 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:05:24 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance fb1a193b-73b7-4690-8571-be9af04b3b14 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:05:24 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 57225bb2-dbce-4212-b363-8dc34af05cce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:05:24 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 89132752-29cb-463d-aec4-07d8c145f4d9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:05:24 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 090405b6-77e0-4f28-bd8d-e7fccfa894b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:05:24 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 17:05:24 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 17:05:24 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:05:24 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:05:24 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 17:05:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.292s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:05:24 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:05:25 user nova-compute[73056]: DEBUG nova.compute.manager [req-a6781704-0cd2-4155-b95a-0574aad11f5b req-8eed32c5-cbde-4953-b41c-645990065be6 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received event network-changed-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:05:25 user nova-compute[73056]: DEBUG nova.compute.manager [req-a6781704-0cd2-4155-b95a-0574aad11f5b req-8eed32c5-cbde-4953-b41c-645990065be6 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Refreshing instance network info cache due to event network-changed-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 17:05:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a6781704-0cd2-4155-b95a-0574aad11f5b req-8eed32c5-cbde-4953-b41c-645990065be6 service nova] Acquiring lock "refresh_cache-57225bb2-dbce-4212-b363-8dc34af05cce" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:05:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a6781704-0cd2-4155-b95a-0574aad11f5b req-8eed32c5-cbde-4953-b41c-645990065be6 service nova] Acquired lock "refresh_cache-57225bb2-dbce-4212-b363-8dc34af05cce" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:05:25 user nova-compute[73056]: DEBUG nova.network.neutron [req-a6781704-0cd2-4155-b95a-0574aad11f5b req-8eed32c5-cbde-4953-b41c-645990065be6 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Refreshing network info cache for port 2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 17:05:25 user nova-compute[73056]: DEBUG nova.network.neutron [req-a6781704-0cd2-4155-b95a-0574aad11f5b req-8eed32c5-cbde-4953-b41c-645990065be6 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Updated VIF entry in instance network info cache for port 2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 17:05:25 user nova-compute[73056]: DEBUG nova.network.neutron [req-a6781704-0cd2-4155-b95a-0574aad11f5b req-8eed32c5-cbde-4953-b41c-645990065be6 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Updating instance_info_cache with network_info: [{"id": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "address": "fa:16:3e:8c:b4:10", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4f4ff4-8e", "ovs_interfaceid": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:05:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-a6781704-0cd2-4155-b95a-0574aad11f5b req-8eed32c5-cbde-4953-b41c-645990065be6 service nova] Releasing lock "refresh_cache-57225bb2-dbce-4212-b363-8dc34af05cce" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:05:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:05:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "57225bb2-dbce-4212-b363-8dc34af05cce" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:05:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "57225bb2-dbce-4212-b363-8dc34af05cce" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:05:29 user nova-compute[73056]: DEBUG nova.objects.instance [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lazy-loading 'flavor' on Instance uuid 57225bb2-dbce-4212-b363-8dc34af05cce {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:05:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "57225bb2-dbce-4212-b363-8dc34af05cce" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:05:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "57225bb2-dbce-4212-b363-8dc34af05cce" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:05:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "57225bb2-dbce-4212-b363-8dc34af05cce" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:05:29 user nova-compute[73056]: INFO nova.compute.manager [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Attaching volume a66a398d-04ae-4635-ab42-f6a387452e58 to /dev/vdb
Aug 14 17:05:29 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:05:29 user nova-compute[73056]: DEBUG os_brick.utils [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 17:05:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:29 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[332439f0-41aa-4578-b2ab-a7bc843ba645]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:05:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:29 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f830ca75-4ed6-4a55-befb-15cdf6d9af7f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:05:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:29 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a5ad1f-b74d-4aa4-9b11-90f66e7be13b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:05:29 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff09e902-9e03-4a9c-9ba1-1395cd8aa97c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:05:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 17:05:29 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 17:05:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 17:05:29 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 17:05:29 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca2417c-666c-4e4a-a441-b870c4fd225d]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:05:29 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 17:05:29 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 17:05:29 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 17:05:29 user nova-compute[73056]: DEBUG os_brick.utils [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 17:05:29 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Updating existing volume attachment record: 22538233-83b9-4505-be88-982655756c41 {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 17:05:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:05:34 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:05:37 user nova-compute[73056]: DEBUG nova.compute.manager [req-40d2568e-3473-4321-b078-44666b0ff7c4 req-1853382b-fa17-4bdb-9775-43a9b901189b service nova] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Received event network-changed-70c729e6-663f-401d-8265-4bfda2634d00 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:05:37 user nova-compute[73056]: DEBUG nova.compute.manager [req-40d2568e-3473-4321-b078-44666b0ff7c4 req-1853382b-fa17-4bdb-9775-43a9b901189b service nova] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Refreshing instance network info cache due to event network-changed-70c729e6-663f-401d-8265-4bfda2634d00. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 17:05:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-40d2568e-3473-4321-b078-44666b0ff7c4 req-1853382b-fa17-4bdb-9775-43a9b901189b service nova] Acquiring lock "refresh_cache-89132752-29cb-463d-aec4-07d8c145f4d9" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:05:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-40d2568e-3473-4321-b078-44666b0ff7c4 req-1853382b-fa17-4bdb-9775-43a9b901189b service nova] Acquired lock "refresh_cache-89132752-29cb-463d-aec4-07d8c145f4d9" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:05:37 user nova-compute[73056]: DEBUG nova.network.neutron [req-40d2568e-3473-4321-b078-44666b0ff7c4 req-1853382b-fa17-4bdb-9775-43a9b901189b service nova] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Refreshing network info cache for port 70c729e6-663f-401d-8265-4bfda2634d00 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 17:05:37 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 17:05:37 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ocqrgTUL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 17:05:37 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 17:05:37 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 17:05:37 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 17:05:37 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 17:05:37 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 17:05:37 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 17:05:37 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 17:05:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a0fe75-93d7-482a-8f6a-72e555411283]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 17:05:38 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b252e320-22ae-4e79-b9b9-d88538aa791e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58] added
Aug 14 17:05:38 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a358001-6f9d-4ed9-a015-fa311cbfec38]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a16d54f-3432-4c9d-b311-bada1c4f518b]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ocqrgTUL {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ocqrgTUL" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1287e2d-d5fb-4a48-873f-5ed68b3c6734]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ocqrgTUL'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ebbe1d-7f1c-44dc-a0f4-66e3ad60b2d6]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c33c1ee-e34b-46d6-a77f-61a48c579863]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 17:05:38 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 17:05:38 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[672100f8-3be9-45ed-992b-f2140f6bfeba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58, portal: 172.16.0.220,3260]
Aug 14 17:05:38 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58, portal: 172.16.0.220,3260] successful.
Aug 14 17:05:38 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[830c5521-580d-4dcd-af7c-3685778c9a9b]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca6e8cc-17be-497b-8622-090f284e3e00]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 17:05:38 user nova-compute[73056]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 (non-flash)
Aug 14 17:05:38 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 17:05:38 user nova-compute[73056]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 (non-flash)
Aug 14 17:05:38 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b911acb8-0476-4c42-8cc4-c08e3e70cf6d]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ocqrgTUL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG nova.network.neutron [req-40d2568e-3473-4321-b078-44666b0ff7c4 req-1853382b-fa17-4bdb-9775-43a9b901189b service nova] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Updated VIF entry in instance network info cache for port 70c729e6-663f-401d-8265-4bfda2634d00. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG nova.network.neutron [req-40d2568e-3473-4321-b078-44666b0ff7c4 req-1853382b-fa17-4bdb-9775-43a9b901189b service nova] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Updating instance_info_cache with network_info: [{"id": "70c729e6-663f-401d-8265-4bfda2634d00", "address": "fa:16:3e:2a:5d:a0", "network": {"id": "cd0faadc-916c-43e7-bc06-21c25481110a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-646602137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6067a4308576451784b4be7ba26c7c8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70c729e6-66", "ovs_interfaceid": "70c729e6-663f-401d-8265-4bfda2634d00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-40d2568e-3473-4321-b078-44666b0ff7c4 req-1853382b-fa17-4bdb-9775-43a9b901189b service nova] Releasing lock "refresh_cache-89132752-29cb-463d-aec4-07d8c145f4d9" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Acquiring lock "89132752-29cb-463d-aec4-07d8c145f4d9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lock "89132752-29cb-463d-aec4-07d8c145f4d9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG nova.objects.instance [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lazy-loading 'flavor' on Instance uuid 89132752-29cb-463d-aec4-07d8c145f4d9 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:05:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lock "89132752-29cb-463d-aec4-07d8c145f4d9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:05:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Acquiring lock "89132752-29cb-463d-aec4-07d8c145f4d9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:05:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lock "89132752-29cb-463d-aec4-07d8c145f4d9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:05:39 user nova-compute[73056]: INFO nova.compute.manager [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Attaching volume 2b709b5d-ea76-4c76-9119-0f688da3804d to /dev/vdb
Aug 14 17:05:39 user nova-compute[73056]: DEBUG os_brick.utils [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 17:05:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[3166140f-160f-4ab1-a73e-0a7408707a5c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:05:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[9733da18-65df-4ea5-a4ed-2a2a2295054f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:05:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de841df-6ced-41ca-8079-f3a16910fca9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:05:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa061cc-6e50-4238-97be-3210b7639081]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:05:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 17:05:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 17:05:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 17:05:39 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 17:05:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c517b795-cc14-4b04-867c-097960347d4b]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:05:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 17:05:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 17:05:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 17:05:39 user nova-compute[73056]: DEBUG os_brick.utils [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 17:05:39 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Updating existing volume attachment record: df3f172b-4b70-49e8-9ae0-6576970b63d7 {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 17:05:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 17:05:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26163313732616233', 'path': '/dev/sdb'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 17:05:39 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163313732616233', 'path': '/dev/sdb'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 17:05:39 user nova-compute[73056]: DEBUG nova.objects.instance [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lazy-loading 'flavor' on Instance uuid 57225bb2-dbce-4212-b363-8dc34af05cce {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:05:39 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 17:05:39 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 17:05:39 user nova-compute[73056]:   <source dev="/dev/sdb"/>
Aug 14 17:05:39 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 17:05:39 user nova-compute[73056]:   <serial>a66a398d-04ae-4635-ab42-f6a387452e58</serial>
Aug 14 17:05:39 user nova-compute[73056]: </disk>
Aug 14 17:05:39 user nova-compute[73056]:  {{(pid=73056) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 17:05:39 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 17:05:39 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 17:05:39 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] No VIF found with MAC fa:16:3e:8c:b4:10, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 17:05:39 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:05:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-28179baa-03fc-4429-824a-53fdef7c456a tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "57225bb2-dbce-4212-b363-8dc34af05cce" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.107s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:05:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c5009e29-bf8c-4d95-a993-320f162c38f1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "57225bb2-dbce-4212-b363-8dc34af05cce" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:05:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c5009e29-bf8c-4d95-a993-320f162c38f1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "57225bb2-dbce-4212-b363-8dc34af05cce" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:05:40 user nova-compute[73056]: DEBUG nova.compute.manager [None req-c5009e29-bf8c-4d95-a993-320f162c38f1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:05:40 user nova-compute[73056]: DEBUG nova.compute.manager [None req-c5009e29-bf8c-4d95-a993-320f162c38f1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73056) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 14 17:05:40 user nova-compute[73056]: DEBUG nova.objects.instance [None req-c5009e29-bf8c-4d95-a993-320f162c38f1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lazy-loading 'flavor' on Instance uuid 57225bb2-dbce-4212-b363-8dc34af05cce {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:05:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:05:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:05:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:05:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:05:41 user nova-compute[73056]: DEBUG nova.compute.manager [req-908b1ba3-5b2d-4c71-979b-4880e4695a67 req-4eacaa65-c2d6-4f3f-955f-a28cce8af385 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received event network-vif-unplugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:05:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-908b1ba3-5b2d-4c71-979b-4880e4695a67 req-4eacaa65-c2d6-4f3f-955f-a28cce8af385 service nova] Acquiring lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:05:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-908b1ba3-5b2d-4c71-979b-4880e4695a67 req-4eacaa65-c2d6-4f3f-955f-a28cce8af385 service nova] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:05:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-908b1ba3-5b2d-4c71-979b-4880e4695a67 req-4eacaa65-c2d6-4f3f-955f-a28cce8af385 service nova] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:05:41 user nova-compute[73056]: DEBUG nova.compute.manager [req-908b1ba3-5b2d-4c71-979b-4880e4695a67 req-4eacaa65-c2d6-4f3f-955f-a28cce8af385 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] No waiting events found dispatching network-vif-unplugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:05:41 user nova-compute[73056]: WARNING nova.compute.manager [req-908b1ba3-5b2d-4c71-979b-4880e4695a67 req-4eacaa65-c2d6-4f3f-955f-a28cce8af385 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received unexpected event network-vif-unplugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a for instance with vm_state active and task_state powering-off.
Aug 14 17:05:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:05:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:05:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:05:41 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Instance destroyed successfully.
Aug 14 17:05:41 user nova-compute[73056]: DEBUG nova.compute.manager [None req-c5009e29-bf8c-4d95-a993-320f162c38f1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:05:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:05:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c5009e29-bf8c-4d95-a993-320f162c38f1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "57225bb2-dbce-4212-b363-8dc34af05cce" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.889s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:05:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:05:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:05:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:05:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:05:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:05:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:05:43 user nova-compute[73056]: DEBUG nova.compute.manager [req-1a54d3ed-22c2-45b7-bb9a-87b71bb1987a req-80713d1b-7353-4b6a-bd68-fdab78d80822 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received event network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:05:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1a54d3ed-22c2-45b7-bb9a-87b71bb1987a req-80713d1b-7353-4b6a-bd68-fdab78d80822 service nova] Acquiring lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:05:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1a54d3ed-22c2-45b7-bb9a-87b71bb1987a req-80713d1b-7353-4b6a-bd68-fdab78d80822 service nova] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:05:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1a54d3ed-22c2-45b7-bb9a-87b71bb1987a req-80713d1b-7353-4b6a-bd68-fdab78d80822 service nova] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:05:43 user nova-compute[73056]: DEBUG nova.compute.manager [req-1a54d3ed-22c2-45b7-bb9a-87b71bb1987a req-80713d1b-7353-4b6a-bd68-fdab78d80822 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] No waiting events found dispatching network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:05:43 user nova-compute[73056]: WARNING nova.compute.manager [req-1a54d3ed-22c2-45b7-bb9a-87b71bb1987a req-80713d1b-7353-4b6a-bd68-fdab78d80822 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received unexpected event network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a for instance with vm_state stopped and task_state None.
Aug 14 17:05:43 user nova-compute[73056]: DEBUG nova.compute.manager [req-1a54d3ed-22c2-45b7-bb9a-87b71bb1987a req-80713d1b-7353-4b6a-bd68-fdab78d80822 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received event network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:05:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1a54d3ed-22c2-45b7-bb9a-87b71bb1987a req-80713d1b-7353-4b6a-bd68-fdab78d80822 service nova] Acquiring lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:05:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1a54d3ed-22c2-45b7-bb9a-87b71bb1987a req-80713d1b-7353-4b6a-bd68-fdab78d80822 service nova] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:05:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1a54d3ed-22c2-45b7-bb9a-87b71bb1987a req-80713d1b-7353-4b6a-bd68-fdab78d80822 service nova] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:05:43 user nova-compute[73056]: DEBUG nova.compute.manager [req-1a54d3ed-22c2-45b7-bb9a-87b71bb1987a req-80713d1b-7353-4b6a-bd68-fdab78d80822 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] No waiting events found dispatching network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:05:43 user nova-compute[73056]: WARNING nova.compute.manager [req-1a54d3ed-22c2-45b7-bb9a-87b71bb1987a req-80713d1b-7353-4b6a-bd68-fdab78d80822 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received unexpected event network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a for instance with vm_state stopped and task_state None.
Aug 14 17:05:43 user nova-compute[73056]: DEBUG nova.compute.manager [req-1a54d3ed-22c2-45b7-bb9a-87b71bb1987a req-80713d1b-7353-4b6a-bd68-fdab78d80822 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received event network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:05:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1a54d3ed-22c2-45b7-bb9a-87b71bb1987a req-80713d1b-7353-4b6a-bd68-fdab78d80822 service nova] Acquiring lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:05:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1a54d3ed-22c2-45b7-bb9a-87b71bb1987a req-80713d1b-7353-4b6a-bd68-fdab78d80822 service nova] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:05:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1a54d3ed-22c2-45b7-bb9a-87b71bb1987a req-80713d1b-7353-4b6a-bd68-fdab78d80822 service nova] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:05:43 user nova-compute[73056]: DEBUG nova.compute.manager [req-1a54d3ed-22c2-45b7-bb9a-87b71bb1987a req-80713d1b-7353-4b6a-bd68-fdab78d80822 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] No waiting events found dispatching network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:05:43 user nova-compute[73056]: WARNING nova.compute.manager [req-1a54d3ed-22c2-45b7-bb9a-87b71bb1987a req-80713d1b-7353-4b6a-bd68-fdab78d80822 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received unexpected event network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a for instance with vm_state stopped and task_state None.
Aug 14 17:05:43 user nova-compute[73056]: DEBUG nova.compute.manager [req-1a54d3ed-22c2-45b7-bb9a-87b71bb1987a req-80713d1b-7353-4b6a-bd68-fdab78d80822 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received event network-vif-unplugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:05:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1a54d3ed-22c2-45b7-bb9a-87b71bb1987a req-80713d1b-7353-4b6a-bd68-fdab78d80822 service nova] Acquiring lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:05:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1a54d3ed-22c2-45b7-bb9a-87b71bb1987a req-80713d1b-7353-4b6a-bd68-fdab78d80822 service nova] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:05:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1a54d3ed-22c2-45b7-bb9a-87b71bb1987a req-80713d1b-7353-4b6a-bd68-fdab78d80822 service nova] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:05:43 user nova-compute[73056]: DEBUG nova.compute.manager [req-1a54d3ed-22c2-45b7-bb9a-87b71bb1987a req-80713d1b-7353-4b6a-bd68-fdab78d80822 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] No waiting events found dispatching network-vif-unplugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:05:43 user nova-compute[73056]: WARNING nova.compute.manager [req-1a54d3ed-22c2-45b7-bb9a-87b71bb1987a req-80713d1b-7353-4b6a-bd68-fdab78d80822 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received unexpected event network-vif-unplugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a for instance with vm_state stopped and task_state None.
Aug 14 17:05:43 user nova-compute[73056]: DEBUG nova.compute.manager [req-1a54d3ed-22c2-45b7-bb9a-87b71bb1987a req-80713d1b-7353-4b6a-bd68-fdab78d80822 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received event network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:05:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1a54d3ed-22c2-45b7-bb9a-87b71bb1987a req-80713d1b-7353-4b6a-bd68-fdab78d80822 service nova] Acquiring lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:05:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1a54d3ed-22c2-45b7-bb9a-87b71bb1987a req-80713d1b-7353-4b6a-bd68-fdab78d80822 service nova] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:05:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1a54d3ed-22c2-45b7-bb9a-87b71bb1987a req-80713d1b-7353-4b6a-bd68-fdab78d80822 service nova] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:05:43 user nova-compute[73056]: DEBUG nova.compute.manager [req-1a54d3ed-22c2-45b7-bb9a-87b71bb1987a req-80713d1b-7353-4b6a-bd68-fdab78d80822 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] No waiting events found dispatching network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:05:43 user nova-compute[73056]: WARNING nova.compute.manager [req-1a54d3ed-22c2-45b7-bb9a-87b71bb1987a req-80713d1b-7353-4b6a-bd68-fdab78d80822 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received unexpected event network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a for instance with vm_state stopped and task_state None.
Aug 14 17:05:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:05:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hSZEfvUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 17:05:47 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 17:05:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 17:05:47 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 17:05:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 17:05:47 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 17:05:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0d6cc3-ff75-4cc2-8461-dc623097291f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 17:05:47 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ad39d2-00d0-438f-b894-d926cb7b7d35]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d] added
Aug 14 17:05:47 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[4239e30c-ea0c-4b7d-a693-454a560f9642]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[db94a87a-daf4-45da-9b39-4e30dd89796d]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hSZEfvUc {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hSZEfvUc" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de0d4ae-a306-43a1-9a73-a29f901479bf]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hSZEfvUc'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[facb4ee1-6e44-46ae-9462-dd336058080b]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[1447e26d-975a-4bfc-b438-91e857b44eda]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 17:05:47 user nova-compute[73056]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 (non-flash)
Aug 14 17:05:47 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 17:05:47 user nova-compute[73056]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 (non-flash)
Aug 14 17:05:47 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e2217b-5e7d-406e-87d9-6cfd2a4dc88f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d, portal: 172.16.0.220,3260]
Aug 14 17:05:47 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d, portal: 172.16.0.220,3260] successful.
Aug 14 17:05:47 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[20488a94-d4fe-43ab-b018-381e30224cf6]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e5334f-28fc-4445-b4fc-f51b5fbbeddc]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 17:05:47 user nova-compute[73056]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 (non-flash)
Aug 14 17:05:47 user nova-compute[73056]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d (non-flash)
Aug 14 17:05:47 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 17:05:47 user nova-compute[73056]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 (non-flash)
Aug 14 17:05:47 user nova-compute[73056]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d (non-flash)
Aug 14 17:05:47 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b326bac-1029-40d7-9fab-99f88674ba3e]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 17:05:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hSZEfvUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 17:05:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:05:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 17:05:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23466623936656136', 'path': '/dev/sdc'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 17:05:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466623936656136', 'path': '/dev/sdc'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 17:05:48 user nova-compute[73056]: DEBUG nova.objects.instance [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lazy-loading 'flavor' on Instance uuid 89132752-29cb-463d-aec4-07d8c145f4d9 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:05:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 17:05:48 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 17:05:48 user nova-compute[73056]:   <source dev="/dev/sdc"/>
Aug 14 17:05:48 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 17:05:48 user nova-compute[73056]:   <serial>2b709b5d-ea76-4c76-9119-0f688da3804d</serial>
Aug 14 17:05:48 user nova-compute[73056]: </disk>
Aug 14 17:05:48 user nova-compute[73056]:  {{(pid=73056) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 17:05:49 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 17:05:49 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 17:05:49 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] No VIF found with MAC fa:16:3e:2a:5d:a0, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 17:05:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-823f3604-a1b8-4caa-8669-5945f857e4ed tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lock "89132752-29cb-463d-aec4-07d8c145f4d9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.395s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:05:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:05:52 user nova-compute[73056]: DEBUG nova.compute.manager [None req-e8a524ab-b484-4988-9e54-9007c7dfbecd tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:05:52 user nova-compute[73056]: INFO nova.compute.manager [None req-e8a524ab-b484-4988-9e54-9007c7dfbecd tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] instance snapshotting
Aug 14 17:05:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Acquiring lock "89132752-29cb-463d-aec4-07d8c145f4d9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:05:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lock "89132752-29cb-463d-aec4-07d8c145f4d9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:05:52 user nova-compute[73056]: DEBUG nova.objects.instance [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lazy-loading 'flavor' on Instance uuid 89132752-29cb-463d-aec4-07d8c145f4d9 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:05:52 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-e8a524ab-b484-4988-9e54-9007c7dfbecd tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Beginning live snapshot process
Aug 14 17:05:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lock "89132752-29cb-463d-aec4-07d8c145f4d9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:05:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Acquiring lock "89132752-29cb-463d-aec4-07d8c145f4d9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:05:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lock "89132752-29cb-463d-aec4-07d8c145f4d9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:05:52 user nova-compute[73056]: INFO nova.compute.manager [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Attaching volume 8e265319-fff8-4f0d-ba46-e0723f560381 to /dev/vdc
Aug 14 17:05:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-e8a524ab-b484-4988-9e54-9007c7dfbecd tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json -f qcow2 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:52 user nova-compute[73056]: DEBUG os_brick.utils [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 17:05:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:52 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32e6381-7df5-45c4-be9c-c211de24fefe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:05:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:52 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[074e5720-91ad-422f-9d30-dc7edbced1d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:05:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:52 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade04722-3217-4d1e-a822-0251fbe68409]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:05:52 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded3c92e-b77d-475c-bd95-6ef4771df632]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:05:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 17:05:52 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 17:05:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 17:05:52 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 17:05:52 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[364a7126-8849-4411-ae0d-c6854e5f0bc0]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:05:52 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 17:05:52 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 17:05:52 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 17:05:52 user nova-compute[73056]: DEBUG os_brick.utils [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 17:05:52 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Updating existing volume attachment record: 2139d512-5968-4305-b431-6e86fa27aa5b {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 17:05:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-e8a524ab-b484-4988-9e54-9007c7dfbecd tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-e8a524ab-b484-4988-9e54-9007c7dfbecd tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json -f qcow2 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-e8a524ab-b484-4988-9e54-9007c7dfbecd tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:52 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-e8a524ab-b484-4988-9e54-9007c7dfbecd tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-e8a524ab-b484-4988-9e54-9007c7dfbecd tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.170s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-e8a524ab-b484-4988-9e54-9007c7dfbecd tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp642dgw3w/0c5770f0b75b44eb92df21848294ba94.delta 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-e8a524ab-b484-4988-9e54-9007c7dfbecd tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp642dgw3w/0c5770f0b75b44eb92df21848294ba94.delta 1073741824" returned: 0 in 0.064s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:53 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-e8a524ab-b484-4988-9e54-9007c7dfbecd tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 14 17:05:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:05:53 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-e8a524ab-b484-4988-9e54-9007c7dfbecd tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73056) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 17:05:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-e8a524ab-b484-4988-9e54-9007c7dfbecd tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73056) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 17:05:54 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-e8a524ab-b484-4988-9e54-9007c7dfbecd tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 14 17:05:54 user nova-compute[73056]: DEBUG nova.privsep.utils [None req-e8a524ab-b484-4988-9e54-9007c7dfbecd tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73056) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 17:05:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-e8a524ab-b484-4988-9e54-9007c7dfbecd tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp642dgw3w/0c5770f0b75b44eb92df21848294ba94.delta /opt/stack/data/nova/instances/snapshots/tmp642dgw3w/0c5770f0b75b44eb92df21848294ba94 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:05:54 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:05:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-e8a524ab-b484-4988-9e54-9007c7dfbecd tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp642dgw3w/0c5770f0b75b44eb92df21848294ba94.delta /opt/stack/data/nova/instances/snapshots/tmp642dgw3w/0c5770f0b75b44eb92df21848294ba94" returned: 0 in 0.693s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:05:55 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-e8a524ab-b484-4988-9e54-9007c7dfbecd tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Snapshot extracted, beginning image upload
Aug 14 17:05:56 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692032741.4381948, 57225bb2-dbce-4212-b363-8dc34af05cce => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:05:56 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] VM Stopped (Lifecycle Event)
Aug 14 17:05:56 user nova-compute[73056]: DEBUG nova.compute.manager [None req-2637b7a8-9093-42bb-bbfa-b6737961bbb3 None None] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:05:56 user nova-compute[73056]: DEBUG nova.compute.manager [None req-2637b7a8-9093-42bb-bbfa-b6737961bbb3 None None] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 17:05:57 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-e8a524ab-b484-4988-9e54-9007c7dfbecd tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Snapshot image upload complete
Aug 14 17:05:57 user nova-compute[73056]: INFO nova.compute.manager [None req-e8a524ab-b484-4988-9e54-9007c7dfbecd tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Took 5.09 seconds to snapshot the instance on the hypervisor.
Aug 14 17:05:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:05:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OzrRXWmd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 17:06:01 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 17:06:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 17:06:01 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 17:06:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 17:06:01 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 17:06:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381 -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[12cd108c-b4d3-4da9-802b-db313e36a1ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 17:06:01 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381 -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[04199347-ec41-4ca7-a69f-36e9a762d13e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381] added
Aug 14 17:06:01 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b102934-027a-4703-8099-66080287ffd4]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[136d62e3-17ad-4401-a5b8-1605b35fcb7a]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OzrRXWmd {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OzrRXWmd" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fe3ce8-3126-4302-80e1-1964cfc56462]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OzrRXWmd'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34efb8c-f769-480b-97cf-dc22a8e8692a]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[412cd6ac-72dd-43d5-a795-1d1d5693acf8]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 17:06:01 user nova-compute[73056]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 (non-flash)
Aug 14 17:06:01 user nova-compute[73056]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d (non-flash)
Aug 14 17:06:01 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 17:06:01 user nova-compute[73056]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 (non-flash)
Aug 14 17:06:01 user nova-compute[73056]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d (non-flash)
Aug 14 17:06:01 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381 -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1fcfdb-25b7-407a-bb55-dfb2852b2955]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381, portal: 172.16.0.220,3260]
Aug 14 17:06:01 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381, portal: 172.16.0.220,3260] successful.
Aug 14 17:06:01 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[1393873a-19b8-4ce1-acf9-9a2b4439ce9b]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c37447-60c4-4ff8-b7c7-d6b6e5080855]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 17:06:01 user nova-compute[73056]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 (non-flash)
Aug 14 17:06:01 user nova-compute[73056]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d (non-flash)
Aug 14 17:06:01 user nova-compute[73056]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381 (non-flash)
Aug 14 17:06:01 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 17:06:01 user nova-compute[73056]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 (non-flash)
Aug 14 17:06:01 user nova-compute[73056]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d (non-flash)
Aug 14 17:06:01 user nova-compute[73056]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381 (non-flash)
Aug 14 17:06:01 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] HCTL ('36', '-', '-', 0) found on session 53 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d738b9-9200-4492-8b5c-f3d041b8274b]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:06:01 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Searching for a device in session 53 and hctl ['36', '*', '*', 0] yield: None {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 17:06:02 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Searching for a device in session 53 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 17:06:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OzrRXWmd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 17:06:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 17:06:02 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23533613062366366', 'path': '/dev/sde'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 17:06:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533613062366366', 'path': '/dev/sde'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 17:06:02 user nova-compute[73056]: DEBUG nova.objects.instance [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lazy-loading 'flavor' on Instance uuid 89132752-29cb-463d-aec4-07d8c145f4d9 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:06:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 17:06:02 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 17:06:02 user nova-compute[73056]:   <source dev="/dev/sde"/>
Aug 14 17:06:02 user nova-compute[73056]:   <target dev="vdc" bus="virtio"/>
Aug 14 17:06:02 user nova-compute[73056]:   <serial>8e265319-fff8-4f0d-ba46-e0723f560381</serial>
Aug 14 17:06:02 user nova-compute[73056]: </disk>
Aug 14 17:06:02 user nova-compute[73056]:  {{(pid=73056) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 17:06:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 17:06:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 17:06:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 17:06:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] No VIF found with MAC fa:16:3e:2a:5d:a0, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 17:06:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a491853f-879d-4e39-9512-6a604fe22b52 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lock "89132752-29cb-463d-aec4-07d8c145f4d9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.742s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:06:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-8ef9da8b-91fc-4954-8b14-96985c8db5ea tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Acquiring lock "89132752-29cb-463d-aec4-07d8c145f4d9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:06:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-8ef9da8b-91fc-4954-8b14-96985c8db5ea tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lock "89132752-29cb-463d-aec4-07d8c145f4d9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:06:04 user nova-compute[73056]: INFO nova.compute.manager [None req-8ef9da8b-91fc-4954-8b14-96985c8db5ea tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Detaching volume 8e265319-fff8-4f0d-ba46-e0723f560381
Aug 14 17:06:04 user nova-compute[73056]: INFO nova.virt.block_device [None req-8ef9da8b-91fc-4954-8b14-96985c8db5ea tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Attempting to driver detach volume 8e265319-fff8-4f0d-ba46-e0723f560381 from mountpoint /dev/vdc
Aug 14 17:06:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-8ef9da8b-91fc-4954-8b14-96985c8db5ea tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Attempting to detach device vdc from instance 89132752-29cb-463d-aec4-07d8c145f4d9 from the persistent domain config. {{(pid=73056) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 17:06:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-8ef9da8b-91fc-4954-8b14-96985c8db5ea tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 17:06:04 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 17:06:04 user nova-compute[73056]:   <source dev="/dev/sde"/>
Aug 14 17:06:04 user nova-compute[73056]:   <target dev="vdc" bus="virtio"/>
Aug 14 17:06:04 user nova-compute[73056]:   <serial>8e265319-fff8-4f0d-ba46-e0723f560381</serial>
Aug 14 17:06:04 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 17:06:04 user nova-compute[73056]: </disk>
Aug 14 17:06:04 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 17:06:04 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-8ef9da8b-91fc-4954-8b14-96985c8db5ea tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Successfully detached device vdc from instance 89132752-29cb-463d-aec4-07d8c145f4d9 from the persistent domain config.
Aug 14 17:06:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-8ef9da8b-91fc-4954-8b14-96985c8db5ea tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 89132752-29cb-463d-aec4-07d8c145f4d9 from the live domain config. {{(pid=73056) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 17:06:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-8ef9da8b-91fc-4954-8b14-96985c8db5ea tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 17:06:04 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 17:06:04 user nova-compute[73056]:   <source dev="/dev/sde"/>
Aug 14 17:06:04 user nova-compute[73056]:   <target dev="vdc" bus="virtio"/>
Aug 14 17:06:04 user nova-compute[73056]:   <serial>8e265319-fff8-4f0d-ba46-e0723f560381</serial>
Aug 14 17:06:04 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 17:06:04 user nova-compute[73056]: </disk>
Aug 14 17:06:04 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 17:06:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Received event <DeviceRemovedEvent: 1692032765.2925217, 89132752-29cb-463d-aec4-07d8c145f4d9 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73056) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-8ef9da8b-91fc-4954-8b14-96985c8db5ea tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 89132752-29cb-463d-aec4-07d8c145f4d9 {{(pid=73056) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 17:06:05 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-8ef9da8b-91fc-4954-8b14-96985c8db5ea tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Successfully detached device vdc from instance 89132752-29cb-463d-aec4-07d8c145f4d9 from the live domain config.
Aug 14 17:06:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ef9da8b-91fc-4954-8b14-96985c8db5ea tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef9da8b-91fc-4954-8b14-96985c8db5ea tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OzrRXWmd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 17:06:05 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-8ef9da8b-91fc-4954-8b14-96985c8db5ea tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 17:06:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-8ef9da8b-91fc-4954-8b14-96985c8db5ea tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-8ef9da8b-91fc-4954-8b14-96985c8db5ea tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef9da8b-91fc-4954-8b14-96985c8db5ea tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a7003b-2d60-47c1-8737-edd95dd1e20a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[256ff303-ae5b-473c-8bba-6a5e52ab1b76]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef9da8b-91fc-4954-8b14-96985c8db5ea tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 17:06:05 user nova-compute[73056]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 (non-flash)
Aug 14 17:06:05 user nova-compute[73056]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d (non-flash)
Aug 14 17:06:05 user nova-compute[73056]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381 (non-flash)
Aug 14 17:06:05 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef9da8b-91fc-4954-8b14-96985c8db5ea tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 17:06:05 user nova-compute[73056]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 (non-flash)
Aug 14 17:06:05 user nova-compute[73056]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d (non-flash)
Aug 14 17:06:05 user nova-compute[73056]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381 (non-flash)
Aug 14 17:06:05 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef9da8b-91fc-4954-8b14-96985c8db5ea tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff334337d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381'): ({'sde'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-8ef9da8b-91fc-4954-8b14-96985c8db5ea tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Removing single pathed devices sde {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac8ff81-309e-4805-920f-1d7c45bbfaab]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[68da0749-b496-494d-85bb-be349778a379]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-8ef9da8b-91fc-4954-8b14-96985c8db5ea tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Flushing IO for device /dev/sde {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6c1558-836f-4e02-a9d0-a4e5138e258b]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-8ef9da8b-91fc-4954-8b14-96985c8db5ea tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85073a1-0832-40ab-86f0-d71a187ff325]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-8ef9da8b-91fc-4954-8b14-96985c8db5ea tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-8ef9da8b-91fc-4954-8b14-96985c8db5ea tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] SCSI volumes sde have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef9da8b-91fc-4954-8b14-96985c8db5ea tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e653572a-807a-4053-931a-f79a2a088300]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef9da8b-91fc-4954-8b14-96985c8db5ea tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381 -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93d7fe6-93a3-42ba-b831-a96131e8dfa1]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef9da8b-91fc-4954-8b14-96985c8db5ea tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381, portal: 172.16.0.220,3260]
Aug 14 17:06:05 user nova-compute[73056]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381, portal: 172.16.0.220,3260] successful.
Aug 14 17:06:05 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381 -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e265319-fff8-4f0d-ba46-e0723f560381 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bceb11-df22-4c64-a9ae-29329670b2ab]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef9da8b-91fc-4954-8b14-96985c8db5ea tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-8ef9da8b-91fc-4954-8b14-96985c8db5ea tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef9da8b-91fc-4954-8b14-96985c8db5ea tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] <== disconnect_volume: return (293ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 17:06:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ef9da8b-91fc-4954-8b14-96985c8db5ea tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 17:06:06 user nova-compute[73056]: DEBUG nova.objects.instance [None req-8ef9da8b-91fc-4954-8b14-96985c8db5ea tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lazy-loading 'flavor' on Instance uuid 89132752-29cb-463d-aec4-07d8c145f4d9 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:06:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-8ef9da8b-91fc-4954-8b14-96985c8db5ea tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lock "89132752-29cb-463d-aec4-07d8c145f4d9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.657s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:06:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:06:11 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:06:11 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:06:11 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 17:06:12 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:06:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:06:14 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:06:14 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 17:06:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-57225bb2-dbce-4212-b363-8dc34af05cce" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:06:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-57225bb2-dbce-4212-b363-8dc34af05cce" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:06:14 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 17:06:14 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:06:15 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Updating instance_info_cache with network_info: [{"id": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "address": "fa:16:3e:8c:b4:10", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4f4ff4-8e", "ovs_interfaceid": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:06:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-57225bb2-dbce-4212-b363-8dc34af05cce" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:06:15 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 17:06:18 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:06:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:06:20 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:06:20 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:06:20 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:06:22 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:06:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:06:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:06:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:06:22 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 17:06:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89132752-29cb-463d-aec4-07d8c145f4d9/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:06:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89132752-29cb-463d-aec4-07d8c145f4d9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:06:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89132752-29cb-463d-aec4-07d8c145f4d9/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:06:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89132752-29cb-463d-aec4-07d8c145f4d9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:06:22 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 17:06:22 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:06:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:06:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:06:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:06:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 17:06:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:06:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:06:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:06:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:06:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:06:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:06:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:06:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:06:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 17:06:24 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:06:24 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:06:24 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=8473MB free_disk=25.027114868164062GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 17:06:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:06:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:06:24 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 5191b082-a6f3-467c-b28b-fda85e15f330 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:06:24 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance fb1a193b-73b7-4690-8571-be9af04b3b14 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:06:24 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 57225bb2-dbce-4212-b363-8dc34af05cce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:06:24 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 89132752-29cb-463d-aec4-07d8c145f4d9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:06:24 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 090405b6-77e0-4f28-bd8d-e7fccfa894b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:06:24 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 17:06:24 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 17:06:24 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:06:24 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:06:24 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 17:06:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.301s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:06:24 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:06:25 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:06:29 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:06:34 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:06:39 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:06:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:06:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:06:54 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6602f9fd-3c20-4ecb-b6bb-25147fd15b57 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Acquiring lock "89132752-29cb-463d-aec4-07d8c145f4d9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6602f9fd-3c20-4ecb-b6bb-25147fd15b57 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lock "89132752-29cb-463d-aec4-07d8c145f4d9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:06:55 user nova-compute[73056]: INFO nova.compute.manager [None req-6602f9fd-3c20-4ecb-b6bb-25147fd15b57 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Detaching volume 2b709b5d-ea76-4c76-9119-0f688da3804d
Aug 14 17:06:55 user nova-compute[73056]: INFO nova.virt.block_device [None req-6602f9fd-3c20-4ecb-b6bb-25147fd15b57 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Attempting to driver detach volume 2b709b5d-ea76-4c76-9119-0f688da3804d from mountpoint /dev/vdb
Aug 14 17:06:55 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6602f9fd-3c20-4ecb-b6bb-25147fd15b57 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Attempting to detach device vdb from instance 89132752-29cb-463d-aec4-07d8c145f4d9 from the persistent domain config. {{(pid=73056) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-6602f9fd-3c20-4ecb-b6bb-25147fd15b57 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 17:06:55 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 17:06:55 user nova-compute[73056]:   <source dev="/dev/sdc"/>
Aug 14 17:06:55 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 17:06:55 user nova-compute[73056]:   <serial>2b709b5d-ea76-4c76-9119-0f688da3804d</serial>
Aug 14 17:06:55 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 17:06:55 user nova-compute[73056]: </disk>
Aug 14 17:06:55 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 17:06:55 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-6602f9fd-3c20-4ecb-b6bb-25147fd15b57 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Successfully detached device vdb from instance 89132752-29cb-463d-aec4-07d8c145f4d9 from the persistent domain config.
Aug 14 17:06:55 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6602f9fd-3c20-4ecb-b6bb-25147fd15b57 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 89132752-29cb-463d-aec4-07d8c145f4d9 from the live domain config. {{(pid=73056) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-6602f9fd-3c20-4ecb-b6bb-25147fd15b57 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 17:06:55 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 17:06:55 user nova-compute[73056]:   <source dev="/dev/sdc"/>
Aug 14 17:06:55 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 17:06:55 user nova-compute[73056]:   <serial>2b709b5d-ea76-4c76-9119-0f688da3804d</serial>
Aug 14 17:06:55 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 17:06:55 user nova-compute[73056]: </disk>
Aug 14 17:06:55 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Received event <DeviceRemovedEvent: 1692032815.7506616, 89132752-29cb-463d-aec4-07d8c145f4d9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73056) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6602f9fd-3c20-4ecb-b6bb-25147fd15b57 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 89132752-29cb-463d-aec4-07d8c145f4d9 {{(pid=73056) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 17:06:55 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-6602f9fd-3c20-4ecb-b6bb-25147fd15b57 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Successfully detached device vdb from instance 89132752-29cb-463d-aec4-07d8c145f4d9 from the live domain config.
Aug 14 17:06:55 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6602f9fd-3c20-4ecb-b6bb-25147fd15b57 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6602f9fd-3c20-4ecb-b6bb-25147fd15b57 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hSZEfvUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 17:06:55 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-6602f9fd-3c20-4ecb-b6bb-25147fd15b57 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 17:06:55 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-6602f9fd-3c20-4ecb-b6bb-25147fd15b57 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-6602f9fd-3c20-4ecb-b6bb-25147fd15b57 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6602f9fd-3c20-4ecb-b6bb-25147fd15b57 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4adaf2-5211-4a18-b991-bbc67fd5fdb9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52e1b9f-dedb-4ba2-8f6b-bd1f06f2b413]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6602f9fd-3c20-4ecb-b6bb-25147fd15b57 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 17:06:55 user nova-compute[73056]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 (non-flash)
Aug 14 17:06:55 user nova-compute[73056]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d (non-flash)
Aug 14 17:06:55 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6602f9fd-3c20-4ecb-b6bb-25147fd15b57 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 17:06:55 user nova-compute[73056]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 (non-flash)
Aug 14 17:06:55 user nova-compute[73056]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d (non-flash)
Aug 14 17:06:55 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6602f9fd-3c20-4ecb-b6bb-25147fd15b57 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff32fcad750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d'): ({'sdc'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-6602f9fd-3c20-4ecb-b6bb-25147fd15b57 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Removing single pathed devices sdc {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f17be1-1cc0-4dc3-9770-3465606987c0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ef2ac9-1797-4a76-8f6b-085dbb18f185]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-6602f9fd-3c20-4ecb-b6bb-25147fd15b57 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Flushing IO for device /dev/sdc {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[0547f6e3-a636-4dfc-a076-96eb64b2e347]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-6602f9fd-3c20-4ecb-b6bb-25147fd15b57 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad992401-05db-4549-991d-d2c6c1dc2129]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-6602f9fd-3c20-4ecb-b6bb-25147fd15b57 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-6602f9fd-3c20-4ecb-b6bb-25147fd15b57 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] SCSI volumes sdc have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6602f9fd-3c20-4ecb-b6bb-25147fd15b57 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc28d16c-73f1-4d6b-801e-36a7c31e8f0a]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6602f9fd-3c20-4ecb-b6bb-25147fd15b57 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:06:55 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:06:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:06:56 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b060d91-1fd4-42d2-a9b4-6de796660409]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:06:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6602f9fd-3c20-4ecb-b6bb-25147fd15b57 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d, portal: 172.16.0.220,3260]
Aug 14 17:06:56 user nova-compute[73056]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d, portal: 172.16.0.220,3260] successful.
Aug 14 17:06:56 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:06:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:06:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b709b5d-ea76-4c76-9119-0f688da3804d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:06:56 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc654b9-d5e7-446d-bc03-cf449691ff66]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:06:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6602f9fd-3c20-4ecb-b6bb-25147fd15b57 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:06:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-6602f9fd-3c20-4ecb-b6bb-25147fd15b57 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 17:06:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6602f9fd-3c20-4ecb-b6bb-25147fd15b57 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] <== disconnect_volume: return (273ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 17:06:56 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6602f9fd-3c20-4ecb-b6bb-25147fd15b57 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 17:06:56 user nova-compute[73056]: DEBUG nova.objects.instance [None req-6602f9fd-3c20-4ecb-b6bb-25147fd15b57 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lazy-loading 'flavor' on Instance uuid 89132752-29cb-463d-aec4-07d8c145f4d9 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:06:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6602f9fd-3c20-4ecb-b6bb-25147fd15b57 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lock "89132752-29cb-463d-aec4-07d8c145f4d9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.587s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:06:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:06:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:06:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:06:59 user nova-compute[73056]: DEBUG nova.compute.manager [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 17:07:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:07:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:07:00 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 17:07:00 user nova-compute[73056]: INFO nova.compute.claims [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Claim successful on node user
Aug 14 17:07:00 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:07:00 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:07:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.325s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:07:00 user nova-compute[73056]: DEBUG nova.compute.manager [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 17:07:00 user nova-compute[73056]: DEBUG nova.compute.manager [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 17:07:00 user nova-compute[73056]: DEBUG nova.network.neutron [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 17:07:00 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 17:07:00 user nova-compute[73056]: DEBUG nova.compute.manager [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 17:07:00 user nova-compute[73056]: INFO nova.virt.block_device [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Booting with volume-backed-image 80fe003b-9902-44ab-86de-a284c1e79abd at /dev/vda
Aug 14 17:07:00 user nova-compute[73056]: DEBUG nova.policy [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '958f0c79efdc4352b35874e6c6f940d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56fc678888b4653802e94ac6b47f95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 17:07:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:01 user nova-compute[73056]: DEBUG nova.network.neutron [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Successfully created port: 852aa0fc-c330-4cdf-9b88-93e0f0260f39 {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 17:07:02 user nova-compute[73056]: DEBUG nova.network.neutron [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Successfully updated port: 852aa0fc-c330-4cdf-9b88-93e0f0260f39 {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 17:07:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "refresh_cache-3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:07:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquired lock "refresh_cache-3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:07:02 user nova-compute[73056]: DEBUG nova.network.neutron [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 17:07:02 user nova-compute[73056]: DEBUG nova.compute.manager [req-4c0395fd-369c-4e03-a6b0-2d8a9701a031 req-a999c7f6-87d5-4bda-ac07-fa419130fa9b service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Received event network-changed-852aa0fc-c330-4cdf-9b88-93e0f0260f39 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:07:02 user nova-compute[73056]: DEBUG nova.compute.manager [req-4c0395fd-369c-4e03-a6b0-2d8a9701a031 req-a999c7f6-87d5-4bda-ac07-fa419130fa9b service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Refreshing instance network info cache due to event network-changed-852aa0fc-c330-4cdf-9b88-93e0f0260f39. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 17:07:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4c0395fd-369c-4e03-a6b0-2d8a9701a031 req-a999c7f6-87d5-4bda-ac07-fa419130fa9b service nova] Acquiring lock "refresh_cache-3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:07:02 user nova-compute[73056]: DEBUG nova.network.neutron [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 17:07:02 user nova-compute[73056]: DEBUG nova.network.neutron [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Updating instance_info_cache with network_info: [{"id": "852aa0fc-c330-4cdf-9b88-93e0f0260f39", "address": "fa:16:3e:9e:41:c0", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852aa0fc-c3", "ovs_interfaceid": "852aa0fc-c330-4cdf-9b88-93e0f0260f39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:07:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Releasing lock "refresh_cache-3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:07:02 user nova-compute[73056]: DEBUG nova.compute.manager [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Instance network_info: |[{"id": "852aa0fc-c330-4cdf-9b88-93e0f0260f39", "address": "fa:16:3e:9e:41:c0", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852aa0fc-c3", "ovs_interfaceid": "852aa0fc-c330-4cdf-9b88-93e0f0260f39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 17:07:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4c0395fd-369c-4e03-a6b0-2d8a9701a031 req-a999c7f6-87d5-4bda-ac07-fa419130fa9b service nova] Acquired lock "refresh_cache-3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:07:02 user nova-compute[73056]: DEBUG nova.network.neutron [req-4c0395fd-369c-4e03-a6b0-2d8a9701a031 req-a999c7f6-87d5-4bda-ac07-fa419130fa9b service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Refreshing network info cache for port 852aa0fc-c330-4cdf-9b88-93e0f0260f39 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 17:07:03 user nova-compute[73056]: DEBUG nova.network.neutron [req-4c0395fd-369c-4e03-a6b0-2d8a9701a031 req-a999c7f6-87d5-4bda-ac07-fa419130fa9b service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Updated VIF entry in instance network info cache for port 852aa0fc-c330-4cdf-9b88-93e0f0260f39. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 17:07:03 user nova-compute[73056]: DEBUG nova.network.neutron [req-4c0395fd-369c-4e03-a6b0-2d8a9701a031 req-a999c7f6-87d5-4bda-ac07-fa419130fa9b service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Updating instance_info_cache with network_info: [{"id": "852aa0fc-c330-4cdf-9b88-93e0f0260f39", "address": "fa:16:3e:9e:41:c0", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852aa0fc-c3", "ovs_interfaceid": "852aa0fc-c330-4cdf-9b88-93e0f0260f39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:07:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4c0395fd-369c-4e03-a6b0-2d8a9701a031 req-a999c7f6-87d5-4bda-ac07-fa419130fa9b service nova] Releasing lock "refresh_cache-3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:07:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:09 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:07:09 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:07:09 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 17:07:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:11 user nova-compute[73056]: DEBUG os_brick.utils [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 17:07:11 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:11 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:11 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedbeb63-4496-476d-af32-e61e40047b65]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:07:11 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:11 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:11 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e430ac-4b8b-4136-943d-cac321c62ca7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:07:11 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:11 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:11 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[0259733d-e523-4c64-ba24-c0e710e86c6e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:07:11 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[296abf91-e33d-4c4b-9034-eacb782b4097]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:07:11 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:11 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 17:07:11 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 17:07:11 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:11 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 17:07:11 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 17:07:11 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6bd069-961c-4c61-9aa8-2fb9a31f5e03]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:07:11 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 17:07:11 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 17:07:11 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 17:07:11 user nova-compute[73056]: DEBUG os_brick.utils [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 17:07:11 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Updating existing volume attachment record: b4564a46-ced7-4b90-9495-036fc31cddec {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 17:07:12 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:07:13 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:07:14 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:07:14 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 17:07:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-89132752-29cb-463d-aec4-07d8c145f4d9" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:07:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-89132752-29cb-463d-aec4-07d8c145f4d9" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:07:14 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 17:07:14 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:14 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Updating instance_info_cache with network_info: [{"id": "70c729e6-663f-401d-8265-4bfda2634d00", "address": "fa:16:3e:2a:5d:a0", "network": {"id": "cd0faadc-916c-43e7-bc06-21c25481110a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-646602137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6067a4308576451784b4be7ba26c7c8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70c729e6-66", "ovs_interfaceid": "70c729e6-663f-401d-8265-4bfda2634d00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:07:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-89132752-29cb-463d-aec4-07d8c145f4d9" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:07:14 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 17:07:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:20 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:07:21 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:07:21 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:07:21 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:07:23 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:07:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:07:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:07:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:07:23 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 17:07:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89132752-29cb-463d-aec4-07d8c145f4d9/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89132752-29cb-463d-aec4-07d8c145f4d9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89132752-29cb-463d-aec4-07d8c145f4d9/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89132752-29cb-463d-aec4-07d8c145f4d9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:24 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:24 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:24 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:24 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 17:07:24 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:24 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:24 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:24 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:24 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:24 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:24 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:24 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:24 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:24 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 17:07:25 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:07:25 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:07:25 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=8484MB free_disk=25.01818084716797GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 5191b082-a6f3-467c-b28b-fda85e15f330 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance fb1a193b-73b7-4690-8571-be9af04b3b14 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 57225bb2-dbce-4212-b363-8dc34af05cce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 89132752-29cb-463d-aec4-07d8c145f4d9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 090405b6-77e0-4f28-bd8d-e7fccfa894b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG nova.compute.manager [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 17:07:25 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Creating image(s)
Aug 14 17:07:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Did not create local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Ensure instance console log exists: /opt/stack/data/nova/instances/3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Start _get_guest_xml network_info=[{"id": "852aa0fc-c330-4cdf-9b88-93e0f0260f39", "address": "fa:16:3e:9e:41:c0", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852aa0fc-c3", "ovs_interfaceid": "852aa0fc-c330-4cdf-9b88-93e0f0260f39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kfAGgIQa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4', 'attached_at': '', 'detached_at': '', 'volume_id': '20289a71-f1fe-42af-90f7-882c2863ed6b', 'serial': '20289a71-f1fe-42af-90f7-882c2863ed6b'}, 'attachment_id': 'b4564a46-ced7-4b90-9495-036fc31cddec', 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 17:07:25 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:07:25 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:07:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kfAGgIQa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 17:07:25 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 17:07:25 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 17:07:25 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 17:07:25 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 17:07:25 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 17:07:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7902ee54-db76-4cc2-8919-b0d4fb49e4b8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 17:07:25 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[004d9edc-af79-43be-be51-1d1d6238599e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b] added
Aug 14 17:07:25 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.517s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a05386c-3bee-44e1-98db-756be0c8daba]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3a40b2-4d19-4feb-b3ec-8522e5f30f07]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kfAGgIQa {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kfAGgIQa" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9443fc0-2341-4554-b95f-894e77e8865c]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kfAGgIQa'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79921ae-6774-497e-92a8-0f175e67865b]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:07:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:26 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d446253-3389-4c9c-a657-f820516b6331]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:07:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 17:07:26 user nova-compute[73056]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 (non-flash)
Aug 14 17:07:26 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 17:07:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 17:07:26 user nova-compute[73056]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 (non-flash)
Aug 14 17:07:26 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 17:07:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:26 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c81d92-3a7d-481d-8ba3-35d9c2c0b572]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:07:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b, portal: 172.16.0.220,3260]
Aug 14 17:07:26 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b, portal: 172.16.0.220,3260] successful.
Aug 14 17:07:26 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:07:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:26 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff547fe-91d5-4d45-a067-5d07310a6240]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:07:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:07:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:26 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd9af32-257e-4007-a01e-a3ef2b7bd9b6]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:07:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 17:07:26 user nova-compute[73056]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 (non-flash)
Aug 14 17:07:26 user nova-compute[73056]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b (non-flash)
Aug 14 17:07:26 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 17:07:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 17:07:26 user nova-compute[73056]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 (non-flash)
Aug 14 17:07:26 user nova-compute[73056]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b (non-flash)
Aug 14 17:07:26 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 17:07:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 17:07:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 17:07:26 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 17:07:26 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 17:07:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:26 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[6988a99e-8c31-4078-aea7-cac84fca567e]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:07:26 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 17:07:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kfAGgIQa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 17:07:27 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 17:07:27 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26331353862646239', 'path': '/dev/sdc'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 17:07:27 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331353862646239', 'path': '/dev/sdc'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 17:07:27 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T17:06:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-632303434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-632303434',id=47,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a56fc678888b4653802e94ac6b47f95d',ramdisk_id='',reservation_id='r-sc3mfbyk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-572642883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T17:07:00Z,user_data=None,user_id='958f0c79efdc4352b35874e6c6f940d8',uuid=3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "852aa0fc-c330-4cdf-9b88-93e0f0260f39", "address": "fa:16:3e:9e:41:c0", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852aa0fc-c3", "ovs_interfaceid": "852aa0fc-c330-4cdf-9b88-93e0f0260f39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 17:07:27 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Converting VIF {"id": "852aa0fc-c330-4cdf-9b88-93e0f0260f39", "address": "fa:16:3e:9e:41:c0", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852aa0fc-c3", "ovs_interfaceid": "852aa0fc-c330-4cdf-9b88-93e0f0260f39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:07:27 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:41:c0,bridge_name='br-int',has_traffic_filtering=True,id=852aa0fc-c330-4cdf-9b88-93e0f0260f39,network=Network(ac2d700d-98d2-4459-8da8-a4858cda8864),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap852aa0fc-c3') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:07:27 user nova-compute[73056]: DEBUG nova.objects.instance [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lazy-loading 'pci_devices' on Instance uuid 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:07:27 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] End _get_guest_xml xml=<domain type="kvm">
Aug 14 17:07:27 user nova-compute[73056]:   <uuid>3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4</uuid>
Aug 14 17:07:27 user nova-compute[73056]:   <name>instance-0000002f</name>
Aug 14 17:07:27 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 17:07:27 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 17:07:27 user nova-compute[73056]:   <metadata>
Aug 14 17:07:27 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 17:07:27 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 17:07:27 user nova-compute[73056]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-632303434</nova:name>
Aug 14 17:07:27 user nova-compute[73056]:       <nova:creationTime>2023-08-14 17:07:25</nova:creationTime>
Aug 14 17:07:27 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 17:07:27 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 17:07:27 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 17:07:27 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 17:07:27 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 17:07:27 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 17:07:27 user nova-compute[73056]:       </nova:flavor>
Aug 14 17:07:27 user nova-compute[73056]:       <nova:owner>
Aug 14 17:07:27 user nova-compute[73056]:         <nova:user uuid="958f0c79efdc4352b35874e6c6f940d8">tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member</nova:user>
Aug 14 17:07:27 user nova-compute[73056]:         <nova:project uuid="a56fc678888b4653802e94ac6b47f95d">tempest-ServerBootFromVolumeStableRescueTest-572642883</nova:project>
Aug 14 17:07:27 user nova-compute[73056]:       </nova:owner>
Aug 14 17:07:27 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 17:07:27 user nova-compute[73056]:       <nova:ports>
Aug 14 17:07:27 user nova-compute[73056]:         <nova:port uuid="852aa0fc-c330-4cdf-9b88-93e0f0260f39">
Aug 14 17:07:27 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 17:07:27 user nova-compute[73056]:         </nova:port>
Aug 14 17:07:27 user nova-compute[73056]:       </nova:ports>
Aug 14 17:07:27 user nova-compute[73056]:     </nova:instance>
Aug 14 17:07:27 user nova-compute[73056]:   </metadata>
Aug 14 17:07:27 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 17:07:27 user nova-compute[73056]:     <system>
Aug 14 17:07:27 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 17:07:27 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 17:07:27 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 17:07:27 user nova-compute[73056]:       <entry name="serial">3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4</entry>
Aug 14 17:07:27 user nova-compute[73056]:       <entry name="uuid">3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4</entry>
Aug 14 17:07:27 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 17:07:27 user nova-compute[73056]:     </system>
Aug 14 17:07:27 user nova-compute[73056]:   </sysinfo>
Aug 14 17:07:27 user nova-compute[73056]:   <os>
Aug 14 17:07:27 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 17:07:27 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 17:07:27 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 17:07:27 user nova-compute[73056]:   </os>
Aug 14 17:07:27 user nova-compute[73056]:   <features>
Aug 14 17:07:27 user nova-compute[73056]:     <acpi/>
Aug 14 17:07:27 user nova-compute[73056]:     <apic/>
Aug 14 17:07:27 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 17:07:27 user nova-compute[73056]:   </features>
Aug 14 17:07:27 user nova-compute[73056]:   <clock offset="utc">
Aug 14 17:07:27 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 17:07:27 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 17:07:27 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 17:07:27 user nova-compute[73056]:   </clock>
Aug 14 17:07:27 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 17:07:27 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 17:07:27 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 17:07:27 user nova-compute[73056]:   </cpu>
Aug 14 17:07:27 user nova-compute[73056]:   <devices>
Aug 14 17:07:27 user nova-compute[73056]:     <disk type="block" device="disk">
Aug 14 17:07:27 user nova-compute[73056]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 17:07:27 user nova-compute[73056]:       <source dev="/dev/sdc"/>
Aug 14 17:07:27 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 17:07:27 user nova-compute[73056]:       <serial>20289a71-f1fe-42af-90f7-882c2863ed6b</serial>
Aug 14 17:07:27 user nova-compute[73056]:     </disk>
Aug 14 17:07:27 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 17:07:27 user nova-compute[73056]:       <mac address="fa:16:3e:9e:41:c0"/>
Aug 14 17:07:27 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 17:07:27 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 17:07:27 user nova-compute[73056]:       <target dev="tap852aa0fc-c3"/>
Aug 14 17:07:27 user nova-compute[73056]:     </interface>
Aug 14 17:07:27 user nova-compute[73056]:     <serial type="pty">
Aug 14 17:07:27 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4/console.log" append="off"/>
Aug 14 17:07:27 user nova-compute[73056]:     </serial>
Aug 14 17:07:27 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 17:07:27 user nova-compute[73056]:     <video>
Aug 14 17:07:27 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 17:07:27 user nova-compute[73056]:     </video>
Aug 14 17:07:27 user nova-compute[73056]:     <rng model="virtio">
Aug 14 17:07:27 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 17:07:27 user nova-compute[73056]:     </rng>
Aug 14 17:07:27 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 17:07:27 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 17:07:27 user nova-compute[73056]:       <stats period="10"/>
Aug 14 17:07:27 user nova-compute[73056]:     </memballoon>
Aug 14 17:07:27 user nova-compute[73056]:   </devices>
Aug 14 17:07:27 user nova-compute[73056]: </domain>
Aug 14 17:07:27 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 17:07:27 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T17:06:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-632303434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-632303434',id=47,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a56fc678888b4653802e94ac6b47f95d',ramdisk_id='',reservation_id='r-sc3mfbyk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-572642883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T17:07:00Z,user_data=None,user_id='958f0c79efdc4352b35874e6c6f940d8',uuid=3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "852aa0fc-c330-4cdf-9b88-93e0f0260f39", "address": "fa:16:3e:9e:41:c0", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852aa0fc-c3", "ovs_interfaceid": "852aa0fc-c330-4cdf-9b88-93e0f0260f39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 17:07:27 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Converting VIF {"id": "852aa0fc-c330-4cdf-9b88-93e0f0260f39", "address": "fa:16:3e:9e:41:c0", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852aa0fc-c3", "ovs_interfaceid": "852aa0fc-c330-4cdf-9b88-93e0f0260f39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:07:27 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:41:c0,bridge_name='br-int',has_traffic_filtering=True,id=852aa0fc-c330-4cdf-9b88-93e0f0260f39,network=Network(ac2d700d-98d2-4459-8da8-a4858cda8864),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap852aa0fc-c3') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:07:27 user nova-compute[73056]: DEBUG os_vif [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:41:c0,bridge_name='br-int',has_traffic_filtering=True,id=852aa0fc-c330-4cdf-9b88-93e0f0260f39,network=Network(ac2d700d-98d2-4459-8da8-a4858cda8864),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap852aa0fc-c3') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 17:07:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:07:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 17:07:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap852aa0fc-c3, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:07:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap852aa0fc-c3, col_values=(('external_ids', {'iface-id': '852aa0fc-c330-4cdf-9b88-93e0f0260f39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:41:c0', 'vm-uuid': '3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:07:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:07:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:27 user nova-compute[73056]: INFO os_vif [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:41:c0,bridge_name='br-int',has_traffic_filtering=True,id=852aa0fc-c330-4cdf-9b88-93e0f0260f39,network=Network(ac2d700d-98d2-4459-8da8-a4858cda8864),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap852aa0fc-c3')
Aug 14 17:07:27 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 17:07:27 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] No VIF found with MAC fa:16:3e:9e:41:c0, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 17:07:28 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:07:28 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73056) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 17:07:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:28 user nova-compute[73056]: DEBUG nova.compute.manager [req-6e528334-3ba3-41e0-b5eb-efa9371e59d2 req-dfde133e-7980-4ed8-b861-5039776b56a3 service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Received event network-vif-plugged-852aa0fc-c330-4cdf-9b88-93e0f0260f39 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:07:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6e528334-3ba3-41e0-b5eb-efa9371e59d2 req-dfde133e-7980-4ed8-b861-5039776b56a3 service nova] Acquiring lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:07:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6e528334-3ba3-41e0-b5eb-efa9371e59d2 req-dfde133e-7980-4ed8-b861-5039776b56a3 service nova] Lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:07:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6e528334-3ba3-41e0-b5eb-efa9371e59d2 req-dfde133e-7980-4ed8-b861-5039776b56a3 service nova] Lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:07:28 user nova-compute[73056]: DEBUG nova.compute.manager [req-6e528334-3ba3-41e0-b5eb-efa9371e59d2 req-dfde133e-7980-4ed8-b861-5039776b56a3 service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] No waiting events found dispatching network-vif-plugged-852aa0fc-c330-4cdf-9b88-93e0f0260f39 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:07:28 user nova-compute[73056]: WARNING nova.compute.manager [req-6e528334-3ba3-41e0-b5eb-efa9371e59d2 req-dfde133e-7980-4ed8-b861-5039776b56a3 service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Received unexpected event network-vif-plugged-852aa0fc-c330-4cdf-9b88-93e0f0260f39 for instance with vm_state building and task_state spawning.
Aug 14 17:07:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:30 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692032850.530912, 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:07:30 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] VM Resumed (Lifecycle Event)
Aug 14 17:07:30 user nova-compute[73056]: DEBUG nova.compute.manager [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 17:07:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 17:07:30 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Instance spawned successfully.
Aug 14 17:07:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 17:07:30 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:07:30 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 17:07:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:07:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:07:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:07:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:07:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:07:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:07:30 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 17:07:30 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692032850.5333676, 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:07:30 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] VM Started (Lifecycle Event)
Aug 14 17:07:30 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:07:30 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 17:07:30 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 17:07:30 user nova-compute[73056]: INFO nova.compute.manager [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Took 4.86 seconds to spawn the instance on the hypervisor.
Aug 14 17:07:30 user nova-compute[73056]: DEBUG nova.compute.manager [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:07:30 user nova-compute[73056]: INFO nova.compute.manager [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Took 30.69 seconds to build instance.
Aug 14 17:07:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7e6829ff-dcb9-4f37-9ff7-b4b739fa218e tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.793s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:07:30 user nova-compute[73056]: DEBUG nova.compute.manager [req-0aed96a1-c641-4805-ac0a-574d18d7aaef req-d9c89516-ca42-416b-985d-5fe00e154318 service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Received event network-vif-plugged-852aa0fc-c330-4cdf-9b88-93e0f0260f39 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:07:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0aed96a1-c641-4805-ac0a-574d18d7aaef req-d9c89516-ca42-416b-985d-5fe00e154318 service nova] Acquiring lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:07:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0aed96a1-c641-4805-ac0a-574d18d7aaef req-d9c89516-ca42-416b-985d-5fe00e154318 service nova] Lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:07:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0aed96a1-c641-4805-ac0a-574d18d7aaef req-d9c89516-ca42-416b-985d-5fe00e154318 service nova] Lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:07:30 user nova-compute[73056]: DEBUG nova.compute.manager [req-0aed96a1-c641-4805-ac0a-574d18d7aaef req-d9c89516-ca42-416b-985d-5fe00e154318 service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] No waiting events found dispatching network-vif-plugged-852aa0fc-c330-4cdf-9b88-93e0f0260f39 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:07:30 user nova-compute[73056]: WARNING nova.compute.manager [req-0aed96a1-c641-4805-ac0a-574d18d7aaef req-d9c89516-ca42-416b-985d-5fe00e154318 service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Received unexpected event network-vif-plugged-852aa0fc-c330-4cdf-9b88-93e0f0260f39 for instance with vm_state active and task_state None.
Aug 14 17:07:31 user nova-compute[73056]: DEBUG nova.objects.instance [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lazy-loading 'flavor' on Instance uuid 57225bb2-dbce-4212-b363-8dc34af05cce {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:07:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "refresh_cache-57225bb2-dbce-4212-b363-8dc34af05cce" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:07:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquired lock "refresh_cache-57225bb2-dbce-4212-b363-8dc34af05cce" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:07:31 user nova-compute[73056]: DEBUG nova.network.neutron [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 17:07:31 user nova-compute[73056]: DEBUG nova.objects.instance [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lazy-loading 'info_cache' on Instance uuid 57225bb2-dbce-4212-b363-8dc34af05cce {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:07:31 user nova-compute[73056]: DEBUG nova.network.neutron [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Updating instance_info_cache with network_info: [{"id": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "address": "fa:16:3e:8c:b4:10", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4f4ff4-8e", "ovs_interfaceid": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:07:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Releasing lock "refresh_cache-57225bb2-dbce-4212-b363-8dc34af05cce" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:07:31 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Instance destroyed successfully.
Aug 14 17:07:31 user nova-compute[73056]: DEBUG nova.objects.instance [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lazy-loading 'resources' on Instance uuid 57225bb2-dbce-4212-b363-8dc34af05cce {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:07:31 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T17:03:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1082884404',display_name='tempest-AttachVolumeTestJSON-server-1082884404',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1082884404',id=44,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPNPWJ92774fwNZF6PVgQpXcTKVtR5LMZz3xu6DLKvMpyOVFGtxgTJRS/WltAZEiJfd7Brr2rP/3+0iYPbiNk8IOQAitKjVnZlCsrC86QNIF45RYJq5300KRzpYOnBhVg==',key_name='tempest-keypair-1762591610',keypairs=<?>,launch_index=0,launched_at=2023-08-14T17:03:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='415a7291b35546b5ac324280d37d50ae',ramdisk_id='',reservation_id='r-vobfg0xl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-112776827',owner_user_name='tempest-AttachVolumeTestJSON-112776827-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T17:05:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bf4bfed609343c78b0d828db45d5ab7',uuid=57225bb2-dbce-4212-b363-8dc34af05cce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "address": "fa:16:3e:8c:b4:10", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4f4ff4-8e", "ovs_interfaceid": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 17:07:31 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Converting VIF {"id": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "address": "fa:16:3e:8c:b4:10", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4f4ff4-8e", "ovs_interfaceid": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:07:31 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b4:10,bridge_name='br-int',has_traffic_filtering=True,id=2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a,network=Network(7e2ce9fb-4bdc-441f-ae4a-30224b2712e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4f4ff4-8e') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:07:31 user nova-compute[73056]: DEBUG os_vif [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b4:10,bridge_name='br-int',has_traffic_filtering=True,id=2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a,network=Network(7e2ce9fb-4bdc-441f-ae4a-30224b2712e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4f4ff4-8e') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 17:07:31 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:31 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e4f4ff4-8e, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:07:31 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:32 user nova-compute[73056]: INFO os_vif [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b4:10,bridge_name='br-int',has_traffic_filtering=True,id=2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a,network=Network(7e2ce9fb-4bdc-441f-ae4a-30224b2712e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4f4ff4-8e')
Aug 14 17:07:32 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ocqrgTUL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 17:07:32 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ab6994-d89a-4dfa-a10e-40516bbc6989]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc33113-4ac9-4c2d-a87f-71f2af86b8b1]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 17:07:32 user nova-compute[73056]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 (non-flash)
Aug 14 17:07:32 user nova-compute[73056]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b (non-flash)
Aug 14 17:07:32 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 17:07:32 user nova-compute[73056]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 (non-flash)
Aug 14 17:07:32 user nova-compute[73056]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b (non-flash)
Aug 14 17:07:32 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3002024d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58'): ({'sdb'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Removing single pathed devices sdb {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6b2a48-e43c-4f59-b610-bf49ba4faac0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9873bc6-4efd-4519-9a25-476c1d08ecf5]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Flushing IO for device /dev/sdb {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d55f772-f6ec-4ec2-b2a3-cd320466a722]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fc532d-ebe9-4b4c-9c11-3a3b11e2df14]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] SCSI volumes sdb have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e8c708-4e79-4e4e-8997-7dcc2adf068a]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77e5037-c28c-4cfb-be8d-ed2d5a52a7bd]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58, portal: 172.16.0.220,3260]
Aug 14 17:07:32 user nova-compute[73056]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58, portal: 172.16.0.220,3260] successful.
Aug 14 17:07:32 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[75363810-ea4f-41c2-b8b6-5c9cee23f9e4]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] <== disconnect_volume: return (302ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Start _get_guest_xml network_info=[{"id": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "address": "fa:16:3e:8c:b4:10", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4f4ff4-8e", "ovs_interfaceid": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ocqrgTUL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '57225bb2-dbce-4212-b363-8dc34af05cce', 'attached_at': '', 'detached_at': '', 'volume_id': 'a66a398d-04ae-4635-ab42-f6a387452e58', 'serial': 'a66a398d-04ae-4635-ab42-f6a387452e58'}, 'attachment_id': '22538233-83b9-4505-be88-982655756c41', 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG nova.objects.instance [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lazy-loading 'numa_topology' on Instance uuid 57225bb2-dbce-4212-b363-8dc34af05cce {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:07:32 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:07:32 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:07:32 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG nova.objects.instance [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lazy-loading 'vcpu_model' on Instance uuid 57225bb2-dbce-4212-b363-8dc34af05cce {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ocqrgTUL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 17:07:32 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 17:07:32 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 17:07:32 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3fbc11-086e-4eac-bb34-5c7959c31330]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 17:07:32 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e931157-e527-4181-9ca1-4471c6f22ed4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58] added
Aug 14 17:07:32 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9353bda-1dc2-4fed-b06e-18d79cbe58e0]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c33127-0e49-41b4-a91c-cbb5d0d6dc7f]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ocqrgTUL {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ocqrgTUL" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[9140fef3-105a-4083-947c-3cedb4c9855f]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ocqrgTUL'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[430a7b62-d591-4206-89a4-ee7e9ae695d1]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[82adf630-cc15-4c94-a552-8b34374b72ca]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 17:07:32 user nova-compute[73056]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b (non-flash)
Aug 14 17:07:32 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 17:07:32 user nova-compute[73056]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b (non-flash)
Aug 14 17:07:32 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5606ef98-e3db-48ef-a819-4031f7dced25]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58, portal: 172.16.0.220,3260]
Aug 14 17:07:32 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58, portal: 172.16.0.220,3260] successful.
Aug 14 17:07:32 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d3680c-0ddb-46fe-9bbf-26e7ac480bfa]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ddd3ba-d273-4382-b5bd-ad1b4b21031f]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 17:07:32 user nova-compute[73056]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b (non-flash)
Aug 14 17:07:32 user nova-compute[73056]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 (non-flash)
Aug 14 17:07:32 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 17:07:32 user nova-compute[73056]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b (non-flash)
Aug 14 17:07:32 user nova-compute[73056]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 (non-flash)
Aug 14 17:07:32 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[924b4eff-630e-4c11-ad49-ee34e7edb00e]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 17:07:32 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ocqrgTUL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 17:07:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:33 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 17:07:33 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26163313732616233', 'path': '/dev/sdb'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 17:07:33 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163313732616233', 'path': '/dev/sdb'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 17:07:33 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T17:03:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1082884404',display_name='tempest-AttachVolumeTestJSON-server-1082884404',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1082884404',id=44,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPNPWJ92774fwNZF6PVgQpXcTKVtR5LMZz3xu6DLKvMpyOVFGtxgTJRS/WltAZEiJfd7Brr2rP/3+0iYPbiNk8IOQAitKjVnZlCsrC86QNIF45RYJq5300KRzpYOnBhVg==',key_name='tempest-keypair-1762591610',keypairs=<?>,launch_index=0,launched_at=2023-08-14T17:03:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='415a7291b35546b5ac324280d37d50ae',ramdisk_id='',reservation_id='r-vobfg0xl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-112776827',owner_user_name='tempest-AttachVolumeTestJSON-112776827-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T17:05:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bf4bfed609343c78b0d828db45d5ab7',uuid=57225bb2-dbce-4212-b363-8dc34af05cce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "address": "fa:16:3e:8c:b4:10", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4f4ff4-8e", "ovs_interfaceid": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 17:07:33 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Converting VIF {"id": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "address": "fa:16:3e:8c:b4:10", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4f4ff4-8e", "ovs_interfaceid": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:07:33 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b4:10,bridge_name='br-int',has_traffic_filtering=True,id=2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a,network=Network(7e2ce9fb-4bdc-441f-ae4a-30224b2712e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4f4ff4-8e') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:07:33 user nova-compute[73056]: DEBUG nova.objects.instance [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lazy-loading 'pci_devices' on Instance uuid 57225bb2-dbce-4212-b363-8dc34af05cce {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:07:33 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] End _get_guest_xml xml=<domain type="kvm">
Aug 14 17:07:33 user nova-compute[73056]:   <uuid>57225bb2-dbce-4212-b363-8dc34af05cce</uuid>
Aug 14 17:07:33 user nova-compute[73056]:   <name>instance-0000002c</name>
Aug 14 17:07:33 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 17:07:33 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 17:07:33 user nova-compute[73056]:   <metadata>
Aug 14 17:07:33 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 17:07:33 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 17:07:33 user nova-compute[73056]:       <nova:name>tempest-AttachVolumeTestJSON-server-1082884404</nova:name>
Aug 14 17:07:33 user nova-compute[73056]:       <nova:creationTime>2023-08-14 17:07:32</nova:creationTime>
Aug 14 17:07:33 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 17:07:33 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 17:07:33 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 17:07:33 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 17:07:33 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 17:07:33 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 17:07:33 user nova-compute[73056]:       </nova:flavor>
Aug 14 17:07:33 user nova-compute[73056]:       <nova:owner>
Aug 14 17:07:33 user nova-compute[73056]:         <nova:user uuid="0bf4bfed609343c78b0d828db45d5ab7">tempest-AttachVolumeTestJSON-112776827-project-member</nova:user>
Aug 14 17:07:33 user nova-compute[73056]:         <nova:project uuid="415a7291b35546b5ac324280d37d50ae">tempest-AttachVolumeTestJSON-112776827</nova:project>
Aug 14 17:07:33 user nova-compute[73056]:       </nova:owner>
Aug 14 17:07:33 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 17:07:33 user nova-compute[73056]:       <nova:ports>
Aug 14 17:07:33 user nova-compute[73056]:         <nova:port uuid="2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a">
Aug 14 17:07:33 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 17:07:33 user nova-compute[73056]:         </nova:port>
Aug 14 17:07:33 user nova-compute[73056]:       </nova:ports>
Aug 14 17:07:33 user nova-compute[73056]:     </nova:instance>
Aug 14 17:07:33 user nova-compute[73056]:   </metadata>
Aug 14 17:07:33 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 17:07:33 user nova-compute[73056]:     <system>
Aug 14 17:07:33 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 17:07:33 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 17:07:33 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 17:07:33 user nova-compute[73056]:       <entry name="serial">57225bb2-dbce-4212-b363-8dc34af05cce</entry>
Aug 14 17:07:33 user nova-compute[73056]:       <entry name="uuid">57225bb2-dbce-4212-b363-8dc34af05cce</entry>
Aug 14 17:07:33 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 17:07:33 user nova-compute[73056]:     </system>
Aug 14 17:07:33 user nova-compute[73056]:   </sysinfo>
Aug 14 17:07:33 user nova-compute[73056]:   <os>
Aug 14 17:07:33 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 17:07:33 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 17:07:33 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 17:07:33 user nova-compute[73056]:   </os>
Aug 14 17:07:33 user nova-compute[73056]:   <features>
Aug 14 17:07:33 user nova-compute[73056]:     <acpi/>
Aug 14 17:07:33 user nova-compute[73056]:     <apic/>
Aug 14 17:07:33 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 17:07:33 user nova-compute[73056]:   </features>
Aug 14 17:07:33 user nova-compute[73056]:   <clock offset="utc">
Aug 14 17:07:33 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 17:07:33 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 17:07:33 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 17:07:33 user nova-compute[73056]:   </clock>
Aug 14 17:07:33 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 17:07:33 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 17:07:33 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 17:07:33 user nova-compute[73056]:   </cpu>
Aug 14 17:07:33 user nova-compute[73056]:   <devices>
Aug 14 17:07:33 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 17:07:33 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 17:07:33 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk"/>
Aug 14 17:07:33 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 17:07:33 user nova-compute[73056]:     </disk>
Aug 14 17:07:33 user nova-compute[73056]:     <disk type="block" device="disk">
Aug 14 17:07:33 user nova-compute[73056]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 17:07:33 user nova-compute[73056]:       <source dev="/dev/sdb"/>
Aug 14 17:07:33 user nova-compute[73056]:       <target dev="vdb" bus="virtio"/>
Aug 14 17:07:33 user nova-compute[73056]:       <serial>a66a398d-04ae-4635-ab42-f6a387452e58</serial>
Aug 14 17:07:33 user nova-compute[73056]:     </disk>
Aug 14 17:07:33 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 17:07:33 user nova-compute[73056]:       <mac address="fa:16:3e:8c:b4:10"/>
Aug 14 17:07:33 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 17:07:33 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 17:07:33 user nova-compute[73056]:       <target dev="tap2e4f4ff4-8e"/>
Aug 14 17:07:33 user nova-compute[73056]:     </interface>
Aug 14 17:07:33 user nova-compute[73056]:     <serial type="pty">
Aug 14 17:07:33 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/console.log" append="off"/>
Aug 14 17:07:33 user nova-compute[73056]:     </serial>
Aug 14 17:07:33 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 17:07:33 user nova-compute[73056]:     <video>
Aug 14 17:07:33 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 17:07:33 user nova-compute[73056]:     </video>
Aug 14 17:07:33 user nova-compute[73056]:     <rng model="virtio">
Aug 14 17:07:33 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 17:07:33 user nova-compute[73056]:     </rng>
Aug 14 17:07:33 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 17:07:33 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 17:07:33 user nova-compute[73056]:       <stats period="10"/>
Aug 14 17:07:33 user nova-compute[73056]:     </memballoon>
Aug 14 17:07:33 user nova-compute[73056]:   </devices>
Aug 14 17:07:33 user nova-compute[73056]: </domain>
Aug 14 17:07:33 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 17:07:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:34 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 17:07:34 user nova-compute[73056]: DEBUG nova.objects.instance [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lazy-loading 'trusted_certs' on Instance uuid 57225bb2-dbce-4212-b363-8dc34af05cce {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:07:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.180s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:34 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Checking if we can resize image /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 17:07:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:07:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:07:34 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Cannot resize image /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 17:07:34 user nova-compute[73056]: DEBUG nova.objects.instance [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lazy-loading 'migration_context' on Instance uuid 57225bb2-dbce-4212-b363-8dc34af05cce {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:07:34 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T17:03:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1082884404',display_name='tempest-AttachVolumeTestJSON-server-1082884404',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1082884404',id=44,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPNPWJ92774fwNZF6PVgQpXcTKVtR5LMZz3xu6DLKvMpyOVFGtxgTJRS/WltAZEiJfd7Brr2rP/3+0iYPbiNk8IOQAitKjVnZlCsrC86QNIF45RYJq5300KRzpYOnBhVg==',key_name='tempest-keypair-1762591610',keypairs=<?>,launch_index=0,launched_at=2023-08-14T17:03:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='415a7291b35546b5ac324280d37d50ae',ramdisk_id='',reservation_id='r-vobfg0xl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-112776827',owner_user_name='tempest-AttachVolumeTestJSON-112776827-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T17:05:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bf4bfed609343c78b0d828db45d5ab7',uuid=57225bb2-dbce-4212-b363-8dc34af05cce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "address": "fa:16:3e:8c:b4:10", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4f4ff4-8e", "ovs_interfaceid": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 17:07:34 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Converting VIF {"id": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "address": "fa:16:3e:8c:b4:10", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4f4ff4-8e", "ovs_interfaceid": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:07:34 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b4:10,bridge_name='br-int',has_traffic_filtering=True,id=2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a,network=Network(7e2ce9fb-4bdc-441f-ae4a-30224b2712e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4f4ff4-8e') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:07:34 user nova-compute[73056]: DEBUG os_vif [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b4:10,bridge_name='br-int',has_traffic_filtering=True,id=2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a,network=Network(7e2ce9fb-4bdc-441f-ae4a-30224b2712e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4f4ff4-8e') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 17:07:34 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:34 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:07:34 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 17:07:34 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:34 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e4f4ff4-8e, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:07:34 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2e4f4ff4-8e, col_values=(('external_ids', {'iface-id': '2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:b4:10', 'vm-uuid': '57225bb2-dbce-4212-b363-8dc34af05cce'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:07:34 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:07:34 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:34 user nova-compute[73056]: INFO os_vif [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b4:10,bridge_name='br-int',has_traffic_filtering=True,id=2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a,network=Network(7e2ce9fb-4bdc-441f-ae4a-30224b2712e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4f4ff4-8e')
Aug 14 17:07:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:36 user nova-compute[73056]: DEBUG nova.compute.manager [req-74d78367-cd7a-4f39-8915-3493ae511326 req-25c99be2-e30e-4c42-9f26-2dc4f9bec096 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received event network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:07:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-74d78367-cd7a-4f39-8915-3493ae511326 req-25c99be2-e30e-4c42-9f26-2dc4f9bec096 service nova] Acquiring lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:07:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-74d78367-cd7a-4f39-8915-3493ae511326 req-25c99be2-e30e-4c42-9f26-2dc4f9bec096 service nova] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:07:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-74d78367-cd7a-4f39-8915-3493ae511326 req-25c99be2-e30e-4c42-9f26-2dc4f9bec096 service nova] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:07:36 user nova-compute[73056]: DEBUG nova.compute.manager [req-74d78367-cd7a-4f39-8915-3493ae511326 req-25c99be2-e30e-4c42-9f26-2dc4f9bec096 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] No waiting events found dispatching network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:07:36 user nova-compute[73056]: WARNING nova.compute.manager [req-74d78367-cd7a-4f39-8915-3493ae511326 req-25c99be2-e30e-4c42-9f26-2dc4f9bec096 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received unexpected event network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a for instance with vm_state stopped and task_state powering-on.
Aug 14 17:07:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:37 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692032857.9537275, 57225bb2-dbce-4212-b363-8dc34af05cce => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:07:37 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] VM Resumed (Lifecycle Event)
Aug 14 17:07:37 user nova-compute[73056]: DEBUG nova.compute.manager [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 17:07:37 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Instance rebooted successfully.
Aug 14 17:07:37 user nova-compute[73056]: DEBUG nova.compute.manager [None req-9f4de070-35ee-459c-aa63-0f63cf562760 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:07:37 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:07:37 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 17:07:38 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 14 17:07:38 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692032857.9581244, 57225bb2-dbce-4212-b363-8dc34af05cce => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:07:38 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] VM Started (Lifecycle Event)
Aug 14 17:07:38 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:07:38 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 17:07:38 user nova-compute[73056]: DEBUG nova.compute.manager [req-9ce93e02-2ff6-4df1-94a9-289c090783d6 req-19fe0ef7-da0a-453f-b65f-c99d25c53161 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received event network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:07:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9ce93e02-2ff6-4df1-94a9-289c090783d6 req-19fe0ef7-da0a-453f-b65f-c99d25c53161 service nova] Acquiring lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:07:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9ce93e02-2ff6-4df1-94a9-289c090783d6 req-19fe0ef7-da0a-453f-b65f-c99d25c53161 service nova] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:07:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9ce93e02-2ff6-4df1-94a9-289c090783d6 req-19fe0ef7-da0a-453f-b65f-c99d25c53161 service nova] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:07:38 user nova-compute[73056]: DEBUG nova.compute.manager [req-9ce93e02-2ff6-4df1-94a9-289c090783d6 req-19fe0ef7-da0a-453f-b65f-c99d25c53161 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] No waiting events found dispatching network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:07:38 user nova-compute[73056]: WARNING nova.compute.manager [req-9ce93e02-2ff6-4df1-94a9-289c090783d6 req-19fe0ef7-da0a-453f-b65f-c99d25c53161 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received unexpected event network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a for instance with vm_state active and task_state None.
Aug 14 17:07:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:39 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5af72249-f285-460f-a711-3206012e2fc2 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Acquiring lock "89132752-29cb-463d-aec4-07d8c145f4d9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:07:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5af72249-f285-460f-a711-3206012e2fc2 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lock "89132752-29cb-463d-aec4-07d8c145f4d9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:07:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5af72249-f285-460f-a711-3206012e2fc2 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Acquiring lock "89132752-29cb-463d-aec4-07d8c145f4d9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:07:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5af72249-f285-460f-a711-3206012e2fc2 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lock "89132752-29cb-463d-aec4-07d8c145f4d9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:07:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5af72249-f285-460f-a711-3206012e2fc2 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lock "89132752-29cb-463d-aec4-07d8c145f4d9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:07:45 user nova-compute[73056]: INFO nova.compute.manager [None req-5af72249-f285-460f-a711-3206012e2fc2 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Terminating instance
Aug 14 17:07:45 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5af72249-f285-460f-a711-3206012e2fc2 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 17:07:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:46 user nova-compute[73056]: DEBUG nova.compute.manager [req-e74275a7-d7d6-4f67-b9fd-9d918860e6e0 req-b4a2a5d8-1261-43d9-a039-071a3d816d75 service nova] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Received event network-vif-unplugged-70c729e6-663f-401d-8265-4bfda2634d00 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:07:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e74275a7-d7d6-4f67-b9fd-9d918860e6e0 req-b4a2a5d8-1261-43d9-a039-071a3d816d75 service nova] Acquiring lock "89132752-29cb-463d-aec4-07d8c145f4d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:07:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e74275a7-d7d6-4f67-b9fd-9d918860e6e0 req-b4a2a5d8-1261-43d9-a039-071a3d816d75 service nova] Lock "89132752-29cb-463d-aec4-07d8c145f4d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:07:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e74275a7-d7d6-4f67-b9fd-9d918860e6e0 req-b4a2a5d8-1261-43d9-a039-071a3d816d75 service nova] Lock "89132752-29cb-463d-aec4-07d8c145f4d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:07:46 user nova-compute[73056]: DEBUG nova.compute.manager [req-e74275a7-d7d6-4f67-b9fd-9d918860e6e0 req-b4a2a5d8-1261-43d9-a039-071a3d816d75 service nova] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] No waiting events found dispatching network-vif-unplugged-70c729e6-663f-401d-8265-4bfda2634d00 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:07:46 user nova-compute[73056]: DEBUG nova.compute.manager [req-e74275a7-d7d6-4f67-b9fd-9d918860e6e0 req-b4a2a5d8-1261-43d9-a039-071a3d816d75 service nova] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Received event network-vif-unplugged-70c729e6-663f-401d-8265-4bfda2634d00 for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 17:07:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:46 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Instance destroyed successfully.
Aug 14 17:07:46 user nova-compute[73056]: DEBUG nova.objects.instance [None req-5af72249-f285-460f-a711-3206012e2fc2 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lazy-loading 'resources' on Instance uuid 89132752-29cb-463d-aec4-07d8c145f4d9 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:07:46 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-5af72249-f285-460f-a711-3206012e2fc2 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T17:03:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-403548302',display_name='tempest-TestServerVolumeAttachmentScenario-server-403548302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-403548302',id=45,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbgz1+0na/YkvVTYKuerdBmCYYdUSRqeIXXQRDZiW2lzky0R4HqHEtW9m9GlP05NWQsIjyZzDAediTbWge7k/UMi6aGYvsMk6CmWC82UBrFVvHm7JzJVPWcc/AyEB0VJw==',key_name='tempest-keypair-497808649',keypairs=<?>,launch_index=0,launched_at=2023-08-14T17:03:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6067a4308576451784b4be7ba26c7c8b',ramdisk_id='',reservation_id='r-rvld6j6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1720243738',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1720243738-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T17:03:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ccbad4e550a4e549ca33f495c81472d',uuid=89132752-29cb-463d-aec4-07d8c145f4d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70c729e6-663f-401d-8265-4bfda2634d00", "address": "fa:16:3e:2a:5d:a0", "network": {"id": "cd0faadc-916c-43e7-bc06-21c25481110a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-646602137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6067a4308576451784b4be7ba26c7c8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70c729e6-66", "ovs_interfaceid": "70c729e6-663f-401d-8265-4bfda2634d00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 17:07:46 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-5af72249-f285-460f-a711-3206012e2fc2 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Converting VIF {"id": "70c729e6-663f-401d-8265-4bfda2634d00", "address": "fa:16:3e:2a:5d:a0", "network": {"id": "cd0faadc-916c-43e7-bc06-21c25481110a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-646602137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6067a4308576451784b4be7ba26c7c8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70c729e6-66", "ovs_interfaceid": "70c729e6-663f-401d-8265-4bfda2634d00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:07:46 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-5af72249-f285-460f-a711-3206012e2fc2 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:5d:a0,bridge_name='br-int',has_traffic_filtering=True,id=70c729e6-663f-401d-8265-4bfda2634d00,network=Network(cd0faadc-916c-43e7-bc06-21c25481110a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70c729e6-66') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:07:46 user nova-compute[73056]: DEBUG os_vif [None req-5af72249-f285-460f-a711-3206012e2fc2 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:5d:a0,bridge_name='br-int',has_traffic_filtering=True,id=70c729e6-663f-401d-8265-4bfda2634d00,network=Network(cd0faadc-916c-43e7-bc06-21c25481110a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70c729e6-66') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 17:07:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70c729e6-66, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:07:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:07:46 user nova-compute[73056]: INFO os_vif [None req-5af72249-f285-460f-a711-3206012e2fc2 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:5d:a0,bridge_name='br-int',has_traffic_filtering=True,id=70c729e6-663f-401d-8265-4bfda2634d00,network=Network(cd0faadc-916c-43e7-bc06-21c25481110a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70c729e6-66')
Aug 14 17:07:46 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-5af72249-f285-460f-a711-3206012e2fc2 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Deleting instance files /opt/stack/data/nova/instances/89132752-29cb-463d-aec4-07d8c145f4d9_del
Aug 14 17:07:46 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-5af72249-f285-460f-a711-3206012e2fc2 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Deletion of /opt/stack/data/nova/instances/89132752-29cb-463d-aec4-07d8c145f4d9_del complete
Aug 14 17:07:46 user nova-compute[73056]: INFO nova.compute.manager [None req-5af72249-f285-460f-a711-3206012e2fc2 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 14 17:07:46 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-5af72249-f285-460f-a711-3206012e2fc2 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 17:07:46 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 17:07:46 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 17:07:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:47 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:07:47 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Took 1.13 seconds to deallocate network for instance.
Aug 14 17:07:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5af72249-f285-460f-a711-3206012e2fc2 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:07:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5af72249-f285-460f-a711-3206012e2fc2 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:07:47 user nova-compute[73056]: DEBUG nova.compute.manager [req-b2db0393-7b34-4bbb-810a-5bf1ec779363 req-a4a5eccf-c9c6-4905-8e66-3458e4dd6f6a service nova] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Received event network-vif-deleted-70c729e6-663f-401d-8265-4bfda2634d00 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:07:47 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-5af72249-f285-460f-a711-3206012e2fc2 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:07:47 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-5af72249-f285-460f-a711-3206012e2fc2 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:07:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5af72249-f285-460f-a711-3206012e2fc2 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.235s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:07:47 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-5af72249-f285-460f-a711-3206012e2fc2 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Deleted allocations for instance 89132752-29cb-463d-aec4-07d8c145f4d9
Aug 14 17:07:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5af72249-f285-460f-a711-3206012e2fc2 tempest-TestServerVolumeAttachmentScenario-1720243738 tempest-TestServerVolumeAttachmentScenario-1720243738-project-member] Lock "89132752-29cb-463d-aec4-07d8c145f4d9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.402s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:07:48 user nova-compute[73056]: DEBUG nova.compute.manager [req-f0e48040-7f79-4bba-b697-aae34e8d52ae req-d5013f55-a234-408c-bdbe-f1b793fa4b02 service nova] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Received event network-vif-plugged-70c729e6-663f-401d-8265-4bfda2634d00 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:07:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f0e48040-7f79-4bba-b697-aae34e8d52ae req-d5013f55-a234-408c-bdbe-f1b793fa4b02 service nova] Acquiring lock "89132752-29cb-463d-aec4-07d8c145f4d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:07:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f0e48040-7f79-4bba-b697-aae34e8d52ae req-d5013f55-a234-408c-bdbe-f1b793fa4b02 service nova] Lock "89132752-29cb-463d-aec4-07d8c145f4d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:07:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f0e48040-7f79-4bba-b697-aae34e8d52ae req-d5013f55-a234-408c-bdbe-f1b793fa4b02 service nova] Lock "89132752-29cb-463d-aec4-07d8c145f4d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:07:48 user nova-compute[73056]: DEBUG nova.compute.manager [req-f0e48040-7f79-4bba-b697-aae34e8d52ae req-d5013f55-a234-408c-bdbe-f1b793fa4b02 service nova] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] No waiting events found dispatching network-vif-plugged-70c729e6-663f-401d-8265-4bfda2634d00 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:07:48 user nova-compute[73056]: WARNING nova.compute.manager [req-f0e48040-7f79-4bba-b697-aae34e8d52ae req-d5013f55-a234-408c-bdbe-f1b793fa4b02 service nova] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Received unexpected event network-vif-plugged-70c729e6-663f-401d-8265-4bfda2634d00 for instance with vm_state deleted and task_state None.
Aug 14 17:07:48 user nova-compute[73056]: DEBUG nova.compute.manager [req-f0e48040-7f79-4bba-b697-aae34e8d52ae req-d5013f55-a234-408c-bdbe-f1b793fa4b02 service nova] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Received event network-vif-plugged-70c729e6-663f-401d-8265-4bfda2634d00 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:07:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f0e48040-7f79-4bba-b697-aae34e8d52ae req-d5013f55-a234-408c-bdbe-f1b793fa4b02 service nova] Acquiring lock "89132752-29cb-463d-aec4-07d8c145f4d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:07:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f0e48040-7f79-4bba-b697-aae34e8d52ae req-d5013f55-a234-408c-bdbe-f1b793fa4b02 service nova] Lock "89132752-29cb-463d-aec4-07d8c145f4d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:07:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f0e48040-7f79-4bba-b697-aae34e8d52ae req-d5013f55-a234-408c-bdbe-f1b793fa4b02 service nova] Lock "89132752-29cb-463d-aec4-07d8c145f4d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:07:48 user nova-compute[73056]: DEBUG nova.compute.manager [req-f0e48040-7f79-4bba-b697-aae34e8d52ae req-d5013f55-a234-408c-bdbe-f1b793fa4b02 service nova] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] No waiting events found dispatching network-vif-plugged-70c729e6-663f-401d-8265-4bfda2634d00 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:07:48 user nova-compute[73056]: WARNING nova.compute.manager [req-f0e48040-7f79-4bba-b697-aae34e8d52ae req-d5013f55-a234-408c-bdbe-f1b793fa4b02 service nova] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Received unexpected event network-vif-plugged-70c729e6-663f-401d-8265-4bfda2634d00 for instance with vm_state deleted and task_state None.
Aug 14 17:07:48 user nova-compute[73056]: DEBUG nova.compute.manager [req-f0e48040-7f79-4bba-b697-aae34e8d52ae req-d5013f55-a234-408c-bdbe-f1b793fa4b02 service nova] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Received event network-vif-plugged-70c729e6-663f-401d-8265-4bfda2634d00 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:07:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f0e48040-7f79-4bba-b697-aae34e8d52ae req-d5013f55-a234-408c-bdbe-f1b793fa4b02 service nova] Acquiring lock "89132752-29cb-463d-aec4-07d8c145f4d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:07:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f0e48040-7f79-4bba-b697-aae34e8d52ae req-d5013f55-a234-408c-bdbe-f1b793fa4b02 service nova] Lock "89132752-29cb-463d-aec4-07d8c145f4d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:07:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f0e48040-7f79-4bba-b697-aae34e8d52ae req-d5013f55-a234-408c-bdbe-f1b793fa4b02 service nova] Lock "89132752-29cb-463d-aec4-07d8c145f4d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:07:48 user nova-compute[73056]: DEBUG nova.compute.manager [req-f0e48040-7f79-4bba-b697-aae34e8d52ae req-d5013f55-a234-408c-bdbe-f1b793fa4b02 service nova] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] No waiting events found dispatching network-vif-plugged-70c729e6-663f-401d-8265-4bfda2634d00 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:07:48 user nova-compute[73056]: WARNING nova.compute.manager [req-f0e48040-7f79-4bba-b697-aae34e8d52ae req-d5013f55-a234-408c-bdbe-f1b793fa4b02 service nova] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Received unexpected event network-vif-plugged-70c729e6-663f-401d-8265-4bfda2634d00 for instance with vm_state deleted and task_state None.
Aug 14 17:07:48 user nova-compute[73056]: DEBUG nova.compute.manager [req-f0e48040-7f79-4bba-b697-aae34e8d52ae req-d5013f55-a234-408c-bdbe-f1b793fa4b02 service nova] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Received event network-vif-unplugged-70c729e6-663f-401d-8265-4bfda2634d00 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:07:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f0e48040-7f79-4bba-b697-aae34e8d52ae req-d5013f55-a234-408c-bdbe-f1b793fa4b02 service nova] Acquiring lock "89132752-29cb-463d-aec4-07d8c145f4d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:07:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f0e48040-7f79-4bba-b697-aae34e8d52ae req-d5013f55-a234-408c-bdbe-f1b793fa4b02 service nova] Lock "89132752-29cb-463d-aec4-07d8c145f4d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:07:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f0e48040-7f79-4bba-b697-aae34e8d52ae req-d5013f55-a234-408c-bdbe-f1b793fa4b02 service nova] Lock "89132752-29cb-463d-aec4-07d8c145f4d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:07:48 user nova-compute[73056]: DEBUG nova.compute.manager [req-f0e48040-7f79-4bba-b697-aae34e8d52ae req-d5013f55-a234-408c-bdbe-f1b793fa4b02 service nova] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] No waiting events found dispatching network-vif-unplugged-70c729e6-663f-401d-8265-4bfda2634d00 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:07:48 user nova-compute[73056]: WARNING nova.compute.manager [req-f0e48040-7f79-4bba-b697-aae34e8d52ae req-d5013f55-a234-408c-bdbe-f1b793fa4b02 service nova] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Received unexpected event network-vif-unplugged-70c729e6-663f-401d-8265-4bfda2634d00 for instance with vm_state deleted and task_state None.
Aug 14 17:07:48 user nova-compute[73056]: DEBUG nova.compute.manager [req-f0e48040-7f79-4bba-b697-aae34e8d52ae req-d5013f55-a234-408c-bdbe-f1b793fa4b02 service nova] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Received event network-vif-plugged-70c729e6-663f-401d-8265-4bfda2634d00 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:07:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f0e48040-7f79-4bba-b697-aae34e8d52ae req-d5013f55-a234-408c-bdbe-f1b793fa4b02 service nova] Acquiring lock "89132752-29cb-463d-aec4-07d8c145f4d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:07:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f0e48040-7f79-4bba-b697-aae34e8d52ae req-d5013f55-a234-408c-bdbe-f1b793fa4b02 service nova] Lock "89132752-29cb-463d-aec4-07d8c145f4d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:07:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f0e48040-7f79-4bba-b697-aae34e8d52ae req-d5013f55-a234-408c-bdbe-f1b793fa4b02 service nova] Lock "89132752-29cb-463d-aec4-07d8c145f4d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:07:48 user nova-compute[73056]: DEBUG nova.compute.manager [req-f0e48040-7f79-4bba-b697-aae34e8d52ae req-d5013f55-a234-408c-bdbe-f1b793fa4b02 service nova] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] No waiting events found dispatching network-vif-plugged-70c729e6-663f-401d-8265-4bfda2634d00 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:07:48 user nova-compute[73056]: WARNING nova.compute.manager [req-f0e48040-7f79-4bba-b697-aae34e8d52ae req-d5013f55-a234-408c-bdbe-f1b793fa4b02 service nova] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Received unexpected event network-vif-plugged-70c729e6-663f-401d-8265-4bfda2634d00 for instance with vm_state deleted and task_state None.
Aug 14 17:07:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:52 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:07:52 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Cleaning up deleted instances {{(pid=73056) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 17:07:52 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] There are 0 instances to clean {{(pid=73056) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 17:07:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:56 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:07:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:08:01 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692032866.420247, 89132752-29cb-463d-aec4-07d8c145f4d9 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:08:01 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] VM Stopped (Lifecycle Event)
Aug 14 17:08:01 user nova-compute[73056]: DEBUG nova.compute.manager [None req-cdc2344f-75af-4f0c-b583-f34672fd1640 None None] [instance: 89132752-29cb-463d-aec4-07d8c145f4d9] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:08:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:08:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:08:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:08:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:08:10 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:08:10 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:08:10 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 17:08:11 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:08:12 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:08:16 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:08:16 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 17:08:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-090405b6-77e0-4f28-bd8d-e7fccfa894b8" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:08:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-090405b6-77e0-4f28-bd8d-e7fccfa894b8" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:08:16 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 17:08:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:08:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:08:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:08:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:08:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:08:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:08:16 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Updating instance_info_cache with network_info: [{"id": "4273f76f-d31b-48bc-92b5-3997783ef4d6", "address": "fa:16:3e:8b:46:5c", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4273f76f-d3", "ovs_interfaceid": "4273f76f-d31b-48bc-92b5-3997783ef4d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:08:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-090405b6-77e0-4f28-bd8d-e7fccfa894b8" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:08:16 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 17:08:21 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:08:21 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:08:22 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:08:23 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:08:23 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:08:25 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:08:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:08:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:08:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:08:25 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 17:08:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 17:08:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:08:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:08:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:08:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:08:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 17:08:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:08:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:08:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:08:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:08:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:08:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:08:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:08:26 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:08:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:08:26 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 17:08:27 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:08:27 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:08:27 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=8359MB free_disk=25.04355239868164GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 17:08:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:08:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:08:27 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 5191b082-a6f3-467c-b28b-fda85e15f330 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:08:27 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance fb1a193b-73b7-4690-8571-be9af04b3b14 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:08:27 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 57225bb2-dbce-4212-b363-8dc34af05cce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:08:27 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 090405b6-77e0-4f28-bd8d-e7fccfa894b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:08:27 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:08:27 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 17:08:27 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 17:08:27 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Refreshing inventories for resource provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 17:08:27 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Updating ProviderTree inventory for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 17:08:27 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Updating inventory in ProviderTree for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 17:08:27 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Refreshing aggregate associations for resource provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b, aggregates: None {{(pid=73056) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 17:08:27 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Refreshing trait associations for resource provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=73056) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 17:08:27 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:08:27 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:08:27 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 17:08:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.395s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:08:28 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:08:31 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:08:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:08:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:08:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:08:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:08:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:08:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:08:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:08:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:08:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:08:50 user nova-compute[73056]: INFO nova.compute.manager [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Rescuing
Aug 14 17:08:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "refresh_cache-3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:08:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquired lock "refresh_cache-3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:08:50 user nova-compute[73056]: DEBUG nova.network.neutron [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 17:08:51 user nova-compute[73056]: DEBUG nova.network.neutron [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Updating instance_info_cache with network_info: [{"id": "852aa0fc-c330-4cdf-9b88-93e0f0260f39", "address": "fa:16:3e:9e:41:c0", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852aa0fc-c3", "ovs_interfaceid": "852aa0fc-c330-4cdf-9b88-93e0f0260f39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:08:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Releasing lock "refresh_cache-3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:08:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:08:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:08:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:08:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:08:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-444ef6fc-c281-426a-969d-7a71878be29c req-899f5cd6-a867-4860-9ab7-3a51fafa8a56 service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Received event network-vif-unplugged-852aa0fc-c330-4cdf-9b88-93e0f0260f39 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:08:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-444ef6fc-c281-426a-969d-7a71878be29c req-899f5cd6-a867-4860-9ab7-3a51fafa8a56 service nova] Acquiring lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:08:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-444ef6fc-c281-426a-969d-7a71878be29c req-899f5cd6-a867-4860-9ab7-3a51fafa8a56 service nova] Lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:08:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-444ef6fc-c281-426a-969d-7a71878be29c req-899f5cd6-a867-4860-9ab7-3a51fafa8a56 service nova] Lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:08:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-444ef6fc-c281-426a-969d-7a71878be29c req-899f5cd6-a867-4860-9ab7-3a51fafa8a56 service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] No waiting events found dispatching network-vif-unplugged-852aa0fc-c330-4cdf-9b88-93e0f0260f39 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:08:51 user nova-compute[73056]: WARNING nova.compute.manager [req-444ef6fc-c281-426a-969d-7a71878be29c req-899f5cd6-a867-4860-9ab7-3a51fafa8a56 service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Received unexpected event network-vif-unplugged-852aa0fc-c330-4cdf-9b88-93e0f0260f39 for instance with vm_state active and task_state rescuing.
Aug 14 17:08:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:08:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:08:52 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Instance destroyed successfully.
Aug 14 17:08:52 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Attempting a stable device rescue
Aug 14 17:08:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73056) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 17:08:52 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Instance directory exists: not creating {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 17:08:52 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Creating image(s)
Aug 14 17:08:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "/opt/stack/data/nova/instances/3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:08:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "/opt/stack/data/nova/instances/3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:08:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "/opt/stack/data/nova/instances/3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.059s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:08:52 user nova-compute[73056]: DEBUG nova.objects.instance [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:08:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "ee9f6aad2978befde47fc8134e8d7664822420c2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:08:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "ee9f6aad2978befde47fc8134e8d7664822420c2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:08:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee9f6aad2978befde47fc8134e8d7664822420c2.part --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:08:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee9f6aad2978befde47fc8134e8d7664822420c2.part --force-share --output=json" returned: 0 in 0.194s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:08:53 user nova-compute[73056]: DEBUG nova.virt.images [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] 0479616f-cd71-45db-ba44-188afa2de74d was qcow2, converting to raw {{(pid=73056) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 17:08:53 user nova-compute[73056]: DEBUG nova.privsep.utils [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73056) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 17:08:53 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ee9f6aad2978befde47fc8134e8d7664822420c2.part /opt/stack/data/nova/instances/_base/ee9f6aad2978befde47fc8134e8d7664822420c2.converted {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:08:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-99cf8029-2d70-470c-b8b4-c1f51299151f req-a20f112a-674e-4f6d-9562-35f5e272e967 service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Received event network-vif-plugged-852aa0fc-c330-4cdf-9b88-93e0f0260f39 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:08:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-99cf8029-2d70-470c-b8b4-c1f51299151f req-a20f112a-674e-4f6d-9562-35f5e272e967 service nova] Acquiring lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:08:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-99cf8029-2d70-470c-b8b4-c1f51299151f req-a20f112a-674e-4f6d-9562-35f5e272e967 service nova] Lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:08:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-99cf8029-2d70-470c-b8b4-c1f51299151f req-a20f112a-674e-4f6d-9562-35f5e272e967 service nova] Lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:08:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-99cf8029-2d70-470c-b8b4-c1f51299151f req-a20f112a-674e-4f6d-9562-35f5e272e967 service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] No waiting events found dispatching network-vif-plugged-852aa0fc-c330-4cdf-9b88-93e0f0260f39 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:08:53 user nova-compute[73056]: WARNING nova.compute.manager [req-99cf8029-2d70-470c-b8b4-c1f51299151f req-a20f112a-674e-4f6d-9562-35f5e272e967 service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Received unexpected event network-vif-plugged-852aa0fc-c330-4cdf-9b88-93e0f0260f39 for instance with vm_state active and task_state rescuing.
Aug 14 17:08:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ee9f6aad2978befde47fc8134e8d7664822420c2.part /opt/stack/data/nova/instances/_base/ee9f6aad2978befde47fc8134e8d7664822420c2.converted" returned: 0 in 0.456s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee9f6aad2978befde47fc8134e8d7664822420c2.converted --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee9f6aad2978befde47fc8134e8d7664822420c2.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "ee9f6aad2978befde47fc8134e8d7664822420c2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.886s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "ee9f6aad2978befde47fc8134e8d7664822420c2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "ee9f6aad2978befde47fc8134e8d7664822420c2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee9f6aad2978befde47fc8134e8d7664822420c2 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee9f6aad2978befde47fc8134e8d7664822420c2 --force-share --output=json" returned: 0 in 0.175s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ee9f6aad2978befde47fc8134e8d7664822420c2,backing_fmt=raw /opt/stack/data/nova/instances/3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4/disk.rescue {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ee9f6aad2978befde47fc8134e8d7664822420c2,backing_fmt=raw /opt/stack/data/nova/instances/3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4/disk.rescue" returned: 0 in 0.053s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "ee9f6aad2978befde47fc8134e8d7664822420c2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG nova.objects.instance [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lazy-loading 'migration_context' on Instance uuid 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Start _get_guest_xml network_info=[{"id": "852aa0fc-c330-4cdf-9b88-93e0f0260f39", "address": "fa:16:3e:9e:41:c0", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "vif_mac": "fa:16:3e:9e:41:c0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852aa0fc-c3", "ovs_interfaceid": "852aa0fc-c330-4cdf-9b88-93e0f0260f39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0479616f-cd71-45db-ba44-188afa2de74d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kfAGgIQa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4', 'attached_at': '', 'detached_at': '', 'volume_id': '20289a71-f1fe-42af-90f7-882c2863ed6b', 'serial': '20289a71-f1fe-42af-90f7-882c2863ed6b'}, 'attachment_id': 'b4564a46-ced7-4b90-9495-036fc31cddec', 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG nova.objects.instance [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lazy-loading 'resources' on Instance uuid 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG nova.objects.instance [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lazy-loading 'numa_topology' on Instance uuid 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:08:54 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:08:54 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:08:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG nova.objects.instance [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kfAGgIQa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 17:08:54 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 17:08:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 17:08:54 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 17:08:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 17:08:54 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 17:08:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0286672-f4d7-4def-9a81-0b3122c85d5a]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = kfAGgIQa\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 14 17:08:54 user nova-compute[73056]: node.name = iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b
Aug 14 17:08:54 user nova-compute[73056]: node.tpgt = -1
Aug 14 17:08:54 user nova-compute[73056]: node.startup = automatic
Aug 14 17:08:54 user nova-compute[73056]: node.leading_login = No
Aug 14 17:08:54 user nova-compute[73056]: iface.iscsi_ifacename = default
Aug 14 17:08:54 user nova-compute[73056]: iface.net_ifacename = <empty>
Aug 14 17:08:54 user nova-compute[73056]: iface.ipaddress = <empty>
Aug 14 17:08:54 user nova-compute[73056]: iface.prefix_len = 0
Aug 14 17:08:54 user nova-compute[73056]: iface.hwaddress = <empty>
Aug 14 17:08:54 user nova-compute[73056]: iface.transport_name = tcp
Aug 14 17:08:54 user nova-compute[73056]: iface.initiatorname = <empty>
Aug 14 17:08:54 user nova-compute[73056]: iface.state = <empty>
Aug 14 17:08:54 user nova-compute[73056]: iface.vlan_id = 0
Aug 14 17:08:54 user nova-compute[73056]: iface.vlan_priority = 0
Aug 14 17:08:54 user nova-compute[73056]: iface.vlan_state = <empty>
Aug 14 17:08:54 user nova-compute[73056]: iface.iface_num = 0
Aug 14 17:08:54 user nova-compute[73056]: iface.mtu = 0
Aug 14 17:08:54 user nova-compute[73056]: iface.port = 0
Aug 14 17:08:54 user nova-compute[73056]: iface.bootproto = <empty>
Aug 14 17:08:54 user nova-compute[73056]: iface.subnet_mask = <empty>
Aug 14 17:08:54 user nova-compute[73056]: iface.gateway = <empty>
Aug 14 17:08:54 user nova-compute[73056]: iface.dhcp_alt_client_id_state = <empty>
Aug 14 17:08:54 user nova-compute[73056]: iface.dhcp_alt_client_id = <empty>
Aug 14 17:08:54 user nova-compute[73056]: iface.dhcp_dns = <empty>
Aug 14 17:08:54 user nova-compute[73056]: iface.dhcp_learn_iqn = <empty>
Aug 14 17:08:54 user nova-compute[73056]: iface.dhcp_req_vendor_id_state = <empty>
Aug 14 17:08:54 user nova-compute[73056]: iface.dhcp_vendor_id_state = <empty>
Aug 14 17:08:54 user nova-compute[73056]: iface.dhcp_vendor_id = <empty>
Aug 14 17:08:54 user nova-compute[73056]: iface.dhcp_slp_da = <empty>
Aug 14 17:08:54 user nova-compute[73056]: iface.fragmentation = <empty>
Aug 14 17:08:54 user nova-compute[73056]: iface.gratuitous_arp = <empty>
Aug 14 17:08:54 user nova-compute[73056]: iface.incoming_forwarding = <empty>
Aug 14 17:08:54 user nova-compute[73056]: iface.tos_state = <empty>
Aug 14 17:08:54 user nova-compute[73056]: iface.tos = 0
Aug 14 17:08:54 user nova-compute[73056]: iface.ttl = 0
Aug 14 17:08:54 user nova-compute[73056]: iface.delayed_ack = <empty>
Aug 14 17:08:54 user nova-compute[73056]: iface.tcp_nagle = <empty>
Aug 14 17:08:54 user nova-compute[73056]: iface.tcp_wsf_state = <empty>
Aug 14 17:08:54 user nova-compute[73056]: iface.tcp_wsf = 0
Aug 14 17:08:54 user nova-compute[73056]: iface.tcp_timer_scale = 0
Aug 14 17:08:54 user nova-compute[73056]: iface.tcp_timestamp = <empty>
Aug 14 17:08:54 user nova-compute[73056]: iface.redirect = <empty>
Aug 14 17:08:54 user nova-compute[73056]: iface.def_task_mgmt_timeout = 0
Aug 14 17:08:54 user nova-compute[73056]: iface.header_digest = <empty>
Aug 14 17:08:54 user nova-compute[73056]: iface.data_digest = <empty>
Aug 14 17:08:54 user nova-compute[73056]: iface.immediate_data = <empty>
Aug 14 17:08:54 user nova-compute[73056]: iface.initial_r2t = <empty>
Aug 14 17:08:54 user nova-compute[73056]: iface.data_seq_inorder = <empty>
Aug 14 17:08:54 user nova-compute[73056]: iface.data_pdu_inorder = <empty>
Aug 14 17:08:54 user nova-compute[73056]: iface.erl = 0
Aug 14 17:08:54 user nova-compute[73056]: iface.max_receive_data_len = 0
Aug 14 17:08:54 user nova-compute[73056]: iface.first_burst_len = 0
Aug 14 17:08:54 user nova-compute[73056]: iface.max_outstanding_r2t = 0
Aug 14 17:08:54 user nova-compute[73056]: iface.max_burst_len = 0
Aug 14 17:08:54 user nova-compute[73056]: iface.chap_auth = <empty>
Aug 14 17:08:54 user nova-compute[73056]: iface.bidi_chap = <empty>
Aug 14 17:08:54 user nova-compute[73056]: iface.strict_login_compliance = <empty>
Aug 14 17:08:54 user nova-compute[73056]: iface.discovery_auth = <empty>
Aug 14 17:08:54 user nova-compute[73056]: iface.discovery_logout = <empty>
Aug 14 17:08:54 user nova-compute[73056]: node.discovery_address = <empty>
Aug 14 17:08:54 user nova-compute[73056]: node.discovery_port = 0
Aug 14 17:08:54 user nova-compute[73056]: node.discovery_type = static
Aug 14 17:08:54 user nova-compute[73056]: node.session.initial_cmdsn = 0
Aug 14 17:08:54 user nova-compute[73056]: node.session.initial_login_retry_max = 8
Aug 14 17:08:54 user nova-compute[73056]: node.session.xmit_thread_priority = -20
Aug 14 17:08:54 user nova-compute[73056]: node.session.cmds_max = 128
Aug 14 17:08:54 user nova-compute[73056]: node.session.queue_depth = 32
Aug 14 17:08:54 user nova-compute[73056]: node.session.nr_sessions = 1
Aug 14 17:08:54 user nova-compute[73056]: node.session.auth.authmethod = CHAP
Aug 14 17:08:54 user nova-compute[73056]: node.session.auth.username = kfAGgIQa
Aug 14 17:08:54 user nova-compute[73056]: node.session.auth.password = ***
Aug 14 17:08:54 user nova-compute[73056]: node.session.auth.username_in = <empty>
Aug 14 17:08:54 user nova-compute[73056]: node.session.auth.password_in = <empty>
Aug 14 17:08:54 user nova-compute[73056]: node.session.auth.chap_algs = MD5
Aug 14 17:08:54 user nova-compute[73056]: node.session.timeo.replacement_timeout = 120
Aug 14 17:08:54 user nova-compute[73056]: node.session.err_timeo.abort_timeout = 15
Aug 14 17:08:54 user nova-compute[73056]: node.session.err_timeo.lu_reset_timeout = 30
Aug 14 17:08:54 user nova-compute[73056]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 14 17:08:54 user nova-compute[73056]: node.session.err_timeo.host_reset_timeout = 60
Aug 14 17:08:54 user nova-compute[73056]: node.session.iscsi.FastAbort = Yes
Aug 14 17:08:54 user nova-compute[73056]: node.session.iscsi.InitialR2T = No
Aug 14 17:08:54 user nova-compute[73056]: node.session.iscsi.ImmediateData = Yes
Aug 14 17:08:54 user nova-compute[73056]: node.session.iscsi.FirstBurstLength = 262144
Aug 14 17:08:54 user nova-compute[73056]: node.session.iscsi.MaxBurstLength = 16776192
Aug 14 17:08:54 user nova-compute[73056]: node.session.iscsi.DefaultTime2Retain = 0
Aug 14 17:08:54 user nova-compute[73056]: node.session.iscsi.DefaultTime2Wait = 2
Aug 14 17:08:54 user nova-compute[73056]: node.session.iscsi.MaxConnections = 1
Aug 14 17:08:54 user nova-compute[73056]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 14 17:08:54 user nova-compute[73056]: node.session.iscsi.ERL = 0
Aug 14 17:08:54 user nova-compute[73056]: node.session.scan = manual
Aug 14 17:08:54 user nova-compute[73056]: node.session.reopen_max = 0
Aug 14 17:08:54 user nova-compute[73056]: node.conn[0].address = 172.16.0.220
Aug 14 17:08:54 user nova-compute[73056]: node.conn[0].port = 3260
Aug 14 17:08:54 user nova-compute[73056]: node.conn[0].startup = manual
Aug 14 17:08:54 user nova-compute[73056]: node.conn[0].tcp.window_size = 524288
Aug 14 17:08:54 user nova-compute[73056]: node.conn[0].tcp.type_of_service = 0
Aug 14 17:08:54 user nova-compute[73056]: node.conn[0].timeo.logout_timeout = 15
Aug 14 17:08:54 user nova-compute[73056]: node.conn[0].timeo.login_timeout = 15
Aug 14 17:08:54 user nova-compute[73056]: node.conn[0].timeo.auth_timeout = 45
Aug 14 17:08:54 user nova-compute[73056]: node.conn[0].timeo.noop_out_interval = 5
Aug 14 17:08:54 user nova-compute[73056]: node.conn[0].timeo.noop_out_timeout = 5
Aug 14 17:08:54 user nova-compute[73056]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 14 17:08:54 user nova-compute[73056]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 14 17:08:54 user nova-compute[73056]: node.conn[0].iscsi.HeaderDigest = None
Aug 14 17:08:54 user nova-compute[73056]: node.conn[0].iscsi.DataDigest = None
Aug 14 17:08:54 user nova-compute[73056]: node.conn[0].iscsi.IFMarker = No
Aug 14 17:08:54 user nova-compute[73056]: node.conn[0].iscsi.OFMarker = No
Aug 14 17:08:54 user nova-compute[73056]: # END RECORD
Aug 14 17:08:54 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d7f09d-b233-49dd-bfe9-8345f419bf1f]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff7e761-e120-44be-b8b4-3d810bac445c]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kfAGgIQa {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kfAGgIQa" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f7d24e-0c0c-42c5-ab71-93962211c552]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kfAGgIQa'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac17a2d-28c5-4cd1-892a-2e25a8e20366]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7acbf0-3e36-4654-ac01-ba191d39534c]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 17:08:54 user nova-compute[73056]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b (non-flash)
Aug 14 17:08:54 user nova-compute[73056]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 (non-flash)
Aug 14 17:08:54 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 17:08:54 user nova-compute[73056]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b (non-flash)
Aug 14 17:08:54 user nova-compute[73056]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 (non-flash)
Aug 14 17:08:54 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.136s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] HCTL ('34', '0', '0', 0) found on session 54 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.013s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[43731d1d-3ebf-4d15-8cad-ec998f0cd7d2]: (4, ('0 0 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Searching for a device in session 54 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kfAGgIQa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.158s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] <== connect_volume: return (160ms) {'type': 'block', 'scsi_wwn': '26331353862646239', 'path': '/dev/sdc'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331353862646239', 'path': '/dev/sdc'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T17:06:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-632303434',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-632303434',id=47,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T17:07:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a56fc678888b4653802e94ac6b47f95d',ramdisk_id='',reservation_id='r-sc3mfbyk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-572642883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T17:07:31Z,user_data=None,user_id='958f0c79efdc4352b35874e6c6f940d8',uuid=3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "852aa0fc-c330-4cdf-9b88-93e0f0260f39", "address": "fa:16:3e:9e:41:c0", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "vif_mac": "fa:16:3e:9e:41:c0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852aa0fc-c3", "ovs_interfaceid": "852aa0fc-c330-4cdf-9b88-93e0f0260f39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Converting VIF {"id": "852aa0fc-c330-4cdf-9b88-93e0f0260f39", "address": "fa:16:3e:9e:41:c0", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "vif_mac": "fa:16:3e:9e:41:c0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852aa0fc-c3", "ovs_interfaceid": "852aa0fc-c330-4cdf-9b88-93e0f0260f39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:41:c0,bridge_name='br-int',has_traffic_filtering=True,id=852aa0fc-c330-4cdf-9b88-93e0f0260f39,network=Network(ac2d700d-98d2-4459-8da8-a4858cda8864),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap852aa0fc-c3') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG nova.objects.instance [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lazy-loading 'pci_devices' on Instance uuid 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] End _get_guest_xml xml=<domain type="kvm">
Aug 14 17:08:54 user nova-compute[73056]:   <uuid>3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4</uuid>
Aug 14 17:08:54 user nova-compute[73056]:   <name>instance-0000002f</name>
Aug 14 17:08:54 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 17:08:54 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 17:08:54 user nova-compute[73056]:   <metadata>
Aug 14 17:08:54 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 17:08:54 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 17:08:54 user nova-compute[73056]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-632303434</nova:name>
Aug 14 17:08:54 user nova-compute[73056]:       <nova:creationTime>2023-08-14 17:08:54</nova:creationTime>
Aug 14 17:08:54 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 17:08:54 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 17:08:54 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 17:08:54 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 17:08:54 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 17:08:54 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 17:08:54 user nova-compute[73056]:       </nova:flavor>
Aug 14 17:08:54 user nova-compute[73056]:       <nova:owner>
Aug 14 17:08:54 user nova-compute[73056]:         <nova:user uuid="958f0c79efdc4352b35874e6c6f940d8">tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member</nova:user>
Aug 14 17:08:54 user nova-compute[73056]:         <nova:project uuid="a56fc678888b4653802e94ac6b47f95d">tempest-ServerBootFromVolumeStableRescueTest-572642883</nova:project>
Aug 14 17:08:54 user nova-compute[73056]:       </nova:owner>
Aug 14 17:08:54 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 17:08:54 user nova-compute[73056]:       <nova:ports>
Aug 14 17:08:54 user nova-compute[73056]:         <nova:port uuid="852aa0fc-c330-4cdf-9b88-93e0f0260f39">
Aug 14 17:08:54 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 17:08:54 user nova-compute[73056]:         </nova:port>
Aug 14 17:08:54 user nova-compute[73056]:       </nova:ports>
Aug 14 17:08:54 user nova-compute[73056]:     </nova:instance>
Aug 14 17:08:54 user nova-compute[73056]:   </metadata>
Aug 14 17:08:54 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 17:08:54 user nova-compute[73056]:     <system>
Aug 14 17:08:54 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 17:08:54 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 17:08:54 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 17:08:54 user nova-compute[73056]:       <entry name="serial">3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4</entry>
Aug 14 17:08:54 user nova-compute[73056]:       <entry name="uuid">3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4</entry>
Aug 14 17:08:54 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 17:08:54 user nova-compute[73056]:     </system>
Aug 14 17:08:54 user nova-compute[73056]:   </sysinfo>
Aug 14 17:08:54 user nova-compute[73056]:   <os>
Aug 14 17:08:54 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 17:08:54 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 17:08:54 user nova-compute[73056]:   </os>
Aug 14 17:08:54 user nova-compute[73056]:   <features>
Aug 14 17:08:54 user nova-compute[73056]:     <acpi/>
Aug 14 17:08:54 user nova-compute[73056]:     <apic/>
Aug 14 17:08:54 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 17:08:54 user nova-compute[73056]:   </features>
Aug 14 17:08:54 user nova-compute[73056]:   <clock offset="utc">
Aug 14 17:08:54 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 17:08:54 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 17:08:54 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 17:08:54 user nova-compute[73056]:   </clock>
Aug 14 17:08:54 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 17:08:54 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 17:08:54 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 17:08:54 user nova-compute[73056]:   </cpu>
Aug 14 17:08:54 user nova-compute[73056]:   <devices>
Aug 14 17:08:54 user nova-compute[73056]:     <disk type="block" device="disk">
Aug 14 17:08:54 user nova-compute[73056]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 17:08:54 user nova-compute[73056]:       <source dev="/dev/sdc"/>
Aug 14 17:08:54 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 17:08:54 user nova-compute[73056]:       <serial>20289a71-f1fe-42af-90f7-882c2863ed6b</serial>
Aug 14 17:08:54 user nova-compute[73056]:     </disk>
Aug 14 17:08:54 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 17:08:54 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 17:08:54 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4/disk.rescue"/>
Aug 14 17:08:54 user nova-compute[73056]:       <target dev="vdb" bus="virtio"/>
Aug 14 17:08:54 user nova-compute[73056]:       <boot order="1"/>
Aug 14 17:08:54 user nova-compute[73056]:     </disk>
Aug 14 17:08:54 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 17:08:54 user nova-compute[73056]:       <mac address="fa:16:3e:9e:41:c0"/>
Aug 14 17:08:54 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 17:08:54 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 17:08:54 user nova-compute[73056]:       <target dev="tap852aa0fc-c3"/>
Aug 14 17:08:54 user nova-compute[73056]:     </interface>
Aug 14 17:08:54 user nova-compute[73056]:     <serial type="pty">
Aug 14 17:08:54 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4/console.log" append="off"/>
Aug 14 17:08:54 user nova-compute[73056]:     </serial>
Aug 14 17:08:54 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 17:08:54 user nova-compute[73056]:     <video>
Aug 14 17:08:54 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 17:08:54 user nova-compute[73056]:     </video>
Aug 14 17:08:54 user nova-compute[73056]:     <rng model="virtio">
Aug 14 17:08:54 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 17:08:54 user nova-compute[73056]:     </rng>
Aug 14 17:08:54 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 17:08:54 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 17:08:54 user nova-compute[73056]:       <stats period="10"/>
Aug 14 17:08:54 user nova-compute[73056]:     </memballoon>
Aug 14 17:08:54 user nova-compute[73056]:   </devices>
Aug 14 17:08:54 user nova-compute[73056]: </domain>
Aug 14 17:08:54 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 17:08:54 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Instance destroyed successfully.
Aug 14 17:08:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 17:08:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] No VIF found with MAC fa:16:3e:9e:41:c0, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 17:08:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:08:56 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:08:56 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:08:56 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:08:56 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:08:56 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:08:56 user nova-compute[73056]: DEBUG nova.compute.manager [req-b2f8d076-b70a-4505-a570-3d359b462d52 req-a846d6ac-3b88-4de7-960e-214f41c06893 service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Received event network-vif-plugged-852aa0fc-c330-4cdf-9b88-93e0f0260f39 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:08:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-b2f8d076-b70a-4505-a570-3d359b462d52 req-a846d6ac-3b88-4de7-960e-214f41c06893 service nova] Acquiring lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:08:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-b2f8d076-b70a-4505-a570-3d359b462d52 req-a846d6ac-3b88-4de7-960e-214f41c06893 service nova] Lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:08:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-b2f8d076-b70a-4505-a570-3d359b462d52 req-a846d6ac-3b88-4de7-960e-214f41c06893 service nova] Lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:08:56 user nova-compute[73056]: DEBUG nova.compute.manager [req-b2f8d076-b70a-4505-a570-3d359b462d52 req-a846d6ac-3b88-4de7-960e-214f41c06893 service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] No waiting events found dispatching network-vif-plugged-852aa0fc-c330-4cdf-9b88-93e0f0260f39 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:08:56 user nova-compute[73056]: WARNING nova.compute.manager [req-b2f8d076-b70a-4505-a570-3d359b462d52 req-a846d6ac-3b88-4de7-960e-214f41c06893 service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Received unexpected event network-vif-plugged-852aa0fc-c330-4cdf-9b88-93e0f0260f39 for instance with vm_state active and task_state rescuing.
Aug 14 17:08:56 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:08:58 user nova-compute[73056]: DEBUG nova.compute.manager [req-0d2bb0c2-0ad4-4ec1-8a76-02512047f434 req-b30f34d5-3666-4aef-89cb-e0a35b33abc2 service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Received event network-vif-plugged-852aa0fc-c330-4cdf-9b88-93e0f0260f39 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:08:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0d2bb0c2-0ad4-4ec1-8a76-02512047f434 req-b30f34d5-3666-4aef-89cb-e0a35b33abc2 service nova] Acquiring lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:08:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0d2bb0c2-0ad4-4ec1-8a76-02512047f434 req-b30f34d5-3666-4aef-89cb-e0a35b33abc2 service nova] Lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:08:58 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-0d2bb0c2-0ad4-4ec1-8a76-02512047f434 req-b30f34d5-3666-4aef-89cb-e0a35b33abc2 service nova] Lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:08:58 user nova-compute[73056]: DEBUG nova.compute.manager [req-0d2bb0c2-0ad4-4ec1-8a76-02512047f434 req-b30f34d5-3666-4aef-89cb-e0a35b33abc2 service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] No waiting events found dispatching network-vif-plugged-852aa0fc-c330-4cdf-9b88-93e0f0260f39 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:08:58 user nova-compute[73056]: WARNING nova.compute.manager [req-0d2bb0c2-0ad4-4ec1-8a76-02512047f434 req-b30f34d5-3666-4aef-89cb-e0a35b33abc2 service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Received unexpected event network-vif-plugged-852aa0fc-c330-4cdf-9b88-93e0f0260f39 for instance with vm_state active and task_state rescuing.
Aug 14 17:08:58 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Removed pending event for 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4 due to event {{(pid=73056) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 17:08:58 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692032938.4409678, 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:08:58 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] VM Resumed (Lifecycle Event)
Aug 14 17:08:58 user nova-compute[73056]: DEBUG nova.compute.manager [None req-4b765047-393d-4a01-9bdb-7e0f2da6e996 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:08:58 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:08:58 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 17:08:58 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 17:08:58 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692032938.4420202, 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:08:58 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] VM Started (Lifecycle Event)
Aug 14 17:08:58 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:08:58 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 17:08:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:09:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:09:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:09:10 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:09:10 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 17:09:11 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:09:11 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:09:13 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:09:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:09:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:09:18 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:09:18 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 17:09:18 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Rebuilding the list of instances to heal {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 17:09:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-5191b082-a6f3-467c-b28b-fda85e15f330" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:09:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-5191b082-a6f3-467c-b28b-fda85e15f330" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:09:18 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 17:09:18 user nova-compute[73056]: DEBUG nova.objects.instance [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lazy-loading 'info_cache' on Instance uuid 5191b082-a6f3-467c-b28b-fda85e15f330 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:09:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:09:18 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Updating instance_info_cache with network_info: [{"id": "dee958cc-5a62-479c-8429-4c503bef3672", "address": "fa:16:3e:3e:a3:b5", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee958cc-5a", "ovs_interfaceid": "dee958cc-5a62-479c-8429-4c503bef3672", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:09:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-5191b082-a6f3-467c-b28b-fda85e15f330" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:09:18 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 17:09:21 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:09:21 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:09:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6b1cc854-6875-41da-85f6-2a5285c03b39 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "57225bb2-dbce-4212-b363-8dc34af05cce" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:09:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6b1cc854-6875-41da-85f6-2a5285c03b39 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "57225bb2-dbce-4212-b363-8dc34af05cce" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:09:22 user nova-compute[73056]: INFO nova.compute.manager [None req-6b1cc854-6875-41da-85f6-2a5285c03b39 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Detaching volume a66a398d-04ae-4635-ab42-f6a387452e58
Aug 14 17:09:22 user nova-compute[73056]: INFO nova.virt.block_device [None req-6b1cc854-6875-41da-85f6-2a5285c03b39 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Attempting to driver detach volume a66a398d-04ae-4635-ab42-f6a387452e58 from mountpoint /dev/vdb
Aug 14 17:09:22 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6b1cc854-6875-41da-85f6-2a5285c03b39 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Attempting to detach device vdb from instance 57225bb2-dbce-4212-b363-8dc34af05cce from the persistent domain config. {{(pid=73056) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 17:09:22 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-6b1cc854-6875-41da-85f6-2a5285c03b39 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 17:09:22 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 17:09:22 user nova-compute[73056]:   <source dev="/dev/sdb"/>
Aug 14 17:09:22 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 17:09:22 user nova-compute[73056]:   <serial>a66a398d-04ae-4635-ab42-f6a387452e58</serial>
Aug 14 17:09:22 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 17:09:22 user nova-compute[73056]: </disk>
Aug 14 17:09:22 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 17:09:22 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-6b1cc854-6875-41da-85f6-2a5285c03b39 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Successfully detached device vdb from instance 57225bb2-dbce-4212-b363-8dc34af05cce from the persistent domain config.
Aug 14 17:09:22 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6b1cc854-6875-41da-85f6-2a5285c03b39 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 57225bb2-dbce-4212-b363-8dc34af05cce from the live domain config. {{(pid=73056) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 17:09:22 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-6b1cc854-6875-41da-85f6-2a5285c03b39 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 17:09:22 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 17:09:22 user nova-compute[73056]:   <source dev="/dev/sdb"/>
Aug 14 17:09:22 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 17:09:22 user nova-compute[73056]:   <serial>a66a398d-04ae-4635-ab42-f6a387452e58</serial>
Aug 14 17:09:22 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 17:09:22 user nova-compute[73056]: </disk>
Aug 14 17:09:22 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Received event <DeviceRemovedEvent: 1692032963.3489528, 57225bb2-dbce-4212-b363-8dc34af05cce => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73056) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-6b1cc854-6875-41da-85f6-2a5285c03b39 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 57225bb2-dbce-4212-b363-8dc34af05cce {{(pid=73056) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 17:09:23 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-6b1cc854-6875-41da-85f6-2a5285c03b39 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Successfully detached device vdb from instance 57225bb2-dbce-4212-b363-8dc34af05cce from the live domain config.
Aug 14 17:09:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b1cc854-6875-41da-85f6-2a5285c03b39 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1cc854-6875-41da-85f6-2a5285c03b39 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ocqrgTUL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 17:09:23 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-6b1cc854-6875-41da-85f6-2a5285c03b39 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 17:09:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-6b1cc854-6875-41da-85f6-2a5285c03b39 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-6b1cc854-6875-41da-85f6-2a5285c03b39 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1cc854-6875-41da-85f6-2a5285c03b39 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bd8383-554b-4cf6-bc8d-fcd482a67266]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90b74b2-9b39-445e-98bf-2b137c9130e2]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1cc854-6875-41da-85f6-2a5285c03b39 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 17:09:23 user nova-compute[73056]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b (non-flash)
Aug 14 17:09:23 user nova-compute[73056]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 (non-flash)
Aug 14 17:09:23 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1cc854-6875-41da-85f6-2a5285c03b39 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 17:09:23 user nova-compute[73056]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b (non-flash)
Aug 14 17:09:23 user nova-compute[73056]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 (non-flash)
Aug 14 17:09:23 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1cc854-6875-41da-85f6-2a5285c03b39 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff32fcac280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58'): ({'sdb'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-6b1cc854-6875-41da-85f6-2a5285c03b39 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Removing single pathed devices sdb {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abdc816-34cd-459c-8474-e7d5085dfa10]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[698afa5d-fd14-4f2d-b583-49ea12482ff1]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-6b1cc854-6875-41da-85f6-2a5285c03b39 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Flushing IO for device /dev/sdb {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8297ba-9d5c-4a82-b1fa-85995b843278]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-6b1cc854-6875-41da-85f6-2a5285c03b39 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c051ca80-3e0d-4082-8293-2684cda6d631]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-6b1cc854-6875-41da-85f6-2a5285c03b39 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-6b1cc854-6875-41da-85f6-2a5285c03b39 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] SCSI volumes sdb have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1cc854-6875-41da-85f6-2a5285c03b39 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[060ca40b-c9bd-4118-a922-e018a6b3ab95]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1cc854-6875-41da-85f6-2a5285c03b39 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2c87ba-574e-47b5-a9c9-983fedb57aca]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1cc854-6875-41da-85f6-2a5285c03b39 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58, portal: 172.16.0.220,3260]
Aug 14 17:09:23 user nova-compute[73056]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58, portal: 172.16.0.220,3260] successful.
Aug 14 17:09:23 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a66a398d-04ae-4635-ab42-f6a387452e58 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f8fcc6-0d33-4c69-b7b8-0c3282594cca]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1cc854-6875-41da-85f6-2a5285c03b39 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-6b1cc854-6875-41da-85f6-2a5285c03b39 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1cc854-6875-41da-85f6-2a5285c03b39 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] <== disconnect_volume: return (284ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b1cc854-6875-41da-85f6-2a5285c03b39 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 17:09:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:09:24 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:09:24 user nova-compute[73056]: DEBUG nova.objects.instance [None req-6b1cc854-6875-41da-85f6-2a5285c03b39 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lazy-loading 'flavor' on Instance uuid 57225bb2-dbce-4212-b363-8dc34af05cce {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:09:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-6b1cc854-6875-41da-85f6-2a5285c03b39 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "57225bb2-dbce-4212-b363-8dc34af05cce" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.643s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:09:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a534a4c0-1e4b-4c87-bf84-1872a715ebd8 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "57225bb2-dbce-4212-b363-8dc34af05cce" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:09:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a534a4c0-1e4b-4c87-bf84-1872a715ebd8 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "57225bb2-dbce-4212-b363-8dc34af05cce" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:09:25 user nova-compute[73056]: DEBUG nova.compute.manager [None req-a534a4c0-1e4b-4c87-bf84-1872a715ebd8 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:09:25 user nova-compute[73056]: DEBUG nova.compute.manager [None req-a534a4c0-1e4b-4c87-bf84-1872a715ebd8 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73056) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 14 17:09:25 user nova-compute[73056]: DEBUG nova.objects.instance [None req-a534a4c0-1e4b-4c87-bf84-1872a715ebd8 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lazy-loading 'flavor' on Instance uuid 57225bb2-dbce-4212-b363-8dc34af05cce {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:09:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:09:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:09:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:09:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:09:25 user nova-compute[73056]: DEBUG nova.compute.manager [req-f97ee161-63f7-4414-9942-1af7d29d0c1b req-ff1cad0c-c2c1-41c1-a700-8d671fcd42d6 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received event network-vif-unplugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:09:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f97ee161-63f7-4414-9942-1af7d29d0c1b req-ff1cad0c-c2c1-41c1-a700-8d671fcd42d6 service nova] Acquiring lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:09:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f97ee161-63f7-4414-9942-1af7d29d0c1b req-ff1cad0c-c2c1-41c1-a700-8d671fcd42d6 service nova] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:09:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f97ee161-63f7-4414-9942-1af7d29d0c1b req-ff1cad0c-c2c1-41c1-a700-8d671fcd42d6 service nova] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:09:25 user nova-compute[73056]: DEBUG nova.compute.manager [req-f97ee161-63f7-4414-9942-1af7d29d0c1b req-ff1cad0c-c2c1-41c1-a700-8d671fcd42d6 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] No waiting events found dispatching network-vif-unplugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:09:25 user nova-compute[73056]: WARNING nova.compute.manager [req-f97ee161-63f7-4414-9942-1af7d29d0c1b req-ff1cad0c-c2c1-41c1-a700-8d671fcd42d6 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received unexpected event network-vif-unplugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a for instance with vm_state active and task_state powering-off.
Aug 14 17:09:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:09:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:09:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:09:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:09:25 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Instance destroyed successfully.
Aug 14 17:09:25 user nova-compute[73056]: DEBUG nova.compute.manager [None req-a534a4c0-1e4b-4c87-bf84-1872a715ebd8 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:09:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:09:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a534a4c0-1e4b-4c87-bf84-1872a715ebd8 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "57225bb2-dbce-4212-b363-8dc34af05cce" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.876s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:09:26 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:09:26 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:09:26 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:09:26 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:09:26 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:09:26 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:09:26 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:09:26 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:09:27 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:09:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:09:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:09:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:09:27 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 17:09:27 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 17:09:27 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:09:27 user nova-compute[73056]: DEBUG nova.compute.manager [req-8708da3e-38f6-488e-914c-9537efe60189 req-e1da1f7e-8b6f-48dd-8805-d7306730ef0f service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received event network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:09:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8708da3e-38f6-488e-914c-9537efe60189 req-e1da1f7e-8b6f-48dd-8805-d7306730ef0f service nova] Acquiring lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:09:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8708da3e-38f6-488e-914c-9537efe60189 req-e1da1f7e-8b6f-48dd-8805-d7306730ef0f service nova] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:09:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8708da3e-38f6-488e-914c-9537efe60189 req-e1da1f7e-8b6f-48dd-8805-d7306730ef0f service nova] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:09:27 user nova-compute[73056]: DEBUG nova.compute.manager [req-8708da3e-38f6-488e-914c-9537efe60189 req-e1da1f7e-8b6f-48dd-8805-d7306730ef0f service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] No waiting events found dispatching network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:09:27 user nova-compute[73056]: WARNING nova.compute.manager [req-8708da3e-38f6-488e-914c-9537efe60189 req-e1da1f7e-8b6f-48dd-8805-d7306730ef0f service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received unexpected event network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a for instance with vm_state stopped and task_state None.
Aug 14 17:09:27 user nova-compute[73056]: DEBUG nova.compute.manager [req-8708da3e-38f6-488e-914c-9537efe60189 req-e1da1f7e-8b6f-48dd-8805-d7306730ef0f service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received event network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:09:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8708da3e-38f6-488e-914c-9537efe60189 req-e1da1f7e-8b6f-48dd-8805-d7306730ef0f service nova] Acquiring lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:09:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8708da3e-38f6-488e-914c-9537efe60189 req-e1da1f7e-8b6f-48dd-8805-d7306730ef0f service nova] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:09:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8708da3e-38f6-488e-914c-9537efe60189 req-e1da1f7e-8b6f-48dd-8805-d7306730ef0f service nova] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:09:27 user nova-compute[73056]: DEBUG nova.compute.manager [req-8708da3e-38f6-488e-914c-9537efe60189 req-e1da1f7e-8b6f-48dd-8805-d7306730ef0f service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] No waiting events found dispatching network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:09:27 user nova-compute[73056]: WARNING nova.compute.manager [req-8708da3e-38f6-488e-914c-9537efe60189 req-e1da1f7e-8b6f-48dd-8805-d7306730ef0f service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received unexpected event network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a for instance with vm_state stopped and task_state None.
Aug 14 17:09:27 user nova-compute[73056]: DEBUG nova.compute.manager [req-8708da3e-38f6-488e-914c-9537efe60189 req-e1da1f7e-8b6f-48dd-8805-d7306730ef0f service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received event network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:09:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8708da3e-38f6-488e-914c-9537efe60189 req-e1da1f7e-8b6f-48dd-8805-d7306730ef0f service nova] Acquiring lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:09:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8708da3e-38f6-488e-914c-9537efe60189 req-e1da1f7e-8b6f-48dd-8805-d7306730ef0f service nova] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:09:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8708da3e-38f6-488e-914c-9537efe60189 req-e1da1f7e-8b6f-48dd-8805-d7306730ef0f service nova] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:09:27 user nova-compute[73056]: DEBUG nova.compute.manager [req-8708da3e-38f6-488e-914c-9537efe60189 req-e1da1f7e-8b6f-48dd-8805-d7306730ef0f service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] No waiting events found dispatching network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:09:27 user nova-compute[73056]: WARNING nova.compute.manager [req-8708da3e-38f6-488e-914c-9537efe60189 req-e1da1f7e-8b6f-48dd-8805-d7306730ef0f service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received unexpected event network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a for instance with vm_state stopped and task_state None.
Aug 14 17:09:27 user nova-compute[73056]: DEBUG nova.compute.manager [req-8708da3e-38f6-488e-914c-9537efe60189 req-e1da1f7e-8b6f-48dd-8805-d7306730ef0f service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received event network-vif-unplugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:09:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8708da3e-38f6-488e-914c-9537efe60189 req-e1da1f7e-8b6f-48dd-8805-d7306730ef0f service nova] Acquiring lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:09:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8708da3e-38f6-488e-914c-9537efe60189 req-e1da1f7e-8b6f-48dd-8805-d7306730ef0f service nova] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:09:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8708da3e-38f6-488e-914c-9537efe60189 req-e1da1f7e-8b6f-48dd-8805-d7306730ef0f service nova] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:09:27 user nova-compute[73056]: DEBUG nova.compute.manager [req-8708da3e-38f6-488e-914c-9537efe60189 req-e1da1f7e-8b6f-48dd-8805-d7306730ef0f service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] No waiting events found dispatching network-vif-unplugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:09:27 user nova-compute[73056]: WARNING nova.compute.manager [req-8708da3e-38f6-488e-914c-9537efe60189 req-e1da1f7e-8b6f-48dd-8805-d7306730ef0f service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received unexpected event network-vif-unplugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a for instance with vm_state stopped and task_state None.
Aug 14 17:09:27 user nova-compute[73056]: DEBUG nova.compute.manager [req-8708da3e-38f6-488e-914c-9537efe60189 req-e1da1f7e-8b6f-48dd-8805-d7306730ef0f service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received event network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:09:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8708da3e-38f6-488e-914c-9537efe60189 req-e1da1f7e-8b6f-48dd-8805-d7306730ef0f service nova] Acquiring lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:09:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8708da3e-38f6-488e-914c-9537efe60189 req-e1da1f7e-8b6f-48dd-8805-d7306730ef0f service nova] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:09:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8708da3e-38f6-488e-914c-9537efe60189 req-e1da1f7e-8b6f-48dd-8805-d7306730ef0f service nova] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:09:27 user nova-compute[73056]: DEBUG nova.compute.manager [req-8708da3e-38f6-488e-914c-9537efe60189 req-e1da1f7e-8b6f-48dd-8805-d7306730ef0f service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] No waiting events found dispatching network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:09:27 user nova-compute[73056]: WARNING nova.compute.manager [req-8708da3e-38f6-488e-914c-9537efe60189 req-e1da1f7e-8b6f-48dd-8805-d7306730ef0f service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received unexpected event network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a for instance with vm_state stopped and task_state None.
Aug 14 17:09:27 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:09:27 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:09:27 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:09:27 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:09:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:09:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:09:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:09:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 17:09:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:09:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:09:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:09:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:09:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:09:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:09:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:09:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:09:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:09:29 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:09:29 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:09:29 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=8427MB free_disk=24.945919036865234GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 17:09:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:09:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:09:29 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 5191b082-a6f3-467c-b28b-fda85e15f330 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:09:29 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance fb1a193b-73b7-4690-8571-be9af04b3b14 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:09:29 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 57225bb2-dbce-4212-b363-8dc34af05cce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:09:29 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 090405b6-77e0-4f28-bd8d-e7fccfa894b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:09:29 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:09:29 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 17:09:29 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 17:09:29 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:09:29 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:09:29 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 17:09:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.343s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:09:31 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:09:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:09:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:09:40 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692032965.9001417, 57225bb2-dbce-4212-b363-8dc34af05cce => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:09:40 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] VM Stopped (Lifecycle Event)
Aug 14 17:09:40 user nova-compute[73056]: DEBUG nova.compute.manager [None req-6feb5541-08c5-4251-bdbd-51a9ff1367b8 None None] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:09:40 user nova-compute[73056]: DEBUG nova.compute.manager [None req-6feb5541-08c5-4251-bdbd-51a9ff1367b8 None None] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 17:09:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:09:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:09:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:09:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:09:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:09:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:09:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:09:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:09:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:09:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:09:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:09:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:09:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:09:56 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:09:56 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:09:56 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:09:56 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:09:56 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:09:56 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:10:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:10:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:10:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:10:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:10:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:10:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:10:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:10:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:10:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:10:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:10:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:10:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:10:11 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:10:11 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:10:11 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:10:11 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:10:11 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:10:11 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:10:13 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:10:13 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:10:13 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 17:10:14 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:10:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:10:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:10:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:10:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:10:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:10:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:10:18 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:10:18 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 17:10:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-fb1a193b-73b7-4690-8571-be9af04b3b14" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:10:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-fb1a193b-73b7-4690-8571-be9af04b3b14" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:10:18 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 17:10:18 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Updating instance_info_cache with network_info: [{"id": "852ab20a-9a1b-47c5-b85e-52a44fff3e36", "address": "fa:16:3e:32:95:fb", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852ab20a-9a", "ovs_interfaceid": "852ab20a-9a1b-47c5-b85e-52a44fff3e36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:10:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-fb1a193b-73b7-4690-8571-be9af04b3b14" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:10:19 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 17:10:21 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:10:21 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:10:23 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:10:24 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:10:25 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:10:26 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:10:27 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:10:28 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:10:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:10:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:10:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:10:28 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 17:10:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 17:10:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:10:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:10:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4/disk.rescue --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:10:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:10:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:10:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:10:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:10:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:10:29 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 17:10:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:10:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:10:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:10:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:10:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:10:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:10:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:10:29 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:10:30 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:10:30 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:10:30 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=8550MB free_disk=24.944908142089844GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 17:10:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:10:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:10:30 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 5191b082-a6f3-467c-b28b-fda85e15f330 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:10:30 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance fb1a193b-73b7-4690-8571-be9af04b3b14 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:10:30 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 57225bb2-dbce-4212-b363-8dc34af05cce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:10:30 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 090405b6-77e0-4f28-bd8d-e7fccfa894b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:10:30 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:10:30 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 17:10:30 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 17:10:30 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:10:30 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:10:30 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 17:10:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.279s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:10:31 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:10:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:10:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:10:41 user nova-compute[73056]: INFO nova.compute.manager [None req-29f62756-7c2b-4cd2-91a9-3dcf4b58f7c6 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Unrescuing
Aug 14 17:10:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-29f62756-7c2b-4cd2-91a9-3dcf4b58f7c6 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "refresh_cache-3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:10:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-29f62756-7c2b-4cd2-91a9-3dcf4b58f7c6 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquired lock "refresh_cache-3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:10:41 user nova-compute[73056]: DEBUG nova.network.neutron [None req-29f62756-7c2b-4cd2-91a9-3dcf4b58f7c6 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 17:10:42 user nova-compute[73056]: DEBUG nova.network.neutron [None req-29f62756-7c2b-4cd2-91a9-3dcf4b58f7c6 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Updating instance_info_cache with network_info: [{"id": "852aa0fc-c330-4cdf-9b88-93e0f0260f39", "address": "fa:16:3e:9e:41:c0", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852aa0fc-c3", "ovs_interfaceid": "852aa0fc-c330-4cdf-9b88-93e0f0260f39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:10:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-29f62756-7c2b-4cd2-91a9-3dcf4b58f7c6 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Releasing lock "refresh_cache-3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:10:42 user nova-compute[73056]: DEBUG nova.objects.instance [None req-29f62756-7c2b-4cd2-91a9-3dcf4b58f7c6 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lazy-loading 'flavor' on Instance uuid 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:10:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:10:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:10:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:10:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:10:42 user nova-compute[73056]: DEBUG nova.compute.manager [req-4f278837-d854-4a50-aec4-b769f0c374ff req-0fc77481-9376-4ced-ac50-171347976427 service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Received event network-vif-unplugged-852aa0fc-c330-4cdf-9b88-93e0f0260f39 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:10:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4f278837-d854-4a50-aec4-b769f0c374ff req-0fc77481-9376-4ced-ac50-171347976427 service nova] Acquiring lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:10:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4f278837-d854-4a50-aec4-b769f0c374ff req-0fc77481-9376-4ced-ac50-171347976427 service nova] Lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:10:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4f278837-d854-4a50-aec4-b769f0c374ff req-0fc77481-9376-4ced-ac50-171347976427 service nova] Lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:10:42 user nova-compute[73056]: DEBUG nova.compute.manager [req-4f278837-d854-4a50-aec4-b769f0c374ff req-0fc77481-9376-4ced-ac50-171347976427 service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] No waiting events found dispatching network-vif-unplugged-852aa0fc-c330-4cdf-9b88-93e0f0260f39 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:10:42 user nova-compute[73056]: WARNING nova.compute.manager [req-4f278837-d854-4a50-aec4-b769f0c374ff req-0fc77481-9376-4ced-ac50-171347976427 service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Received unexpected event network-vif-unplugged-852aa0fc-c330-4cdf-9b88-93e0f0260f39 for instance with vm_state rescued and task_state unrescuing.
Aug 14 17:10:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:10:42 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Instance destroyed successfully.
Aug 14 17:10:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:10:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:10:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:10:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:10:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:10:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:10:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:10:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:10:44 user nova-compute[73056]: DEBUG nova.compute.manager [req-f87959bb-a331-450c-8095-3676381eff4d req-cc590f44-aab0-4b30-9131-9bf93ef1ae3a service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Received event network-vif-plugged-852aa0fc-c330-4cdf-9b88-93e0f0260f39 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:10:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f87959bb-a331-450c-8095-3676381eff4d req-cc590f44-aab0-4b30-9131-9bf93ef1ae3a service nova] Acquiring lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:10:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f87959bb-a331-450c-8095-3676381eff4d req-cc590f44-aab0-4b30-9131-9bf93ef1ae3a service nova] Lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:10:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f87959bb-a331-450c-8095-3676381eff4d req-cc590f44-aab0-4b30-9131-9bf93ef1ae3a service nova] Lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:10:44 user nova-compute[73056]: DEBUG nova.compute.manager [req-f87959bb-a331-450c-8095-3676381eff4d req-cc590f44-aab0-4b30-9131-9bf93ef1ae3a service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] No waiting events found dispatching network-vif-plugged-852aa0fc-c330-4cdf-9b88-93e0f0260f39 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:10:44 user nova-compute[73056]: WARNING nova.compute.manager [req-f87959bb-a331-450c-8095-3676381eff4d req-cc590f44-aab0-4b30-9131-9bf93ef1ae3a service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Received unexpected event network-vif-plugged-852aa0fc-c330-4cdf-9b88-93e0f0260f39 for instance with vm_state rescued and task_state unrescuing.
Aug 14 17:10:44 user nova-compute[73056]: DEBUG nova.compute.manager [req-f87959bb-a331-450c-8095-3676381eff4d req-cc590f44-aab0-4b30-9131-9bf93ef1ae3a service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Received event network-vif-plugged-852aa0fc-c330-4cdf-9b88-93e0f0260f39 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:10:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f87959bb-a331-450c-8095-3676381eff4d req-cc590f44-aab0-4b30-9131-9bf93ef1ae3a service nova] Acquiring lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:10:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f87959bb-a331-450c-8095-3676381eff4d req-cc590f44-aab0-4b30-9131-9bf93ef1ae3a service nova] Lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:10:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f87959bb-a331-450c-8095-3676381eff4d req-cc590f44-aab0-4b30-9131-9bf93ef1ae3a service nova] Lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:10:44 user nova-compute[73056]: DEBUG nova.compute.manager [req-f87959bb-a331-450c-8095-3676381eff4d req-cc590f44-aab0-4b30-9131-9bf93ef1ae3a service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] No waiting events found dispatching network-vif-plugged-852aa0fc-c330-4cdf-9b88-93e0f0260f39 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:10:44 user nova-compute[73056]: WARNING nova.compute.manager [req-f87959bb-a331-450c-8095-3676381eff4d req-cc590f44-aab0-4b30-9131-9bf93ef1ae3a service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Received unexpected event network-vif-plugged-852aa0fc-c330-4cdf-9b88-93e0f0260f39 for instance with vm_state rescued and task_state unrescuing.
Aug 14 17:10:46 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Removed pending event for 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4 due to event {{(pid=73056) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 17:10:46 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692033046.1655712, 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:10:46 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] VM Resumed (Lifecycle Event)
Aug 14 17:10:46 user nova-compute[73056]: DEBUG nova.compute.manager [None req-29f62756-7c2b-4cd2-91a9-3dcf4b58f7c6 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:10:46 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:10:46 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 17:10:46 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 17:10:46 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692033046.1673262, 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:10:46 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] VM Started (Lifecycle Event)
Aug 14 17:10:46 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:10:46 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 17:10:46 user nova-compute[73056]: DEBUG nova.compute.manager [req-574b2f60-6cad-436e-9095-9fc1e070561c req-18b3732c-565e-4e88-b4b0-7172ffa5df79 service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Received event network-vif-plugged-852aa0fc-c330-4cdf-9b88-93e0f0260f39 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:10:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-574b2f60-6cad-436e-9095-9fc1e070561c req-18b3732c-565e-4e88-b4b0-7172ffa5df79 service nova] Acquiring lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:10:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-574b2f60-6cad-436e-9095-9fc1e070561c req-18b3732c-565e-4e88-b4b0-7172ffa5df79 service nova] Lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:10:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-574b2f60-6cad-436e-9095-9fc1e070561c req-18b3732c-565e-4e88-b4b0-7172ffa5df79 service nova] Lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:10:46 user nova-compute[73056]: DEBUG nova.compute.manager [req-574b2f60-6cad-436e-9095-9fc1e070561c req-18b3732c-565e-4e88-b4b0-7172ffa5df79 service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] No waiting events found dispatching network-vif-plugged-852aa0fc-c330-4cdf-9b88-93e0f0260f39 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:10:46 user nova-compute[73056]: WARNING nova.compute.manager [req-574b2f60-6cad-436e-9095-9fc1e070561c req-18b3732c-565e-4e88-b4b0-7172ffa5df79 service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Received unexpected event network-vif-plugged-852aa0fc-c330-4cdf-9b88-93e0f0260f39 for instance with vm_state active and task_state None.
Aug 14 17:10:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:10:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:10:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:10:56 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:10:56 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:10:56 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:10:56 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:10:56 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:10:56 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:11:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:11:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:11:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:11:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:11:11 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:11:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:11:15 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:11:15 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:11:15 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:11:15 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 17:11:15 user nova-compute[73056]: DEBUG nova.objects.instance [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lazy-loading 'flavor' on Instance uuid 57225bb2-dbce-4212-b363-8dc34af05cce {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:11:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "refresh_cache-57225bb2-dbce-4212-b363-8dc34af05cce" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:11:15 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquired lock "refresh_cache-57225bb2-dbce-4212-b363-8dc34af05cce" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:11:15 user nova-compute[73056]: DEBUG nova.network.neutron [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 17:11:15 user nova-compute[73056]: DEBUG nova.objects.instance [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lazy-loading 'info_cache' on Instance uuid 57225bb2-dbce-4212-b363-8dc34af05cce {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:11:16 user nova-compute[73056]: DEBUG nova.network.neutron [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Updating instance_info_cache with network_info: [{"id": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "address": "fa:16:3e:8c:b4:10", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4f4ff4-8e", "ovs_interfaceid": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:11:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Releasing lock "refresh_cache-57225bb2-dbce-4212-b363-8dc34af05cce" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:11:16 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Instance destroyed successfully.
Aug 14 17:11:16 user nova-compute[73056]: DEBUG nova.objects.instance [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lazy-loading 'resources' on Instance uuid 57225bb2-dbce-4212-b363-8dc34af05cce {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:11:16 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T17:03:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1082884404',display_name='tempest-AttachVolumeTestJSON-server-1082884404',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1082884404',id=44,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPNPWJ92774fwNZF6PVgQpXcTKVtR5LMZz3xu6DLKvMpyOVFGtxgTJRS/WltAZEiJfd7Brr2rP/3+0iYPbiNk8IOQAitKjVnZlCsrC86QNIF45RYJq5300KRzpYOnBhVg==',key_name='tempest-keypair-1762591610',keypairs=<?>,launch_index=0,launched_at=2023-08-14T17:03:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='415a7291b35546b5ac324280d37d50ae',ramdisk_id='',reservation_id='r-vobfg0xl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-112776827',owner_user_name='tempest-AttachVolumeTestJSON-112776827-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T17:09:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bf4bfed609343c78b0d828db45d5ab7',uuid=57225bb2-dbce-4212-b363-8dc34af05cce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "address": "fa:16:3e:8c:b4:10", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4f4ff4-8e", "ovs_interfaceid": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 17:11:16 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Converting VIF {"id": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "address": "fa:16:3e:8c:b4:10", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4f4ff4-8e", "ovs_interfaceid": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:11:16 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b4:10,bridge_name='br-int',has_traffic_filtering=True,id=2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a,network=Network(7e2ce9fb-4bdc-441f-ae4a-30224b2712e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4f4ff4-8e') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:11:16 user nova-compute[73056]: DEBUG os_vif [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b4:10,bridge_name='br-int',has_traffic_filtering=True,id=2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a,network=Network(7e2ce9fb-4bdc-441f-ae4a-30224b2712e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4f4ff4-8e') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 17:11:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:11:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e4f4ff4-8e, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:11:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:11:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:11:16 user nova-compute[73056]: INFO os_vif [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b4:10,bridge_name='br-int',has_traffic_filtering=True,id=2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a,network=Network(7e2ce9fb-4bdc-441f-ae4a-30224b2712e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4f4ff4-8e')
Aug 14 17:11:16 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Start _get_guest_xml network_info=[{"id": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "address": "fa:16:3e:8c:b4:10", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4f4ff4-8e", "ovs_interfaceid": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 17:11:16 user nova-compute[73056]: DEBUG nova.objects.instance [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lazy-loading 'numa_topology' on Instance uuid 57225bb2-dbce-4212-b363-8dc34af05cce {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:11:16 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:11:16 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:11:16 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 17:11:16 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 17:11:16 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 17:11:16 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 17:11:16 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 17:11:16 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 17:11:16 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 17:11:16 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 17:11:16 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 17:11:16 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 17:11:16 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 17:11:16 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 17:11:16 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 17:11:16 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 17:11:16 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 17:11:16 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 17:11:16 user nova-compute[73056]: DEBUG nova.objects.instance [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lazy-loading 'vcpu_model' on Instance uuid 57225bb2-dbce-4212-b363-8dc34af05cce {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:11:16 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T17:03:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1082884404',display_name='tempest-AttachVolumeTestJSON-server-1082884404',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1082884404',id=44,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPNPWJ92774fwNZF6PVgQpXcTKVtR5LMZz3xu6DLKvMpyOVFGtxgTJRS/WltAZEiJfd7Brr2rP/3+0iYPbiNk8IOQAitKjVnZlCsrC86QNIF45RYJq5300KRzpYOnBhVg==',key_name='tempest-keypair-1762591610',keypairs=<?>,launch_index=0,launched_at=2023-08-14T17:03:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='415a7291b35546b5ac324280d37d50ae',ramdisk_id='',reservation_id='r-vobfg0xl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-112776827',owner_user_name='tempest-AttachVolumeTestJSON-112776827-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T17:09:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bf4bfed609343c78b0d828db45d5ab7',uuid=57225bb2-dbce-4212-b363-8dc34af05cce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "address": "fa:16:3e:8c:b4:10", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4f4ff4-8e", "ovs_interfaceid": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 17:11:16 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Converting VIF {"id": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "address": "fa:16:3e:8c:b4:10", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4f4ff4-8e", "ovs_interfaceid": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:11:16 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b4:10,bridge_name='br-int',has_traffic_filtering=True,id=2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a,network=Network(7e2ce9fb-4bdc-441f-ae4a-30224b2712e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4f4ff4-8e') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:11:16 user nova-compute[73056]: DEBUG nova.objects.instance [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lazy-loading 'pci_devices' on Instance uuid 57225bb2-dbce-4212-b363-8dc34af05cce {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:11:16 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] End _get_guest_xml xml=<domain type="kvm">
Aug 14 17:11:16 user nova-compute[73056]:   <uuid>57225bb2-dbce-4212-b363-8dc34af05cce</uuid>
Aug 14 17:11:16 user nova-compute[73056]:   <name>instance-0000002c</name>
Aug 14 17:11:16 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 17:11:16 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 17:11:16 user nova-compute[73056]:   <metadata>
Aug 14 17:11:16 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 17:11:16 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 17:11:16 user nova-compute[73056]:       <nova:name>tempest-AttachVolumeTestJSON-server-1082884404</nova:name>
Aug 14 17:11:16 user nova-compute[73056]:       <nova:creationTime>2023-08-14 17:11:16</nova:creationTime>
Aug 14 17:11:16 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 17:11:16 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 17:11:16 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 17:11:16 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 17:11:16 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 17:11:16 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 17:11:16 user nova-compute[73056]:       </nova:flavor>
Aug 14 17:11:16 user nova-compute[73056]:       <nova:owner>
Aug 14 17:11:16 user nova-compute[73056]:         <nova:user uuid="0bf4bfed609343c78b0d828db45d5ab7">tempest-AttachVolumeTestJSON-112776827-project-member</nova:user>
Aug 14 17:11:16 user nova-compute[73056]:         <nova:project uuid="415a7291b35546b5ac324280d37d50ae">tempest-AttachVolumeTestJSON-112776827</nova:project>
Aug 14 17:11:16 user nova-compute[73056]:       </nova:owner>
Aug 14 17:11:16 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 17:11:16 user nova-compute[73056]:       <nova:ports>
Aug 14 17:11:16 user nova-compute[73056]:         <nova:port uuid="2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a">
Aug 14 17:11:16 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 17:11:16 user nova-compute[73056]:         </nova:port>
Aug 14 17:11:16 user nova-compute[73056]:       </nova:ports>
Aug 14 17:11:16 user nova-compute[73056]:     </nova:instance>
Aug 14 17:11:16 user nova-compute[73056]:   </metadata>
Aug 14 17:11:16 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 17:11:16 user nova-compute[73056]:     <system>
Aug 14 17:11:16 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 17:11:16 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 17:11:16 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 17:11:16 user nova-compute[73056]:       <entry name="serial">57225bb2-dbce-4212-b363-8dc34af05cce</entry>
Aug 14 17:11:16 user nova-compute[73056]:       <entry name="uuid">57225bb2-dbce-4212-b363-8dc34af05cce</entry>
Aug 14 17:11:16 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 17:11:16 user nova-compute[73056]:     </system>
Aug 14 17:11:16 user nova-compute[73056]:   </sysinfo>
Aug 14 17:11:16 user nova-compute[73056]:   <os>
Aug 14 17:11:16 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 17:11:16 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 17:11:16 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 17:11:16 user nova-compute[73056]:   </os>
Aug 14 17:11:16 user nova-compute[73056]:   <features>
Aug 14 17:11:16 user nova-compute[73056]:     <acpi/>
Aug 14 17:11:16 user nova-compute[73056]:     <apic/>
Aug 14 17:11:16 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 17:11:16 user nova-compute[73056]:   </features>
Aug 14 17:11:16 user nova-compute[73056]:   <clock offset="utc">
Aug 14 17:11:16 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 17:11:16 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 17:11:16 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 17:11:16 user nova-compute[73056]:   </clock>
Aug 14 17:11:16 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 17:11:16 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 17:11:16 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 17:11:16 user nova-compute[73056]:   </cpu>
Aug 14 17:11:16 user nova-compute[73056]:   <devices>
Aug 14 17:11:16 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 17:11:16 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 17:11:16 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk"/>
Aug 14 17:11:16 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 17:11:16 user nova-compute[73056]:     </disk>
Aug 14 17:11:16 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 17:11:16 user nova-compute[73056]:       <mac address="fa:16:3e:8c:b4:10"/>
Aug 14 17:11:16 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 17:11:16 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 17:11:16 user nova-compute[73056]:       <target dev="tap2e4f4ff4-8e"/>
Aug 14 17:11:16 user nova-compute[73056]:     </interface>
Aug 14 17:11:16 user nova-compute[73056]:     <serial type="pty">
Aug 14 17:11:16 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/console.log" append="off"/>
Aug 14 17:11:16 user nova-compute[73056]:     </serial>
Aug 14 17:11:16 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 17:11:16 user nova-compute[73056]:     <video>
Aug 14 17:11:16 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 17:11:16 user nova-compute[73056]:     </video>
Aug 14 17:11:16 user nova-compute[73056]:     <rng model="virtio">
Aug 14 17:11:16 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 17:11:16 user nova-compute[73056]:     </rng>
Aug 14 17:11:16 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 17:11:16 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 17:11:16 user nova-compute[73056]:       <stats period="10"/>
Aug 14 17:11:16 user nova-compute[73056]:     </memballoon>
Aug 14 17:11:16 user nova-compute[73056]:   </devices>
Aug 14 17:11:16 user nova-compute[73056]: </domain>
Aug 14 17:11:16 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 17:11:16 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:11:16 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:11:16 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:11:16 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:11:16 user nova-compute[73056]: DEBUG nova.objects.instance [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lazy-loading 'trusted_certs' on Instance uuid 57225bb2-dbce-4212-b363-8dc34af05cce {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:11:16 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:11:17 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.168s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:11:17 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Checking if we can resize image /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 17:11:17 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:11:17 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:11:17 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Cannot resize image /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 17:11:17 user nova-compute[73056]: DEBUG nova.objects.instance [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lazy-loading 'migration_context' on Instance uuid 57225bb2-dbce-4212-b363-8dc34af05cce {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:11:17 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T17:03:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1082884404',display_name='tempest-AttachVolumeTestJSON-server-1082884404',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1082884404',id=44,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPNPWJ92774fwNZF6PVgQpXcTKVtR5LMZz3xu6DLKvMpyOVFGtxgTJRS/WltAZEiJfd7Brr2rP/3+0iYPbiNk8IOQAitKjVnZlCsrC86QNIF45RYJq5300KRzpYOnBhVg==',key_name='tempest-keypair-1762591610',keypairs=<?>,launch_index=0,launched_at=2023-08-14T17:03:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='415a7291b35546b5ac324280d37d50ae',ramdisk_id='',reservation_id='r-vobfg0xl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-112776827',owner_user_name='tempest-AttachVolumeTestJSON-112776827-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T17:09:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bf4bfed609343c78b0d828db45d5ab7',uuid=57225bb2-dbce-4212-b363-8dc34af05cce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "address": "fa:16:3e:8c:b4:10", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4f4ff4-8e", "ovs_interfaceid": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 17:11:17 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Converting VIF {"id": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "address": "fa:16:3e:8c:b4:10", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4f4ff4-8e", "ovs_interfaceid": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:11:17 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b4:10,bridge_name='br-int',has_traffic_filtering=True,id=2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a,network=Network(7e2ce9fb-4bdc-441f-ae4a-30224b2712e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4f4ff4-8e') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:11:17 user nova-compute[73056]: DEBUG os_vif [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b4:10,bridge_name='br-int',has_traffic_filtering=True,id=2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a,network=Network(7e2ce9fb-4bdc-441f-ae4a-30224b2712e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4f4ff4-8e') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 17:11:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:11:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:11:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 17:11:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:11:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e4f4ff4-8e, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:11:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2e4f4ff4-8e, col_values=(('external_ids', {'iface-id': '2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:b4:10', 'vm-uuid': '57225bb2-dbce-4212-b363-8dc34af05cce'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:11:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:11:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:11:17 user nova-compute[73056]: INFO os_vif [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:b4:10,bridge_name='br-int',has_traffic_filtering=True,id=2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a,network=Network(7e2ce9fb-4bdc-441f-ae4a-30224b2712e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4f4ff4-8e')
Aug 14 17:11:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:11:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:11:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:11:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:11:18 user nova-compute[73056]: DEBUG nova.compute.manager [req-86964152-b87d-49c2-87f1-1c3ffc378caa req-b4460e55-fd31-45d2-b8c7-540166994ebb service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received event network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:11:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-86964152-b87d-49c2-87f1-1c3ffc378caa req-b4460e55-fd31-45d2-b8c7-540166994ebb service nova] Acquiring lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:11:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-86964152-b87d-49c2-87f1-1c3ffc378caa req-b4460e55-fd31-45d2-b8c7-540166994ebb service nova] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:11:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-86964152-b87d-49c2-87f1-1c3ffc378caa req-b4460e55-fd31-45d2-b8c7-540166994ebb service nova] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:11:18 user nova-compute[73056]: DEBUG nova.compute.manager [req-86964152-b87d-49c2-87f1-1c3ffc378caa req-b4460e55-fd31-45d2-b8c7-540166994ebb service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] No waiting events found dispatching network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:11:18 user nova-compute[73056]: WARNING nova.compute.manager [req-86964152-b87d-49c2-87f1-1c3ffc378caa req-b4460e55-fd31-45d2-b8c7-540166994ebb service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received unexpected event network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a for instance with vm_state stopped and task_state powering-on.
Aug 14 17:11:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:11:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:11:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:11:19 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:11:19 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 17:11:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-57225bb2-dbce-4212-b363-8dc34af05cce" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:11:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-57225bb2-dbce-4212-b363-8dc34af05cce" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:11:19 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 17:11:19 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Updating instance_info_cache with network_info: [{"id": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "address": "fa:16:3e:8c:b4:10", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4f4ff4-8e", "ovs_interfaceid": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:11:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-57225bb2-dbce-4212-b363-8dc34af05cce" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:11:19 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 17:11:20 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692033080.8546014, 57225bb2-dbce-4212-b363-8dc34af05cce => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:11:20 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] VM Resumed (Lifecycle Event)
Aug 14 17:11:20 user nova-compute[73056]: DEBUG nova.compute.manager [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 17:11:20 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Instance rebooted successfully.
Aug 14 17:11:20 user nova-compute[73056]: DEBUG nova.compute.manager [None req-08f32ee0-09d3-458a-878c-0f60ff05c1ef tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:11:20 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:11:20 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 17:11:20 user nova-compute[73056]: DEBUG nova.compute.manager [req-bfde1ff2-6335-405c-b453-696283a3b4cd req-afbccfbf-943e-4074-af16-883d16be4627 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received event network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:11:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-bfde1ff2-6335-405c-b453-696283a3b4cd req-afbccfbf-943e-4074-af16-883d16be4627 service nova] Acquiring lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:11:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-bfde1ff2-6335-405c-b453-696283a3b4cd req-afbccfbf-943e-4074-af16-883d16be4627 service nova] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:11:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-bfde1ff2-6335-405c-b453-696283a3b4cd req-afbccfbf-943e-4074-af16-883d16be4627 service nova] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:11:20 user nova-compute[73056]: DEBUG nova.compute.manager [req-bfde1ff2-6335-405c-b453-696283a3b4cd req-afbccfbf-943e-4074-af16-883d16be4627 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] No waiting events found dispatching network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:11:20 user nova-compute[73056]: WARNING nova.compute.manager [req-bfde1ff2-6335-405c-b453-696283a3b4cd req-afbccfbf-943e-4074-af16-883d16be4627 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received unexpected event network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a for instance with vm_state stopped and task_state powering-on.
Aug 14 17:11:20 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 14 17:11:20 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692033080.8561435, 57225bb2-dbce-4212-b363-8dc34af05cce => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:11:20 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] VM Started (Lifecycle Event)
Aug 14 17:11:20 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:11:20 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 17:11:22 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:11:23 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:11:23 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:11:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:11:26 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:11:26 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:11:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:11:30 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:11:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:11:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:11:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:11:30 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 17:11:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 17:11:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:11:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:11:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:11:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:11:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 17:11:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:11:31 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:11:31 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:11:31 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:11:31 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:11:31 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:11:31 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:11:31 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:11:32 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:11:32 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:11:32 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=8421MB free_disk=24.93657684326172GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 17:11:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:11:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:11:32 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 5191b082-a6f3-467c-b28b-fda85e15f330 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:11:32 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance fb1a193b-73b7-4690-8571-be9af04b3b14 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:11:32 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 57225bb2-dbce-4212-b363-8dc34af05cce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:11:32 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 090405b6-77e0-4f28-bd8d-e7fccfa894b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:11:32 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:11:32 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 17:11:32 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 17:11:32 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:11:32 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:11:32 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 17:11:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.313s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:11:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:11:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:11:37 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:11:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:11:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:11:43 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:11:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:11:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:11:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:11:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:11:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:11:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:11:43 user nova-compute[73056]: DEBUG nova.virt.libvirt.imagecache [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Verify base images {{(pid=73056) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 14 17:11:43 user nova-compute[73056]: DEBUG nova.virt.libvirt.imagecache [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Image id 80fe003b-9902-44ab-86de-a284c1e79abd yields fingerprint c889592ab94cd0b0ce896f27a2af0323771db234 {{(pid=73056) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 14 17:11:43 user nova-compute[73056]: INFO nova.virt.libvirt.imagecache [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] image 80fe003b-9902-44ab-86de-a284c1e79abd at (/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234): checking
Aug 14 17:11:43 user nova-compute[73056]: DEBUG nova.virt.libvirt.imagecache [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] image 80fe003b-9902-44ab-86de-a284c1e79abd at (/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234): image is in use {{(pid=73056) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 14 17:11:43 user nova-compute[73056]: DEBUG nova.virt.libvirt.imagecache [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=73056) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 14 17:11:43 user nova-compute[73056]: DEBUG nova.virt.libvirt.imagecache [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] 090405b6-77e0-4f28-bd8d-e7fccfa894b8 is a valid instance name {{(pid=73056) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 14 17:11:43 user nova-compute[73056]: DEBUG nova.virt.libvirt.imagecache [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] 090405b6-77e0-4f28-bd8d-e7fccfa894b8 has a disk file {{(pid=73056) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 14 17:11:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:11:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:11:43 user nova-compute[73056]: DEBUG nova.virt.libvirt.imagecache [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 090405b6-77e0-4f28-bd8d-e7fccfa894b8 is backed by c889592ab94cd0b0ce896f27a2af0323771db234 {{(pid=73056) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 14 17:11:43 user nova-compute[73056]: DEBUG nova.virt.libvirt.imagecache [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] fb1a193b-73b7-4690-8571-be9af04b3b14 is a valid instance name {{(pid=73056) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 14 17:11:43 user nova-compute[73056]: DEBUG nova.virt.libvirt.imagecache [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4 is a valid instance name {{(pid=73056) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 14 17:11:43 user nova-compute[73056]: DEBUG nova.virt.libvirt.imagecache [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] 57225bb2-dbce-4212-b363-8dc34af05cce is a valid instance name {{(pid=73056) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 14 17:11:43 user nova-compute[73056]: DEBUG nova.virt.libvirt.imagecache [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] 57225bb2-dbce-4212-b363-8dc34af05cce has a disk file {{(pid=73056) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 14 17:11:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:11:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:11:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:11:43 user nova-compute[73056]: DEBUG nova.virt.libvirt.imagecache [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 57225bb2-dbce-4212-b363-8dc34af05cce is backed by c889592ab94cd0b0ce896f27a2af0323771db234 {{(pid=73056) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 14 17:11:43 user nova-compute[73056]: DEBUG nova.virt.libvirt.imagecache [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] 5191b082-a6f3-467c-b28b-fda85e15f330 is a valid instance name {{(pid=73056) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 14 17:11:43 user nova-compute[73056]: DEBUG nova.virt.libvirt.imagecache [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] 5191b082-a6f3-467c-b28b-fda85e15f330 has a disk file {{(pid=73056) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 14 17:11:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:11:43 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:11:43 user nova-compute[73056]: DEBUG nova.virt.libvirt.imagecache [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 5191b082-a6f3-467c-b28b-fda85e15f330 is backed by c889592ab94cd0b0ce896f27a2af0323771db234 {{(pid=73056) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 14 17:11:43 user nova-compute[73056]: WARNING nova.virt.libvirt.imagecache [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ee9f6aad2978befde47fc8134e8d7664822420c2
Aug 14 17:11:43 user nova-compute[73056]: WARNING nova.virt.libvirt.imagecache [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b0f2c3865387244922d1862e2292b5063d96c2f3
Aug 14 17:11:43 user nova-compute[73056]: WARNING nova.virt.libvirt.imagecache [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/0aa261a59f542845a73be8758304cdf32672f20a
Aug 14 17:11:43 user nova-compute[73056]: WARNING nova.virt.libvirt.imagecache [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/6ab1c310bc2ab3975874b79bc1015eb8539c4049
Aug 14 17:11:43 user nova-compute[73056]: WARNING nova.virt.libvirt.imagecache [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/44577b94195c4f51d4cbc3d97ab781320087609e
Aug 14 17:11:43 user nova-compute[73056]: WARNING nova.virt.libvirt.imagecache [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b93d781dfbec47a3093bbda995328a2a54025a4d
Aug 14 17:11:43 user nova-compute[73056]: WARNING nova.virt.libvirt.imagecache [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/42e35594cd1db4c7dfc03dd6291c1035e6fb08b0
Aug 14 17:11:43 user nova-compute[73056]: WARNING nova.virt.libvirt.imagecache [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/dd5774880873ec6b7e3cccda077c9d2494bee613
Aug 14 17:11:43 user nova-compute[73056]: WARNING nova.virt.libvirt.imagecache [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d8a4e28779756b2c305892f62fba2aebbda21833
Aug 14 17:11:43 user nova-compute[73056]: INFO nova.virt.libvirt.imagecache [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Active base files: /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234
Aug 14 17:11:43 user nova-compute[73056]: INFO nova.virt.libvirt.imagecache [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Removable base files: /opt/stack/data/nova/instances/_base/ee9f6aad2978befde47fc8134e8d7664822420c2 /opt/stack/data/nova/instances/_base/b0f2c3865387244922d1862e2292b5063d96c2f3 /opt/stack/data/nova/instances/_base/0aa261a59f542845a73be8758304cdf32672f20a /opt/stack/data/nova/instances/_base/6ab1c310bc2ab3975874b79bc1015eb8539c4049 /opt/stack/data/nova/instances/_base/44577b94195c4f51d4cbc3d97ab781320087609e /opt/stack/data/nova/instances/_base/b93d781dfbec47a3093bbda995328a2a54025a4d /opt/stack/data/nova/instances/_base/42e35594cd1db4c7dfc03dd6291c1035e6fb08b0 /opt/stack/data/nova/instances/_base/dd5774880873ec6b7e3cccda077c9d2494bee613 /opt/stack/data/nova/instances/_base/d8a4e28779756b2c305892f62fba2aebbda21833
Aug 14 17:11:43 user nova-compute[73056]: INFO nova.virt.libvirt.imagecache [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ee9f6aad2978befde47fc8134e8d7664822420c2
Aug 14 17:11:43 user nova-compute[73056]: INFO nova.virt.libvirt.imagecache [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b0f2c3865387244922d1862e2292b5063d96c2f3
Aug 14 17:11:43 user nova-compute[73056]: INFO nova.virt.libvirt.imagecache [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0aa261a59f542845a73be8758304cdf32672f20a
Aug 14 17:11:43 user nova-compute[73056]: INFO nova.virt.libvirt.imagecache [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6ab1c310bc2ab3975874b79bc1015eb8539c4049
Aug 14 17:11:43 user nova-compute[73056]: INFO nova.virt.libvirt.imagecache [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/44577b94195c4f51d4cbc3d97ab781320087609e
Aug 14 17:11:43 user nova-compute[73056]: INFO nova.virt.libvirt.imagecache [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b93d781dfbec47a3093bbda995328a2a54025a4d
Aug 14 17:11:43 user nova-compute[73056]: INFO nova.virt.libvirt.imagecache [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/42e35594cd1db4c7dfc03dd6291c1035e6fb08b0
Aug 14 17:11:43 user nova-compute[73056]: INFO nova.virt.libvirt.imagecache [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/dd5774880873ec6b7e3cccda077c9d2494bee613
Aug 14 17:11:43 user nova-compute[73056]: INFO nova.virt.libvirt.imagecache [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d8a4e28779756b2c305892f62fba2aebbda21833
Aug 14 17:11:43 user nova-compute[73056]: DEBUG nova.virt.libvirt.imagecache [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Verification complete {{(pid=73056) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 14 17:11:43 user nova-compute[73056]: DEBUG nova.virt.libvirt.imagecache [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Verify swap images {{(pid=73056) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 14 17:11:43 user nova-compute[73056]: DEBUG nova.virt.libvirt.imagecache [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Verify ephemeral images {{(pid=73056) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 14 17:11:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:11:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:11:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:11:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:12:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:12:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:12:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:12:13 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:12:13 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 17:12:15 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:12:15 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:12:17 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:12:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:12:21 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:12:21 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 17:12:21 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-090405b6-77e0-4f28-bd8d-e7fccfa894b8" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:12:21 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-090405b6-77e0-4f28-bd8d-e7fccfa894b8" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:12:21 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 17:12:21 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Updating instance_info_cache with network_info: [{"id": "4273f76f-d31b-48bc-92b5-3997783ef4d6", "address": "fa:16:3e:8b:46:5c", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4273f76f-d3", "ovs_interfaceid": "4273f76f-d31b-48bc-92b5-3997783ef4d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:12:21 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-090405b6-77e0-4f28-bd8d-e7fccfa894b8" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:12:21 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 17:12:22 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:12:24 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:12:24 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:12:26 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:12:27 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:12:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:12:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:12:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:12:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:12:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:12:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:12:29 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:12:29 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73056) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 17:12:30 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:12:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:12:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:12:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:12:30 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 17:12:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 17:12:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:12:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:12:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:12:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:12:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 17:12:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:12:31 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:12:31 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:12:31 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:12:31 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:12:31 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:12:31 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:12:31 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:12:31 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:12:31 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:12:31 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=8451MB free_disk=24.93576431274414GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 17:12:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:12:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:12:32 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 5191b082-a6f3-467c-b28b-fda85e15f330 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:12:32 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance fb1a193b-73b7-4690-8571-be9af04b3b14 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:12:32 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 57225bb2-dbce-4212-b363-8dc34af05cce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:12:32 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 090405b6-77e0-4f28-bd8d-e7fccfa894b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:12:32 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:12:32 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 17:12:32 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 17:12:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:12:32 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:12:32 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:12:32 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 17:12:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.401s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:12:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:12:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:12:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:12:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:12:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:12:32 user nova-compute[73056]: INFO nova.compute.manager [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Terminating instance
Aug 14 17:12:32 user nova-compute[73056]: DEBUG nova.compute.manager [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 17:12:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:12:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:12:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:12:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:12:32 user nova-compute[73056]: DEBUG nova.compute.manager [req-cbd024be-0f70-4508-b605-e17352583eef req-47bbe4a4-f479-4057-9210-2af516ce910b service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Received event network-vif-unplugged-852aa0fc-c330-4cdf-9b88-93e0f0260f39 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:12:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cbd024be-0f70-4508-b605-e17352583eef req-47bbe4a4-f479-4057-9210-2af516ce910b service nova] Acquiring lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:12:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cbd024be-0f70-4508-b605-e17352583eef req-47bbe4a4-f479-4057-9210-2af516ce910b service nova] Lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:12:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-cbd024be-0f70-4508-b605-e17352583eef req-47bbe4a4-f479-4057-9210-2af516ce910b service nova] Lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:12:32 user nova-compute[73056]: DEBUG nova.compute.manager [req-cbd024be-0f70-4508-b605-e17352583eef req-47bbe4a4-f479-4057-9210-2af516ce910b service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] No waiting events found dispatching network-vif-unplugged-852aa0fc-c330-4cdf-9b88-93e0f0260f39 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:12:32 user nova-compute[73056]: DEBUG nova.compute.manager [req-cbd024be-0f70-4508-b605-e17352583eef req-47bbe4a4-f479-4057-9210-2af516ce910b service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Received event network-vif-unplugged-852aa0fc-c330-4cdf-9b88-93e0f0260f39 for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:12:33 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Instance destroyed successfully.
Aug 14 17:12:33 user nova-compute[73056]: DEBUG nova.objects.instance [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lazy-loading 'resources' on Instance uuid 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T17:06:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-632303434',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-632303434',id=47,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T17:08:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a56fc678888b4653802e94ac6b47f95d',ramdisk_id='',reservation_id='r-sc3mfbyk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-572642883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T17:10:46Z,user_data=None,user_id='958f0c79efdc4352b35874e6c6f940d8',uuid=3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "852aa0fc-c330-4cdf-9b88-93e0f0260f39", "address": "fa:16:3e:9e:41:c0", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852aa0fc-c3", "ovs_interfaceid": "852aa0fc-c330-4cdf-9b88-93e0f0260f39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Converting VIF {"id": "852aa0fc-c330-4cdf-9b88-93e0f0260f39", "address": "fa:16:3e:9e:41:c0", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852aa0fc-c3", "ovs_interfaceid": "852aa0fc-c330-4cdf-9b88-93e0f0260f39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:41:c0,bridge_name='br-int',has_traffic_filtering=True,id=852aa0fc-c330-4cdf-9b88-93e0f0260f39,network=Network(ac2d700d-98d2-4459-8da8-a4858cda8864),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap852aa0fc-c3') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG os_vif [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:41:c0,bridge_name='br-int',has_traffic_filtering=True,id=852aa0fc-c330-4cdf-9b88-93e0f0260f39,network=Network(ac2d700d-98d2-4459-8da8-a4858cda8864),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap852aa0fc-c3') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap852aa0fc-c3, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:12:33 user nova-compute[73056]: INFO os_vif [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:41:c0,bridge_name='br-int',has_traffic_filtering=True,id=852aa0fc-c330-4cdf-9b88-93e0f0260f39,network=Network(ac2d700d-98d2-4459-8da8-a4858cda8864),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap852aa0fc-c3')
Aug 14 17:12:33 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kfAGgIQa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 17:12:33 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 17:12:33 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65a1004-b03f-412d-b675-f57a4480f954]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6c593e-7b59-4dff-9fdb-90b14d5e2269]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 17:12:33 user nova-compute[73056]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b (non-flash)
Aug 14 17:12:33 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 17:12:33 user nova-compute[73056]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b (non-flash)
Aug 14 17:12:33 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff300343b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b'): ({'sdc'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Removing single pathed devices sdc {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff17502-19f3-441b-b90d-ddac69117984]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[441b389c-f95a-4564-9e40-288ad1a050db]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Flushing IO for device /dev/sdc {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e49b46-ce02-45ab-a1a0-8eefae756e37]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac700871-a51f-4956-b0ae-a3a4c5d6de72]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] SCSI volumes sdc have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26331353862646239', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_70d7098', '/dev/disk/by-id/scsi-1SCST_BIO70d7098-c158bdb91ac3c594') {{(pid=83519) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c40df3-7241-437c-a7ff-b6dfa2ff719d]: (4, None) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf389b5-efac-46d7-809a-d695f686dd03]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9204cf-3755-43a0-94f3-c847eee486cc]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b, portal: 172.16.0.220,3260]
Aug 14 17:12:33 user nova-compute[73056]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b, portal: 172.16.0.220,3260] successful.
Aug 14 17:12:33 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20289a71-f1fe-42af-90f7-882c2863ed6b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35b069c-87f3-401b-88a3-9f76188da6d5]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] <== disconnect_volume: return (268ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 17:12:33 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Deleting instance files /opt/stack/data/nova/instances/3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4_del
Aug 14 17:12:33 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Deletion of /opt/stack/data/nova/instances/3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4_del complete
Aug 14 17:12:33 user nova-compute[73056]: INFO nova.compute.manager [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Took 1.10 seconds to destroy the instance on the hypervisor.
Aug 14 17:12:33 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 17:12:33 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 17:12:34 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:12:34 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Took 0.80 seconds to deallocate network for instance.
Aug 14 17:12:34 user nova-compute[73056]: DEBUG nova.compute.manager [req-8e859375-de13-4da3-99d4-fd872c43d698 req-32a7445c-4db5-4ef3-bd93-f44f9328b195 service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Received event network-vif-deleted-852aa0fc-c330-4cdf-9b88-93e0f0260f39 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:12:34 user nova-compute[73056]: DEBUG nova.compute.manager [req-01e2a804-34a0-4f0c-a481-b78777bbc883 req-06306f47-74bb-44bc-a5df-d1532209a430 service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Received event network-vif-plugged-852aa0fc-c330-4cdf-9b88-93e0f0260f39 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:12:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-01e2a804-34a0-4f0c-a481-b78777bbc883 req-06306f47-74bb-44bc-a5df-d1532209a430 service nova] Acquiring lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:12:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-01e2a804-34a0-4f0c-a481-b78777bbc883 req-06306f47-74bb-44bc-a5df-d1532209a430 service nova] Lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:12:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-01e2a804-34a0-4f0c-a481-b78777bbc883 req-06306f47-74bb-44bc-a5df-d1532209a430 service nova] Lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:12:34 user nova-compute[73056]: DEBUG nova.compute.manager [req-01e2a804-34a0-4f0c-a481-b78777bbc883 req-06306f47-74bb-44bc-a5df-d1532209a430 service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] No waiting events found dispatching network-vif-plugged-852aa0fc-c330-4cdf-9b88-93e0f0260f39 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:12:34 user nova-compute[73056]: WARNING nova.compute.manager [req-01e2a804-34a0-4f0c-a481-b78777bbc883 req-06306f47-74bb-44bc-a5df-d1532209a430 service nova] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Received unexpected event network-vif-plugged-852aa0fc-c330-4cdf-9b88-93e0f0260f39 for instance with vm_state active and task_state deleting.
Aug 14 17:12:35 user nova-compute[73056]: INFO nova.compute.manager [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Took 0.73 seconds to detach 1 volumes for instance.
Aug 14 17:12:35 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:12:35 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:12:35 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:12:35 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:12:35 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.231s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:12:35 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Deleted allocations for instance 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4
Aug 14 17:12:35 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7c4a46e5-a90f-4014-8df6-37949675ac8a tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.044s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:12:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:12:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:12:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:12:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:12:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:12:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:12:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:12:48 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692033153.2391353, 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:12:48 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] VM Stopped (Lifecycle Event)
Aug 14 17:12:48 user nova-compute[73056]: DEBUG nova.compute.manager [None req-0c88c0eb-7517-41f0-b69a-c19a7af6737e None None] [instance: 3cd97fc9-6747-4ded-9f95-2a4d3a03ffb4] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:12:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:12:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:12:55 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:12:55 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Cleaning up deleted instances {{(pid=73056) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 17:12:55 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] There are 0 instances to clean {{(pid=73056) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 17:12:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:13:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:13:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5bbba343-b176-4556-ac21-2d223184f326 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "57225bb2-dbce-4212-b363-8dc34af05cce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:13:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5bbba343-b176-4556-ac21-2d223184f326 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "57225bb2-dbce-4212-b363-8dc34af05cce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:13:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5bbba343-b176-4556-ac21-2d223184f326 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:13:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5bbba343-b176-4556-ac21-2d223184f326 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:13:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5bbba343-b176-4556-ac21-2d223184f326 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:13:06 user nova-compute[73056]: INFO nova.compute.manager [None req-5bbba343-b176-4556-ac21-2d223184f326 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Terminating instance
Aug 14 17:13:06 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5bbba343-b176-4556-ac21-2d223184f326 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 17:13:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:13:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:13:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:13:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:13:07 user nova-compute[73056]: DEBUG nova.compute.manager [req-6a854b76-1925-44bd-8291-08a02de5f1fb req-b286aa8f-1d0c-4a8e-98d9-da553fb93f48 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received event network-vif-unplugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:13:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6a854b76-1925-44bd-8291-08a02de5f1fb req-b286aa8f-1d0c-4a8e-98d9-da553fb93f48 service nova] Acquiring lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:13:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6a854b76-1925-44bd-8291-08a02de5f1fb req-b286aa8f-1d0c-4a8e-98d9-da553fb93f48 service nova] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:13:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-6a854b76-1925-44bd-8291-08a02de5f1fb req-b286aa8f-1d0c-4a8e-98d9-da553fb93f48 service nova] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:13:07 user nova-compute[73056]: DEBUG nova.compute.manager [req-6a854b76-1925-44bd-8291-08a02de5f1fb req-b286aa8f-1d0c-4a8e-98d9-da553fb93f48 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] No waiting events found dispatching network-vif-unplugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:13:07 user nova-compute[73056]: DEBUG nova.compute.manager [req-6a854b76-1925-44bd-8291-08a02de5f1fb req-b286aa8f-1d0c-4a8e-98d9-da553fb93f48 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received event network-vif-unplugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 17:13:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:13:07 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Instance destroyed successfully.
Aug 14 17:13:07 user nova-compute[73056]: DEBUG nova.objects.instance [None req-5bbba343-b176-4556-ac21-2d223184f326 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lazy-loading 'resources' on Instance uuid 57225bb2-dbce-4212-b363-8dc34af05cce {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:13:07 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-5bbba343-b176-4556-ac21-2d223184f326 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T17:03:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1082884404',display_name='tempest-AttachVolumeTestJSON-server-1082884404',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1082884404',id=44,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPNPWJ92774fwNZF6PVgQpXcTKVtR5LMZz3xu6DLKvMpyOVFGtxgTJRS/WltAZEiJfd7Brr2rP/3+0iYPbiNk8IOQAitKjVnZlCsrC86QNIF45RYJq5300KRzpYOnBhVg==',key_name='tempest-keypair-1762591610',keypairs=<?>,launch_index=0,launched_at=2023-08-14T17:03:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='415a7291b35546b5ac324280d37d50ae',ramdisk_id='',reservation_id='r-vobfg0xl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-112776827',owner_user_name='tempest-AttachVolumeTestJSON-112776827-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T17:11:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bf4bfed609343c78b0d828db45d5ab7',uuid=57225bb2-dbce-4212-b363-8dc34af05cce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "address": "fa:16:3e:8c:b4:10", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4f4ff4-8e", "ovs_interfaceid": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 17:13:07 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-5bbba343-b176-4556-ac21-2d223184f326 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Converting VIF {"id": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "address": "fa:16:3e:8c:b4:10", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e4f4ff4-8e", "ovs_interfaceid": "2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:13:07 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-5bbba343-b176-4556-ac21-2d223184f326 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:b4:10,bridge_name='br-int',has_traffic_filtering=True,id=2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a,network=Network(7e2ce9fb-4bdc-441f-ae4a-30224b2712e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4f4ff4-8e') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:13:07 user nova-compute[73056]: DEBUG os_vif [None req-5bbba343-b176-4556-ac21-2d223184f326 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:b4:10,bridge_name='br-int',has_traffic_filtering=True,id=2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a,network=Network(7e2ce9fb-4bdc-441f-ae4a-30224b2712e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4f4ff4-8e') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 17:13:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:13:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e4f4ff4-8e, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:13:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:13:07 user nova-compute[73056]: INFO os_vif [None req-5bbba343-b176-4556-ac21-2d223184f326 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:b4:10,bridge_name='br-int',has_traffic_filtering=True,id=2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a,network=Network(7e2ce9fb-4bdc-441f-ae4a-30224b2712e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e4f4ff4-8e')
Aug 14 17:13:07 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-5bbba343-b176-4556-ac21-2d223184f326 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Deleting instance files /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce_del
Aug 14 17:13:07 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-5bbba343-b176-4556-ac21-2d223184f326 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Deletion of /opt/stack/data/nova/instances/57225bb2-dbce-4212-b363-8dc34af05cce_del complete
Aug 14 17:13:07 user nova-compute[73056]: INFO nova.compute.manager [None req-5bbba343-b176-4556-ac21-2d223184f326 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 14 17:13:07 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-5bbba343-b176-4556-ac21-2d223184f326 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 17:13:07 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 17:13:07 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 17:13:08 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:13:08 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Took 0.80 seconds to deallocate network for instance.
Aug 14 17:13:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5bbba343-b176-4556-ac21-2d223184f326 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:13:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5bbba343-b176-4556-ac21-2d223184f326 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:13:08 user nova-compute[73056]: DEBUG nova.compute.manager [req-30d9e61d-92d3-4641-8f2c-42d63b5ad58a req-0119d7c6-8c54-46b8-92fd-5c17aa385c12 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received event network-vif-deleted-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:13:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:13:08 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-5bbba343-b176-4556-ac21-2d223184f326 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:13:08 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-5bbba343-b176-4556-ac21-2d223184f326 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:13:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5bbba343-b176-4556-ac21-2d223184f326 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.178s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:13:08 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-5bbba343-b176-4556-ac21-2d223184f326 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Deleted allocations for instance 57225bb2-dbce-4212-b363-8dc34af05cce
Aug 14 17:13:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-5bbba343-b176-4556-ac21-2d223184f326 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "57225bb2-dbce-4212-b363-8dc34af05cce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.994s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:13:09 user nova-compute[73056]: DEBUG nova.compute.manager [req-f288a152-4eda-4238-9dc4-9f0879908e35 req-06c16823-fa60-44da-94e2-ea3de5dcfbe7 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received event network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:13:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f288a152-4eda-4238-9dc4-9f0879908e35 req-06c16823-fa60-44da-94e2-ea3de5dcfbe7 service nova] Acquiring lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:13:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f288a152-4eda-4238-9dc4-9f0879908e35 req-06c16823-fa60-44da-94e2-ea3de5dcfbe7 service nova] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:13:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-f288a152-4eda-4238-9dc4-9f0879908e35 req-06c16823-fa60-44da-94e2-ea3de5dcfbe7 service nova] Lock "57225bb2-dbce-4212-b363-8dc34af05cce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:13:09 user nova-compute[73056]: DEBUG nova.compute.manager [req-f288a152-4eda-4238-9dc4-9f0879908e35 req-06c16823-fa60-44da-94e2-ea3de5dcfbe7 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] No waiting events found dispatching network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:13:09 user nova-compute[73056]: WARNING nova.compute.manager [req-f288a152-4eda-4238-9dc4-9f0879908e35 req-06c16823-fa60-44da-94e2-ea3de5dcfbe7 service nova] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Received unexpected event network-vif-plugged-2e4f4ff4-8e03-4ffb-b324-26cd8a563f2a for instance with vm_state deleted and task_state None.
Aug 14 17:13:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:13:15 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:13:15 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 17:13:16 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:13:16 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:13:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:13:18 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:13:18 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Triggering sync for uuid 5191b082-a6f3-467c-b28b-fda85e15f330 {{(pid=73056) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 17:13:18 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Triggering sync for uuid fb1a193b-73b7-4690-8571-be9af04b3b14 {{(pid=73056) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 17:13:18 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Triggering sync for uuid 090405b6-77e0-4f28-bd8d-e7fccfa894b8 {{(pid=73056) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 17:13:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "5191b082-a6f3-467c-b28b-fda85e15f330" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:13:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "5191b082-a6f3-467c-b28b-fda85e15f330" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:13:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "fb1a193b-73b7-4690-8571-be9af04b3b14" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:13:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "fb1a193b-73b7-4690-8571-be9af04b3b14" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:13:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "090405b6-77e0-4f28-bd8d-e7fccfa894b8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:13:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "090405b6-77e0-4f28-bd8d-e7fccfa894b8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:13:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "5191b082-a6f3-467c-b28b-fda85e15f330" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:13:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "fb1a193b-73b7-4690-8571-be9af04b3b14" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:13:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "090405b6-77e0-4f28-bd8d-e7fccfa894b8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:13:22 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692033187.67677, 57225bb2-dbce-4212-b363-8dc34af05cce => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:13:22 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] VM Stopped (Lifecycle Event)
Aug 14 17:13:22 user nova-compute[73056]: DEBUG nova.compute.manager [None req-42362080-b159-45a1-984d-63564d3f4b27 None None] [instance: 57225bb2-dbce-4212-b363-8dc34af05cce] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:13:22 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:13:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3db6f191-c57b-43a7-bc46-93ea7de23e86 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "090405b6-77e0-4f28-bd8d-e7fccfa894b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:13:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3db6f191-c57b-43a7-bc46-93ea7de23e86 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "090405b6-77e0-4f28-bd8d-e7fccfa894b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:13:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3db6f191-c57b-43a7-bc46-93ea7de23e86 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "090405b6-77e0-4f28-bd8d-e7fccfa894b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:13:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3db6f191-c57b-43a7-bc46-93ea7de23e86 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "090405b6-77e0-4f28-bd8d-e7fccfa894b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:13:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3db6f191-c57b-43a7-bc46-93ea7de23e86 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "090405b6-77e0-4f28-bd8d-e7fccfa894b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:13:23 user nova-compute[73056]: INFO nova.compute.manager [None req-3db6f191-c57b-43a7-bc46-93ea7de23e86 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Terminating instance
Aug 14 17:13:23 user nova-compute[73056]: DEBUG nova.compute.manager [None req-3db6f191-c57b-43a7-bc46-93ea7de23e86 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 17:13:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:13:23 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:13:23 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 17:13:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:13:23 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Didn't find any instances for network info cache update. {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 17:13:23 user nova-compute[73056]: DEBUG nova.compute.manager [req-2a523e05-fb10-4d53-b1aa-2a2bed8e8ffe req-f57c396e-d5f3-459f-91f1-10336a11b80d service nova] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Received event network-vif-unplugged-4273f76f-d31b-48bc-92b5-3997783ef4d6 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:13:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2a523e05-fb10-4d53-b1aa-2a2bed8e8ffe req-f57c396e-d5f3-459f-91f1-10336a11b80d service nova] Acquiring lock "090405b6-77e0-4f28-bd8d-e7fccfa894b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:13:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2a523e05-fb10-4d53-b1aa-2a2bed8e8ffe req-f57c396e-d5f3-459f-91f1-10336a11b80d service nova] Lock "090405b6-77e0-4f28-bd8d-e7fccfa894b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:13:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-2a523e05-fb10-4d53-b1aa-2a2bed8e8ffe req-f57c396e-d5f3-459f-91f1-10336a11b80d service nova] Lock "090405b6-77e0-4f28-bd8d-e7fccfa894b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:13:23 user nova-compute[73056]: DEBUG nova.compute.manager [req-2a523e05-fb10-4d53-b1aa-2a2bed8e8ffe req-f57c396e-d5f3-459f-91f1-10336a11b80d service nova] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] No waiting events found dispatching network-vif-unplugged-4273f76f-d31b-48bc-92b5-3997783ef4d6 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:13:23 user nova-compute[73056]: DEBUG nova.compute.manager [req-2a523e05-fb10-4d53-b1aa-2a2bed8e8ffe req-f57c396e-d5f3-459f-91f1-10336a11b80d service nova] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Received event network-vif-unplugged-4273f76f-d31b-48bc-92b5-3997783ef4d6 for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 17:13:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:13:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:13:24 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Instance destroyed successfully.
Aug 14 17:13:24 user nova-compute[73056]: DEBUG nova.objects.instance [None req-3db6f191-c57b-43a7-bc46-93ea7de23e86 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lazy-loading 'resources' on Instance uuid 090405b6-77e0-4f28-bd8d-e7fccfa894b8 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:13:24 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-3db6f191-c57b-43a7-bc46-93ea7de23e86 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T17:04:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1395318398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1395318398',id=46,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T17:04:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a56fc678888b4653802e94ac6b47f95d',ramdisk_id='',reservation_id='r-k8ieucl6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-572642883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T17:05:57Z,user_data=None,user_id='958f0c79efdc4352b35874e6c6f940d8',uuid=090405b6-77e0-4f28-bd8d-e7fccfa894b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4273f76f-d31b-48bc-92b5-3997783ef4d6", "address": "fa:16:3e:8b:46:5c", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4273f76f-d3", "ovs_interfaceid": "4273f76f-d31b-48bc-92b5-3997783ef4d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 17:13:24 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-3db6f191-c57b-43a7-bc46-93ea7de23e86 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Converting VIF {"id": "4273f76f-d31b-48bc-92b5-3997783ef4d6", "address": "fa:16:3e:8b:46:5c", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4273f76f-d3", "ovs_interfaceid": "4273f76f-d31b-48bc-92b5-3997783ef4d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:13:24 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-3db6f191-c57b-43a7-bc46-93ea7de23e86 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:46:5c,bridge_name='br-int',has_traffic_filtering=True,id=4273f76f-d31b-48bc-92b5-3997783ef4d6,network=Network(ac2d700d-98d2-4459-8da8-a4858cda8864),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4273f76f-d3') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:13:24 user nova-compute[73056]: DEBUG os_vif [None req-3db6f191-c57b-43a7-bc46-93ea7de23e86 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:46:5c,bridge_name='br-int',has_traffic_filtering=True,id=4273f76f-d31b-48bc-92b5-3997783ef4d6,network=Network(ac2d700d-98d2-4459-8da8-a4858cda8864),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4273f76f-d3') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 17:13:24 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:13:24 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4273f76f-d3, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:13:24 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:13:24 user nova-compute[73056]: INFO os_vif [None req-3db6f191-c57b-43a7-bc46-93ea7de23e86 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:46:5c,bridge_name='br-int',has_traffic_filtering=True,id=4273f76f-d31b-48bc-92b5-3997783ef4d6,network=Network(ac2d700d-98d2-4459-8da8-a4858cda8864),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4273f76f-d3')
Aug 14 17:13:24 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-3db6f191-c57b-43a7-bc46-93ea7de23e86 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Deleting instance files /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8_del
Aug 14 17:13:24 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-3db6f191-c57b-43a7-bc46-93ea7de23e86 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Deletion of /opt/stack/data/nova/instances/090405b6-77e0-4f28-bd8d-e7fccfa894b8_del complete
Aug 14 17:13:24 user nova-compute[73056]: INFO nova.compute.manager [None req-3db6f191-c57b-43a7-bc46-93ea7de23e86 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 14 17:13:24 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-3db6f191-c57b-43a7-bc46-93ea7de23e86 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 17:13:24 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 17:13:24 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 17:13:24 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:13:24 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Took 0.64 seconds to deallocate network for instance.
Aug 14 17:13:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3db6f191-c57b-43a7-bc46-93ea7de23e86 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:13:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3db6f191-c57b-43a7-bc46-93ea7de23e86 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:13:24 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-3db6f191-c57b-43a7-bc46-93ea7de23e86 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:13:24 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-3db6f191-c57b-43a7-bc46-93ea7de23e86 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:13:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3db6f191-c57b-43a7-bc46-93ea7de23e86 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.155s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:13:25 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-3db6f191-c57b-43a7-bc46-93ea7de23e86 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Deleted allocations for instance 090405b6-77e0-4f28-bd8d-e7fccfa894b8
Aug 14 17:13:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3db6f191-c57b-43a7-bc46-93ea7de23e86 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "090405b6-77e0-4f28-bd8d-e7fccfa894b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.833s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:13:25 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:13:25 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:13:25 user nova-compute[73056]: DEBUG nova.compute.manager [req-ade5f2e0-3385-49cd-9328-b4854ec8d5d4 req-ebab4dae-658e-4282-9fd8-4e589af3398d service nova] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Received event network-vif-plugged-4273f76f-d31b-48bc-92b5-3997783ef4d6 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:13:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ade5f2e0-3385-49cd-9328-b4854ec8d5d4 req-ebab4dae-658e-4282-9fd8-4e589af3398d service nova] Acquiring lock "090405b6-77e0-4f28-bd8d-e7fccfa894b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:13:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ade5f2e0-3385-49cd-9328-b4854ec8d5d4 req-ebab4dae-658e-4282-9fd8-4e589af3398d service nova] Lock "090405b6-77e0-4f28-bd8d-e7fccfa894b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:13:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-ade5f2e0-3385-49cd-9328-b4854ec8d5d4 req-ebab4dae-658e-4282-9fd8-4e589af3398d service nova] Lock "090405b6-77e0-4f28-bd8d-e7fccfa894b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:13:25 user nova-compute[73056]: DEBUG nova.compute.manager [req-ade5f2e0-3385-49cd-9328-b4854ec8d5d4 req-ebab4dae-658e-4282-9fd8-4e589af3398d service nova] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] No waiting events found dispatching network-vif-plugged-4273f76f-d31b-48bc-92b5-3997783ef4d6 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:13:25 user nova-compute[73056]: WARNING nova.compute.manager [req-ade5f2e0-3385-49cd-9328-b4854ec8d5d4 req-ebab4dae-658e-4282-9fd8-4e589af3398d service nova] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Received unexpected event network-vif-plugged-4273f76f-d31b-48bc-92b5-3997783ef4d6 for instance with vm_state deleted and task_state None.
Aug 14 17:13:25 user nova-compute[73056]: DEBUG nova.compute.manager [req-ade5f2e0-3385-49cd-9328-b4854ec8d5d4 req-ebab4dae-658e-4282-9fd8-4e589af3398d service nova] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Received event network-vif-deleted-4273f76f-d31b-48bc-92b5-3997783ef4d6 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:13:28 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:13:28 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:13:29 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:13:30 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:13:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:13:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:13:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:13:30 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 17:13:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 17:13:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:13:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:13:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:13:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:13:31 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:13:31 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:13:31 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=8689MB free_disk=25.08819580078125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 17:13:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:13:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:13:31 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 5191b082-a6f3-467c-b28b-fda85e15f330 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:13:31 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance fb1a193b-73b7-4690-8571-be9af04b3b14 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:13:31 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 17:13:31 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 17:13:31 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Refreshing inventories for resource provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 17:13:31 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Updating ProviderTree inventory for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 17:13:31 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Updating inventory in ProviderTree for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 17:13:31 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Refreshing aggregate associations for resource provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b, aggregates: None {{(pid=73056) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 17:13:31 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Refreshing trait associations for resource provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=73056) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 17:13:31 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:13:31 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:13:31 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 17:13:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.330s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:13:34 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:13:39 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692033204.0463362, 090405b6-77e0-4f28-bd8d-e7fccfa894b8 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:13:39 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] VM Stopped (Lifecycle Event)
Aug 14 17:13:39 user nova-compute[73056]: DEBUG nova.compute.manager [None req-3ea8f558-a21c-4e51-974d-09b94a47859d None None] [instance: 090405b6-77e0-4f28-bd8d-e7fccfa894b8] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:13:39 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:13:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:13:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:13:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:13:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:13:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:13:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:13:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:13:54 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:13:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:13:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:14:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "b8a52b1b-bcd0-493c-9887-af867acf019f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:14:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "b8a52b1b-bcd0-493c-9887-af867acf019f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:14:00 user nova-compute[73056]: DEBUG nova.compute.manager [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 17:14:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:14:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:14:00 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 17:14:00 user nova-compute[73056]: INFO nova.compute.claims [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Claim successful on node user
Aug 14 17:14:00 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:14:01 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:14:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.261s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:14:01 user nova-compute[73056]: DEBUG nova.compute.manager [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 17:14:01 user nova-compute[73056]: DEBUG nova.compute.manager [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 17:14:01 user nova-compute[73056]: DEBUG nova.network.neutron [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 17:14:01 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 17:14:01 user nova-compute[73056]: DEBUG nova.compute.manager [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 17:14:01 user nova-compute[73056]: DEBUG nova.policy [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0bf4bfed609343c78b0d828db45d5ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415a7291b35546b5ac324280d37d50ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 17:14:01 user nova-compute[73056]: DEBUG nova.compute.manager [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 17:14:01 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 17:14:01 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Creating image(s)
Aug 14 17:14:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "/opt/stack/data/nova/instances/b8a52b1b-bcd0-493c-9887-af867acf019f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:14:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "/opt/stack/data/nova/instances/b8a52b1b-bcd0-493c-9887-af867acf019f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:14:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "/opt/stack/data/nova/instances/b8a52b1b-bcd0-493c-9887-af867acf019f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:14:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:14:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.172s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:14:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "c889592ab94cd0b0ce896f27a2af0323771db234" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:14:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:14:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:14:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.178s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:14:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/b8a52b1b-bcd0-493c-9887-af867acf019f/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:14:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/b8a52b1b-bcd0-493c-9887-af867acf019f/disk 1073741824" returned: 0 in 0.052s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:14:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:14:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:14:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.178s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:14:01 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b8a52b1b-bcd0-493c-9887-af867acf019f/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 17:14:01 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a52b1b-bcd0-493c-9887-af867acf019f/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:14:02 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a52b1b-bcd0-493c-9887-af867acf019f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:14:02 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Cannot resize image /opt/stack/data/nova/instances/b8a52b1b-bcd0-493c-9887-af867acf019f/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 17:14:02 user nova-compute[73056]: DEBUG nova.objects.instance [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lazy-loading 'migration_context' on Instance uuid b8a52b1b-bcd0-493c-9887-af867acf019f {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:14:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 17:14:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Ensure instance console log exists: /opt/stack/data/nova/instances/b8a52b1b-bcd0-493c-9887-af867acf019f/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 17:14:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:14:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:14:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:14:02 user nova-compute[73056]: DEBUG nova.network.neutron [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Successfully created port: 0e8b1816-285f-49ca-8fd5-3f672c8d42f9 {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG nova.network.neutron [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Successfully updated port: 0e8b1816-285f-49ca-8fd5-3f672c8d42f9 {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "refresh_cache-b8a52b1b-bcd0-493c-9887-af867acf019f" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquired lock "refresh_cache-b8a52b1b-bcd0-493c-9887-af867acf019f" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG nova.network.neutron [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG nova.compute.manager [req-be8a0bbe-70be-4932-a8a2-1b4d8e99d2b0 req-1b988632-d8c0-4719-bd8e-fa9e5529c7ef service nova] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Received event network-changed-0e8b1816-285f-49ca-8fd5-3f672c8d42f9 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG nova.compute.manager [req-be8a0bbe-70be-4932-a8a2-1b4d8e99d2b0 req-1b988632-d8c0-4719-bd8e-fa9e5529c7ef service nova] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Refreshing instance network info cache due to event network-changed-0e8b1816-285f-49ca-8fd5-3f672c8d42f9. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-be8a0bbe-70be-4932-a8a2-1b4d8e99d2b0 req-1b988632-d8c0-4719-bd8e-fa9e5529c7ef service nova] Acquiring lock "refresh_cache-b8a52b1b-bcd0-493c-9887-af867acf019f" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG nova.network.neutron [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG nova.network.neutron [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Updating instance_info_cache with network_info: [{"id": "0e8b1816-285f-49ca-8fd5-3f672c8d42f9", "address": "fa:16:3e:99:5e:b7", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8b1816-28", "ovs_interfaceid": "0e8b1816-285f-49ca-8fd5-3f672c8d42f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Releasing lock "refresh_cache-b8a52b1b-bcd0-493c-9887-af867acf019f" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG nova.compute.manager [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Instance network_info: |[{"id": "0e8b1816-285f-49ca-8fd5-3f672c8d42f9", "address": "fa:16:3e:99:5e:b7", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8b1816-28", "ovs_interfaceid": "0e8b1816-285f-49ca-8fd5-3f672c8d42f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-be8a0bbe-70be-4932-a8a2-1b4d8e99d2b0 req-1b988632-d8c0-4719-bd8e-fa9e5529c7ef service nova] Acquired lock "refresh_cache-b8a52b1b-bcd0-493c-9887-af867acf019f" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG nova.network.neutron [req-be8a0bbe-70be-4932-a8a2-1b4d8e99d2b0 req-1b988632-d8c0-4719-bd8e-fa9e5529c7ef service nova] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Refreshing network info cache for port 0e8b1816-285f-49ca-8fd5-3f672c8d42f9 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Start _get_guest_xml network_info=[{"id": "0e8b1816-285f-49ca-8fd5-3f672c8d42f9", "address": "fa:16:3e:99:5e:b7", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8b1816-28", "ovs_interfaceid": "0e8b1816-285f-49ca-8fd5-3f672c8d42f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 17:14:03 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:14:03 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:14:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T17:14:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1787890632',display_name='tempest-AttachVolumeTestJSON-server-1787890632',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1787890632',id=48,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiqFQ9jmpfA1gcwScSEzYgMTzDIuvVWJ47gAgo/o3S8pUNqjBCZYJuZRMhehC2bLpzs6Ie2XYwTYMCRU31Vxai8S325VR+ZEnlIH+7eRI2hxjFhGDMJZht/qFjVmrw/vg==',key_name='tempest-keypair-932455183',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='415a7291b35546b5ac324280d37d50ae',ramdisk_id='',reservation_id='r-45450rib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-112776827',owner_user_name='tempest-AttachVolumeTestJSON-112776827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T17:14:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bf4bfed609343c78b0d828db45d5ab7',uuid=b8a52b1b-bcd0-493c-9887-af867acf019f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e8b1816-285f-49ca-8fd5-3f672c8d42f9", "address": "fa:16:3e:99:5e:b7", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8b1816-28", "ovs_interfaceid": "0e8b1816-285f-49ca-8fd5-3f672c8d42f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Converting VIF {"id": "0e8b1816-285f-49ca-8fd5-3f672c8d42f9", "address": "fa:16:3e:99:5e:b7", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8b1816-28", "ovs_interfaceid": "0e8b1816-285f-49ca-8fd5-3f672c8d42f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:5e:b7,bridge_name='br-int',has_traffic_filtering=True,id=0e8b1816-285f-49ca-8fd5-3f672c8d42f9,network=Network(7e2ce9fb-4bdc-441f-ae4a-30224b2712e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e8b1816-28') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG nova.objects.instance [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lazy-loading 'pci_devices' on Instance uuid b8a52b1b-bcd0-493c-9887-af867acf019f {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] End _get_guest_xml xml=<domain type="kvm">
Aug 14 17:14:03 user nova-compute[73056]:   <uuid>b8a52b1b-bcd0-493c-9887-af867acf019f</uuid>
Aug 14 17:14:03 user nova-compute[73056]:   <name>instance-00000030</name>
Aug 14 17:14:03 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 17:14:03 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 17:14:03 user nova-compute[73056]:   <metadata>
Aug 14 17:14:03 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 17:14:03 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 17:14:03 user nova-compute[73056]:       <nova:name>tempest-AttachVolumeTestJSON-server-1787890632</nova:name>
Aug 14 17:14:03 user nova-compute[73056]:       <nova:creationTime>2023-08-14 17:14:03</nova:creationTime>
Aug 14 17:14:03 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 17:14:03 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 17:14:03 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 17:14:03 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 17:14:03 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 17:14:03 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 17:14:03 user nova-compute[73056]:       </nova:flavor>
Aug 14 17:14:03 user nova-compute[73056]:       <nova:owner>
Aug 14 17:14:03 user nova-compute[73056]:         <nova:user uuid="0bf4bfed609343c78b0d828db45d5ab7">tempest-AttachVolumeTestJSON-112776827-project-member</nova:user>
Aug 14 17:14:03 user nova-compute[73056]:         <nova:project uuid="415a7291b35546b5ac324280d37d50ae">tempest-AttachVolumeTestJSON-112776827</nova:project>
Aug 14 17:14:03 user nova-compute[73056]:       </nova:owner>
Aug 14 17:14:03 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 17:14:03 user nova-compute[73056]:       <nova:ports>
Aug 14 17:14:03 user nova-compute[73056]:         <nova:port uuid="0e8b1816-285f-49ca-8fd5-3f672c8d42f9">
Aug 14 17:14:03 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 17:14:03 user nova-compute[73056]:         </nova:port>
Aug 14 17:14:03 user nova-compute[73056]:       </nova:ports>
Aug 14 17:14:03 user nova-compute[73056]:     </nova:instance>
Aug 14 17:14:03 user nova-compute[73056]:   </metadata>
Aug 14 17:14:03 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 17:14:03 user nova-compute[73056]:     <system>
Aug 14 17:14:03 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 17:14:03 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 17:14:03 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 17:14:03 user nova-compute[73056]:       <entry name="serial">b8a52b1b-bcd0-493c-9887-af867acf019f</entry>
Aug 14 17:14:03 user nova-compute[73056]:       <entry name="uuid">b8a52b1b-bcd0-493c-9887-af867acf019f</entry>
Aug 14 17:14:03 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 17:14:03 user nova-compute[73056]:     </system>
Aug 14 17:14:03 user nova-compute[73056]:   </sysinfo>
Aug 14 17:14:03 user nova-compute[73056]:   <os>
Aug 14 17:14:03 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 17:14:03 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 17:14:03 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 17:14:03 user nova-compute[73056]:   </os>
Aug 14 17:14:03 user nova-compute[73056]:   <features>
Aug 14 17:14:03 user nova-compute[73056]:     <acpi/>
Aug 14 17:14:03 user nova-compute[73056]:     <apic/>
Aug 14 17:14:03 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 17:14:03 user nova-compute[73056]:   </features>
Aug 14 17:14:03 user nova-compute[73056]:   <clock offset="utc">
Aug 14 17:14:03 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 17:14:03 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 17:14:03 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 17:14:03 user nova-compute[73056]:   </clock>
Aug 14 17:14:03 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 17:14:03 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 17:14:03 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 17:14:03 user nova-compute[73056]:   </cpu>
Aug 14 17:14:03 user nova-compute[73056]:   <devices>
Aug 14 17:14:03 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 17:14:03 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 17:14:03 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/b8a52b1b-bcd0-493c-9887-af867acf019f/disk"/>
Aug 14 17:14:03 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 17:14:03 user nova-compute[73056]:     </disk>
Aug 14 17:14:03 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 17:14:03 user nova-compute[73056]:       <mac address="fa:16:3e:99:5e:b7"/>
Aug 14 17:14:03 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 17:14:03 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 17:14:03 user nova-compute[73056]:       <target dev="tap0e8b1816-28"/>
Aug 14 17:14:03 user nova-compute[73056]:     </interface>
Aug 14 17:14:03 user nova-compute[73056]:     <serial type="pty">
Aug 14 17:14:03 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/b8a52b1b-bcd0-493c-9887-af867acf019f/console.log" append="off"/>
Aug 14 17:14:03 user nova-compute[73056]:     </serial>
Aug 14 17:14:03 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 17:14:03 user nova-compute[73056]:     <video>
Aug 14 17:14:03 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 17:14:03 user nova-compute[73056]:     </video>
Aug 14 17:14:03 user nova-compute[73056]:     <rng model="virtio">
Aug 14 17:14:03 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 17:14:03 user nova-compute[73056]:     </rng>
Aug 14 17:14:03 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 17:14:03 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 17:14:03 user nova-compute[73056]:       <stats period="10"/>
Aug 14 17:14:03 user nova-compute[73056]:     </memballoon>
Aug 14 17:14:03 user nova-compute[73056]:   </devices>
Aug 14 17:14:03 user nova-compute[73056]: </domain>
Aug 14 17:14:03 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T17:14:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1787890632',display_name='tempest-AttachVolumeTestJSON-server-1787890632',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1787890632',id=48,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiqFQ9jmpfA1gcwScSEzYgMTzDIuvVWJ47gAgo/o3S8pUNqjBCZYJuZRMhehC2bLpzs6Ie2XYwTYMCRU31Vxai8S325VR+ZEnlIH+7eRI2hxjFhGDMJZht/qFjVmrw/vg==',key_name='tempest-keypair-932455183',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='415a7291b35546b5ac324280d37d50ae',ramdisk_id='',reservation_id='r-45450rib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-112776827',owner_user_name='tempest-AttachVolumeTestJSON-112776827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T17:14:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bf4bfed609343c78b0d828db45d5ab7',uuid=b8a52b1b-bcd0-493c-9887-af867acf019f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e8b1816-285f-49ca-8fd5-3f672c8d42f9", "address": "fa:16:3e:99:5e:b7", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8b1816-28", "ovs_interfaceid": "0e8b1816-285f-49ca-8fd5-3f672c8d42f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Converting VIF {"id": "0e8b1816-285f-49ca-8fd5-3f672c8d42f9", "address": "fa:16:3e:99:5e:b7", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8b1816-28", "ovs_interfaceid": "0e8b1816-285f-49ca-8fd5-3f672c8d42f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:5e:b7,bridge_name='br-int',has_traffic_filtering=True,id=0e8b1816-285f-49ca-8fd5-3f672c8d42f9,network=Network(7e2ce9fb-4bdc-441f-ae4a-30224b2712e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e8b1816-28') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG os_vif [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:5e:b7,bridge_name='br-int',has_traffic_filtering=True,id=0e8b1816-285f-49ca-8fd5-3f672c8d42f9,network=Network(7e2ce9fb-4bdc-441f-ae4a-30224b2712e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e8b1816-28') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e8b1816-28, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0e8b1816-28, col_values=(('external_ids', {'iface-id': '0e8b1816-285f-49ca-8fd5-3f672c8d42f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:5e:b7', 'vm-uuid': 'b8a52b1b-bcd0-493c-9887-af867acf019f'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:14:03 user nova-compute[73056]: INFO os_vif [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:5e:b7,bridge_name='br-int',has_traffic_filtering=True,id=0e8b1816-285f-49ca-8fd5-3f672c8d42f9,network=Network(7e2ce9fb-4bdc-441f-ae4a-30224b2712e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e8b1816-28')
Aug 14 17:14:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] No VIF found with MAC fa:16:3e:99:5e:b7, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG nova.network.neutron [req-be8a0bbe-70be-4932-a8a2-1b4d8e99d2b0 req-1b988632-d8c0-4719-bd8e-fa9e5529c7ef service nova] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Updated VIF entry in instance network info cache for port 0e8b1816-285f-49ca-8fd5-3f672c8d42f9. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG nova.network.neutron [req-be8a0bbe-70be-4932-a8a2-1b4d8e99d2b0 req-1b988632-d8c0-4719-bd8e-fa9e5529c7ef service nova] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Updating instance_info_cache with network_info: [{"id": "0e8b1816-285f-49ca-8fd5-3f672c8d42f9", "address": "fa:16:3e:99:5e:b7", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8b1816-28", "ovs_interfaceid": "0e8b1816-285f-49ca-8fd5-3f672c8d42f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:14:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-be8a0bbe-70be-4932-a8a2-1b4d8e99d2b0 req-1b988632-d8c0-4719-bd8e-fa9e5529c7ef service nova] Releasing lock "refresh_cache-b8a52b1b-bcd0-493c-9887-af867acf019f" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:14:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:14:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:14:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:14:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:14:05 user nova-compute[73056]: DEBUG nova.compute.manager [req-9c5a4043-ecf4-4cc4-9e9e-6992cddc1979 req-08e32edc-88bf-4612-b373-b699ee4cc109 service nova] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Received event network-vif-plugged-0e8b1816-285f-49ca-8fd5-3f672c8d42f9 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:14:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9c5a4043-ecf4-4cc4-9e9e-6992cddc1979 req-08e32edc-88bf-4612-b373-b699ee4cc109 service nova] Acquiring lock "b8a52b1b-bcd0-493c-9887-af867acf019f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:14:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9c5a4043-ecf4-4cc4-9e9e-6992cddc1979 req-08e32edc-88bf-4612-b373-b699ee4cc109 service nova] Lock "b8a52b1b-bcd0-493c-9887-af867acf019f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:14:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-9c5a4043-ecf4-4cc4-9e9e-6992cddc1979 req-08e32edc-88bf-4612-b373-b699ee4cc109 service nova] Lock "b8a52b1b-bcd0-493c-9887-af867acf019f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:14:05 user nova-compute[73056]: DEBUG nova.compute.manager [req-9c5a4043-ecf4-4cc4-9e9e-6992cddc1979 req-08e32edc-88bf-4612-b373-b699ee4cc109 service nova] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] No waiting events found dispatching network-vif-plugged-0e8b1816-285f-49ca-8fd5-3f672c8d42f9 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:14:05 user nova-compute[73056]: WARNING nova.compute.manager [req-9c5a4043-ecf4-4cc4-9e9e-6992cddc1979 req-08e32edc-88bf-4612-b373-b699ee4cc109 service nova] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Received unexpected event network-vif-plugged-0e8b1816-285f-49ca-8fd5-3f672c8d42f9 for instance with vm_state building and task_state spawning.
Aug 14 17:14:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:14:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:14:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:14:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:14:07 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692033247.1528666, b8a52b1b-bcd0-493c-9887-af867acf019f => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:14:07 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] VM Resumed (Lifecycle Event)
Aug 14 17:14:07 user nova-compute[73056]: DEBUG nova.compute.manager [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 17:14:07 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 17:14:07 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Instance spawned successfully.
Aug 14 17:14:07 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 17:14:07 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:14:07 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 17:14:07 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:14:07 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:14:07 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:14:07 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:14:07 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:14:07 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:14:07 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 17:14:07 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692033247.1565285, b8a52b1b-bcd0-493c-9887-af867acf019f => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:14:07 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] VM Started (Lifecycle Event)
Aug 14 17:14:07 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:14:07 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 17:14:07 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 17:14:07 user nova-compute[73056]: INFO nova.compute.manager [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Took 5.97 seconds to spawn the instance on the hypervisor.
Aug 14 17:14:07 user nova-compute[73056]: DEBUG nova.compute.manager [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:14:07 user nova-compute[73056]: INFO nova.compute.manager [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Took 6.57 seconds to build instance.
Aug 14 17:14:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2075f9a6-1290-46f8-a542-87b000e7c139 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "b8a52b1b-bcd0-493c-9887-af867acf019f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.678s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:14:07 user nova-compute[73056]: DEBUG nova.compute.manager [req-73159d25-a1c7-4f95-bb32-afc06b937346 req-3882a9c0-0683-4b81-939f-366e86d57d90 service nova] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Received event network-vif-plugged-0e8b1816-285f-49ca-8fd5-3f672c8d42f9 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:14:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-73159d25-a1c7-4f95-bb32-afc06b937346 req-3882a9c0-0683-4b81-939f-366e86d57d90 service nova] Acquiring lock "b8a52b1b-bcd0-493c-9887-af867acf019f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:14:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-73159d25-a1c7-4f95-bb32-afc06b937346 req-3882a9c0-0683-4b81-939f-366e86d57d90 service nova] Lock "b8a52b1b-bcd0-493c-9887-af867acf019f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:14:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-73159d25-a1c7-4f95-bb32-afc06b937346 req-3882a9c0-0683-4b81-939f-366e86d57d90 service nova] Lock "b8a52b1b-bcd0-493c-9887-af867acf019f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:14:07 user nova-compute[73056]: DEBUG nova.compute.manager [req-73159d25-a1c7-4f95-bb32-afc06b937346 req-3882a9c0-0683-4b81-939f-366e86d57d90 service nova] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] No waiting events found dispatching network-vif-plugged-0e8b1816-285f-49ca-8fd5-3f672c8d42f9 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:14:07 user nova-compute[73056]: WARNING nova.compute.manager [req-73159d25-a1c7-4f95-bb32-afc06b937346 req-3882a9c0-0683-4b81-939f-366e86d57d90 service nova] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Received unexpected event network-vif-plugged-0e8b1816-285f-49ca-8fd5-3f672c8d42f9 for instance with vm_state active and task_state None.
Aug 14 17:14:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:14:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:14:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:14:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "fb1a193b-73b7-4690-8571-be9af04b3b14" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:14:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "fb1a193b-73b7-4690-8571-be9af04b3b14" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:14:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "fb1a193b-73b7-4690-8571-be9af04b3b14-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:14:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "fb1a193b-73b7-4690-8571-be9af04b3b14-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:14:13 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "fb1a193b-73b7-4690-8571-be9af04b3b14-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:14:13 user nova-compute[73056]: INFO nova.compute.manager [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Terminating instance
Aug 14 17:14:13 user nova-compute[73056]: DEBUG nova.compute.manager [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 17:14:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:14:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG nova.compute.manager [req-101d0569-5b53-472e-a2e5-ae4e5fd97529 req-7a7857f4-1263-4462-b5c8-1b589efa6734 service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Received event network-vif-unplugged-852ab20a-9a1b-47c5-b85e-52a44fff3e36 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-101d0569-5b53-472e-a2e5-ae4e5fd97529 req-7a7857f4-1263-4462-b5c8-1b589efa6734 service nova] Acquiring lock "fb1a193b-73b7-4690-8571-be9af04b3b14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-101d0569-5b53-472e-a2e5-ae4e5fd97529 req-7a7857f4-1263-4462-b5c8-1b589efa6734 service nova] Lock "fb1a193b-73b7-4690-8571-be9af04b3b14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-101d0569-5b53-472e-a2e5-ae4e5fd97529 req-7a7857f4-1263-4462-b5c8-1b589efa6734 service nova] Lock "fb1a193b-73b7-4690-8571-be9af04b3b14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG nova.compute.manager [req-101d0569-5b53-472e-a2e5-ae4e5fd97529 req-7a7857f4-1263-4462-b5c8-1b589efa6734 service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] No waiting events found dispatching network-vif-unplugged-852ab20a-9a1b-47c5-b85e-52a44fff3e36 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG nova.compute.manager [req-101d0569-5b53-472e-a2e5-ae4e5fd97529 req-7a7857f4-1263-4462-b5c8-1b589efa6734 service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Received event network-vif-unplugged-852ab20a-9a1b-47c5-b85e-52a44fff3e36 for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:14:14 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Instance destroyed successfully.
Aug 14 17:14:14 user nova-compute[73056]: DEBUG nova.objects.instance [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lazy-loading 'resources' on Instance uuid fb1a193b-73b7-4690-8571-be9af04b3b14 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:58:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-981830137',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-981830137',id=43,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T17:00:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a56fc678888b4653802e94ac6b47f95d',ramdisk_id='',reservation_id='r-j55o6yqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-572642883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T17:02:14Z,user_data=None,user_id='958f0c79efdc4352b35874e6c6f940d8',uuid=fb1a193b-73b7-4690-8571-be9af04b3b14,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "852ab20a-9a1b-47c5-b85e-52a44fff3e36", "address": "fa:16:3e:32:95:fb", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852ab20a-9a", "ovs_interfaceid": "852ab20a-9a1b-47c5-b85e-52a44fff3e36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Converting VIF {"id": "852ab20a-9a1b-47c5-b85e-52a44fff3e36", "address": "fa:16:3e:32:95:fb", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap852ab20a-9a", "ovs_interfaceid": "852ab20a-9a1b-47c5-b85e-52a44fff3e36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:95:fb,bridge_name='br-int',has_traffic_filtering=True,id=852ab20a-9a1b-47c5-b85e-52a44fff3e36,network=Network(ac2d700d-98d2-4459-8da8-a4858cda8864),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap852ab20a-9a') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG os_vif [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:95:fb,bridge_name='br-int',has_traffic_filtering=True,id=852ab20a-9a1b-47c5-b85e-52a44fff3e36,network=Network(ac2d700d-98d2-4459-8da8-a4858cda8864),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap852ab20a-9a') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap852ab20a-9a, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:14:14 user nova-compute[73056]: INFO os_vif [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:95:fb,bridge_name='br-int',has_traffic_filtering=True,id=852ab20a-9a1b-47c5-b85e-52a44fff3e36,network=Network(ac2d700d-98d2-4459-8da8-a4858cda8864),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap852ab20a-9a')
Aug 14 17:14:14 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gCIxQLbZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 17:14:14 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 17:14:14 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5599f3f1-884f-4cd6-b99c-c1e1dafc23b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd832a0c-33ac-446a-88b5-1cd8785b771a]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 17:14:14 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e (non-flash)
Aug 14 17:14:14 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff300556050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e'): ({'sdd'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Removing single pathed devices sdd {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2ffcd7-59b2-444b-b639-53574f5176e6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7620e5-4fe7-4ed2-aa90-458f5ee34426]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Flushing IO for device /dev/sdd {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1d03d4-42c9-4a66-9777-699ac0244239]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96b084f-e736-4476-ae4a-2b62f4947228]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] SCSI volumes sdd have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd4356f-3b0d-409a-9eef-1b55eda8f6f6]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cef7908-e29e-4ab4-bda7-ed9c676cde0d]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e, portal: 172.16.0.220,3260]
Aug 14 17:14:14 user nova-compute[73056]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e, portal: 172.16.0.220,3260] successful.
Aug 14 17:14:14 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f47dbb29-89e5-4391-b050-a7773b4ca93e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5614ad5-c09f-4b12-a217-36937edac6de]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] <== disconnect_volume: return (273ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 17:14:14 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Deleting instance files /opt/stack/data/nova/instances/fb1a193b-73b7-4690-8571-be9af04b3b14_del
Aug 14 17:14:14 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Deletion of /opt/stack/data/nova/instances/fb1a193b-73b7-4690-8571-be9af04b3b14_del complete
Aug 14 17:14:14 user nova-compute[73056]: INFO nova.compute.manager [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Took 1.11 seconds to destroy the instance on the hypervisor.
Aug 14 17:14:14 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 17:14:14 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 17:14:15 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:14:15 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Took 0.61 seconds to deallocate network for instance.
Aug 14 17:14:16 user nova-compute[73056]: DEBUG nova.compute.manager [req-715a944c-3c7c-4dbd-b6e8-82c5a61cbb32 req-518689d8-e5f8-499c-a52d-48e5f817cb3a service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Received event network-vif-plugged-852ab20a-9a1b-47c5-b85e-52a44fff3e36 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:14:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-715a944c-3c7c-4dbd-b6e8-82c5a61cbb32 req-518689d8-e5f8-499c-a52d-48e5f817cb3a service nova] Acquiring lock "fb1a193b-73b7-4690-8571-be9af04b3b14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:14:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-715a944c-3c7c-4dbd-b6e8-82c5a61cbb32 req-518689d8-e5f8-499c-a52d-48e5f817cb3a service nova] Lock "fb1a193b-73b7-4690-8571-be9af04b3b14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:14:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-715a944c-3c7c-4dbd-b6e8-82c5a61cbb32 req-518689d8-e5f8-499c-a52d-48e5f817cb3a service nova] Lock "fb1a193b-73b7-4690-8571-be9af04b3b14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:14:16 user nova-compute[73056]: DEBUG nova.compute.manager [req-715a944c-3c7c-4dbd-b6e8-82c5a61cbb32 req-518689d8-e5f8-499c-a52d-48e5f817cb3a service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] No waiting events found dispatching network-vif-plugged-852ab20a-9a1b-47c5-b85e-52a44fff3e36 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:14:16 user nova-compute[73056]: WARNING nova.compute.manager [req-715a944c-3c7c-4dbd-b6e8-82c5a61cbb32 req-518689d8-e5f8-499c-a52d-48e5f817cb3a service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Received unexpected event network-vif-plugged-852ab20a-9a1b-47c5-b85e-52a44fff3e36 for instance with vm_state active and task_state deleting.
Aug 14 17:14:16 user nova-compute[73056]: DEBUG nova.compute.manager [req-715a944c-3c7c-4dbd-b6e8-82c5a61cbb32 req-518689d8-e5f8-499c-a52d-48e5f817cb3a service nova] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Received event network-vif-deleted-852ab20a-9a1b-47c5-b85e-52a44fff3e36 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:14:16 user nova-compute[73056]: INFO nova.compute.manager [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Took 0.70 seconds to detach 1 volumes for instance.
Aug 14 17:14:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:14:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:14:16 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:14:16 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:14:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.165s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:14:16 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Deleted allocations for instance fb1a193b-73b7-4690-8571-be9af04b3b14
Aug 14 17:14:16 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:14:16 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 17:14:16 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-729930ed-1e08-4299-965a-8b955ac113b7 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "fb1a193b-73b7-4690-8571-be9af04b3b14" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.768s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:14:18 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:14:18 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:14:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:14:23 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:14:23 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 17:14:23 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Rebuilding the list of instances to heal {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 17:14:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-5191b082-a6f3-467c-b28b-fda85e15f330" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:14:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-5191b082-a6f3-467c-b28b-fda85e15f330" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:14:23 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 17:14:23 user nova-compute[73056]: DEBUG nova.objects.instance [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lazy-loading 'info_cache' on Instance uuid 5191b082-a6f3-467c-b28b-fda85e15f330 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:14:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:14:23 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Updating instance_info_cache with network_info: [{"id": "dee958cc-5a62-479c-8429-4c503bef3672", "address": "fa:16:3e:3e:a3:b5", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee958cc-5a", "ovs_interfaceid": "dee958cc-5a62-479c-8429-4c503bef3672", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:14:23 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-5191b082-a6f3-467c-b28b-fda85e15f330" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:14:23 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 17:14:24 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:14:26 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:14:26 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:14:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:14:29 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:14:29 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692033254.5297651, fb1a193b-73b7-4690-8571-be9af04b3b14 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:14:29 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] VM Stopped (Lifecycle Event)
Aug 14 17:14:29 user nova-compute[73056]: DEBUG nova.compute.manager [None req-928787e8-5858-4163-9781-19ad8bf01c9a None None] [instance: fb1a193b-73b7-4690-8571-be9af04b3b14] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:14:29 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:14:30 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:14:30 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:14:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:14:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:14:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:14:30 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 17:14:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a52b1b-bcd0-493c-9887-af867acf019f/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:14:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a52b1b-bcd0-493c-9887-af867acf019f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:14:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a52b1b-bcd0-493c-9887-af867acf019f/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:14:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a52b1b-bcd0-493c-9887-af867acf019f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:14:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:14:31 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:14:31 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:14:31 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:14:31 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:14:31 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:14:31 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=8541MB free_disk=25.05841827392578GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 17:14:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:14:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:14:31 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 5191b082-a6f3-467c-b28b-fda85e15f330 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:14:31 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance b8a52b1b-bcd0-493c-9887-af867acf019f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:14:31 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 17:14:31 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 17:14:31 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:14:31 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:14:31 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 17:14:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.230s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:14:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:14:34 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:14:34 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:14:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:14:39 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:14:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:14:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:14:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:14:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:14:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:14:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:14:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:14:54 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:14:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:15:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-456c35aa-e758-4eb0-b61b-c0ee8cae8392 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "5191b082-a6f3-467c-b28b-fda85e15f330" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:15:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-456c35aa-e758-4eb0-b61b-c0ee8cae8392 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "5191b082-a6f3-467c-b28b-fda85e15f330" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:15:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-456c35aa-e758-4eb0-b61b-c0ee8cae8392 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "5191b082-a6f3-467c-b28b-fda85e15f330-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:15:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-456c35aa-e758-4eb0-b61b-c0ee8cae8392 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "5191b082-a6f3-467c-b28b-fda85e15f330-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:15:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-456c35aa-e758-4eb0-b61b-c0ee8cae8392 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "5191b082-a6f3-467c-b28b-fda85e15f330-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:15:04 user nova-compute[73056]: INFO nova.compute.manager [None req-456c35aa-e758-4eb0-b61b-c0ee8cae8392 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Terminating instance
Aug 14 17:15:04 user nova-compute[73056]: DEBUG nova.compute.manager [None req-456c35aa-e758-4eb0-b61b-c0ee8cae8392 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 17:15:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:15:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:15:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:15:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:15:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:15:04 user nova-compute[73056]: DEBUG nova.compute.manager [req-81f2c552-5db3-446b-a97f-8b1c93e2d48b req-0370571a-7573-48e5-9b8c-de5e45b7c410 service nova] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Received event network-vif-unplugged-dee958cc-5a62-479c-8429-4c503bef3672 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:15:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-81f2c552-5db3-446b-a97f-8b1c93e2d48b req-0370571a-7573-48e5-9b8c-de5e45b7c410 service nova] Acquiring lock "5191b082-a6f3-467c-b28b-fda85e15f330-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:15:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-81f2c552-5db3-446b-a97f-8b1c93e2d48b req-0370571a-7573-48e5-9b8c-de5e45b7c410 service nova] Lock "5191b082-a6f3-467c-b28b-fda85e15f330-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:15:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-81f2c552-5db3-446b-a97f-8b1c93e2d48b req-0370571a-7573-48e5-9b8c-de5e45b7c410 service nova] Lock "5191b082-a6f3-467c-b28b-fda85e15f330-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:15:04 user nova-compute[73056]: DEBUG nova.compute.manager [req-81f2c552-5db3-446b-a97f-8b1c93e2d48b req-0370571a-7573-48e5-9b8c-de5e45b7c410 service nova] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] No waiting events found dispatching network-vif-unplugged-dee958cc-5a62-479c-8429-4c503bef3672 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:15:04 user nova-compute[73056]: DEBUG nova.compute.manager [req-81f2c552-5db3-446b-a97f-8b1c93e2d48b req-0370571a-7573-48e5-9b8c-de5e45b7c410 service nova] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Received event network-vif-unplugged-dee958cc-5a62-479c-8429-4c503bef3672 for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 17:15:05 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Instance destroyed successfully.
Aug 14 17:15:05 user nova-compute[73056]: DEBUG nova.objects.instance [None req-456c35aa-e758-4eb0-b61b-c0ee8cae8392 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lazy-loading 'resources' on Instance uuid 5191b082-a6f3-467c-b28b-fda85e15f330 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:15:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-456c35aa-e758-4eb0-b61b-c0ee8cae8392 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T16:55:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-608145548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-608145548',id=40,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T16:55:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a56fc678888b4653802e94ac6b47f95d',ramdisk_id='',reservation_id='r-e0807ie7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-572642883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T16:57:25Z,user_data=None,user_id='958f0c79efdc4352b35874e6c6f940d8',uuid=5191b082-a6f3-467c-b28b-fda85e15f330,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dee958cc-5a62-479c-8429-4c503bef3672", "address": "fa:16:3e:3e:a3:b5", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee958cc-5a", "ovs_interfaceid": "dee958cc-5a62-479c-8429-4c503bef3672", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 17:15:05 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-456c35aa-e758-4eb0-b61b-c0ee8cae8392 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Converting VIF {"id": "dee958cc-5a62-479c-8429-4c503bef3672", "address": "fa:16:3e:3e:a3:b5", "network": {"id": "ac2d700d-98d2-4459-8da8-a4858cda8864", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-982786450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a56fc678888b4653802e94ac6b47f95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee958cc-5a", "ovs_interfaceid": "dee958cc-5a62-479c-8429-4c503bef3672", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:15:05 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-456c35aa-e758-4eb0-b61b-c0ee8cae8392 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:a3:b5,bridge_name='br-int',has_traffic_filtering=True,id=dee958cc-5a62-479c-8429-4c503bef3672,network=Network(ac2d700d-98d2-4459-8da8-a4858cda8864),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdee958cc-5a') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:15:05 user nova-compute[73056]: DEBUG os_vif [None req-456c35aa-e758-4eb0-b61b-c0ee8cae8392 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:a3:b5,bridge_name='br-int',has_traffic_filtering=True,id=dee958cc-5a62-479c-8429-4c503bef3672,network=Network(ac2d700d-98d2-4459-8da8-a4858cda8864),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdee958cc-5a') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 17:15:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:15:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdee958cc-5a, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:15:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:15:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:15:05 user nova-compute[73056]: INFO os_vif [None req-456c35aa-e758-4eb0-b61b-c0ee8cae8392 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:a3:b5,bridge_name='br-int',has_traffic_filtering=True,id=dee958cc-5a62-479c-8429-4c503bef3672,network=Network(ac2d700d-98d2-4459-8da8-a4858cda8864),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdee958cc-5a')
Aug 14 17:15:05 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-456c35aa-e758-4eb0-b61b-c0ee8cae8392 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Deleting instance files /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330_del
Aug 14 17:15:05 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-456c35aa-e758-4eb0-b61b-c0ee8cae8392 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Deletion of /opt/stack/data/nova/instances/5191b082-a6f3-467c-b28b-fda85e15f330_del complete
Aug 14 17:15:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:15:05 user nova-compute[73056]: INFO nova.compute.manager [None req-456c35aa-e758-4eb0-b61b-c0ee8cae8392 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Took 0.72 seconds to destroy the instance on the hypervisor.
Aug 14 17:15:05 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-456c35aa-e758-4eb0-b61b-c0ee8cae8392 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 17:15:05 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 17:15:05 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 17:15:05 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:15:05 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Took 0.57 seconds to deallocate network for instance.
Aug 14 17:15:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-456c35aa-e758-4eb0-b61b-c0ee8cae8392 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:15:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-456c35aa-e758-4eb0-b61b-c0ee8cae8392 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:15:05 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-456c35aa-e758-4eb0-b61b-c0ee8cae8392 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:15:05 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-456c35aa-e758-4eb0-b61b-c0ee8cae8392 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:15:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-456c35aa-e758-4eb0-b61b-c0ee8cae8392 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.146s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:15:06 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-456c35aa-e758-4eb0-b61b-c0ee8cae8392 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Deleted allocations for instance 5191b082-a6f3-467c-b28b-fda85e15f330
Aug 14 17:15:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-456c35aa-e758-4eb0-b61b-c0ee8cae8392 tempest-ServerBootFromVolumeStableRescueTest-572642883 tempest-ServerBootFromVolumeStableRescueTest-572642883-project-member] Lock "5191b082-a6f3-467c-b28b-fda85e15f330" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.667s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:15:06 user nova-compute[73056]: DEBUG nova.compute.manager [req-557cf894-d0f4-4fc6-b4b9-b33957220a56 req-e8fb119a-41d3-4df1-bb58-24b5d5cd75c3 service nova] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Received event network-vif-plugged-dee958cc-5a62-479c-8429-4c503bef3672 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:15:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-557cf894-d0f4-4fc6-b4b9-b33957220a56 req-e8fb119a-41d3-4df1-bb58-24b5d5cd75c3 service nova] Acquiring lock "5191b082-a6f3-467c-b28b-fda85e15f330-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:15:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-557cf894-d0f4-4fc6-b4b9-b33957220a56 req-e8fb119a-41d3-4df1-bb58-24b5d5cd75c3 service nova] Lock "5191b082-a6f3-467c-b28b-fda85e15f330-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:15:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-557cf894-d0f4-4fc6-b4b9-b33957220a56 req-e8fb119a-41d3-4df1-bb58-24b5d5cd75c3 service nova] Lock "5191b082-a6f3-467c-b28b-fda85e15f330-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:15:06 user nova-compute[73056]: DEBUG nova.compute.manager [req-557cf894-d0f4-4fc6-b4b9-b33957220a56 req-e8fb119a-41d3-4df1-bb58-24b5d5cd75c3 service nova] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] No waiting events found dispatching network-vif-plugged-dee958cc-5a62-479c-8429-4c503bef3672 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:15:06 user nova-compute[73056]: WARNING nova.compute.manager [req-557cf894-d0f4-4fc6-b4b9-b33957220a56 req-e8fb119a-41d3-4df1-bb58-24b5d5cd75c3 service nova] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Received unexpected event network-vif-plugged-dee958cc-5a62-479c-8429-4c503bef3672 for instance with vm_state deleted and task_state None.
Aug 14 17:15:06 user nova-compute[73056]: DEBUG nova.compute.manager [req-557cf894-d0f4-4fc6-b4b9-b33957220a56 req-e8fb119a-41d3-4df1-bb58-24b5d5cd75c3 service nova] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Received event network-vif-deleted-dee958cc-5a62-479c-8429-4c503bef3672 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:15:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:15:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:15:17 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:15:17 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 17:15:18 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:15:20 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692033305.099451, 5191b082-a6f3-467c-b28b-fda85e15f330 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:15:20 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] VM Stopped (Lifecycle Event)
Aug 14 17:15:20 user nova-compute[73056]: DEBUG nova.compute.manager [None req-75fa670b-c856-439a-8f3d-8a9f9c4e5c5b None None] [instance: 5191b082-a6f3-467c-b28b-fda85e15f330] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:15:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:15:20 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:15:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:15:25 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:15:25 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 17:15:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-b8a52b1b-bcd0-493c-9887-af867acf019f" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:15:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-b8a52b1b-bcd0-493c-9887-af867acf019f" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:15:25 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 17:15:26 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Updating instance_info_cache with network_info: [{"id": "0e8b1816-285f-49ca-8fd5-3f672c8d42f9", "address": "fa:16:3e:99:5e:b7", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8b1816-28", "ovs_interfaceid": "0e8b1816-285f-49ca-8fd5-3f672c8d42f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:15:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-b8a52b1b-bcd0-493c-9887-af867acf019f" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:15:26 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 17:15:27 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:15:28 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:15:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:15:30 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:15:32 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:15:32 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:15:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:15:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:15:32 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:15:32 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 17:15:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a52b1b-bcd0-493c-9887-af867acf019f/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:15:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a52b1b-bcd0-493c-9887-af867acf019f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:15:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a52b1b-bcd0-493c-9887-af867acf019f/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:15:32 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a52b1b-bcd0-493c-9887-af867acf019f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:15:33 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:15:33 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:15:33 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=8709MB free_disk=25.182758331298828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 17:15:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:15:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:15:33 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance b8a52b1b-bcd0-493c-9887-af867acf019f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:15:33 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 17:15:33 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 17:15:33 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:15:33 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:15:33 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 17:15:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.193s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:15:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:15:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:15:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:15:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:15:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:15:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:15:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:15:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:15:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:15:52 user nova-compute[73056]: DEBUG nova.compute.manager [req-3f0f0045-d9e3-4426-a32c-58ff137d8a69 req-9a5456ed-0f81-4040-ac9c-3d33be1efcfc service nova] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Received event network-changed-0e8b1816-285f-49ca-8fd5-3f672c8d42f9 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:15:52 user nova-compute[73056]: DEBUG nova.compute.manager [req-3f0f0045-d9e3-4426-a32c-58ff137d8a69 req-9a5456ed-0f81-4040-ac9c-3d33be1efcfc service nova] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Refreshing instance network info cache due to event network-changed-0e8b1816-285f-49ca-8fd5-3f672c8d42f9. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 17:15:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3f0f0045-d9e3-4426-a32c-58ff137d8a69 req-9a5456ed-0f81-4040-ac9c-3d33be1efcfc service nova] Acquiring lock "refresh_cache-b8a52b1b-bcd0-493c-9887-af867acf019f" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:15:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3f0f0045-d9e3-4426-a32c-58ff137d8a69 req-9a5456ed-0f81-4040-ac9c-3d33be1efcfc service nova] Acquired lock "refresh_cache-b8a52b1b-bcd0-493c-9887-af867acf019f" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:15:52 user nova-compute[73056]: DEBUG nova.network.neutron [req-3f0f0045-d9e3-4426-a32c-58ff137d8a69 req-9a5456ed-0f81-4040-ac9c-3d33be1efcfc service nova] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Refreshing network info cache for port 0e8b1816-285f-49ca-8fd5-3f672c8d42f9 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 17:15:52 user nova-compute[73056]: DEBUG nova.network.neutron [req-3f0f0045-d9e3-4426-a32c-58ff137d8a69 req-9a5456ed-0f81-4040-ac9c-3d33be1efcfc service nova] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Updated VIF entry in instance network info cache for port 0e8b1816-285f-49ca-8fd5-3f672c8d42f9. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 17:15:52 user nova-compute[73056]: DEBUG nova.network.neutron [req-3f0f0045-d9e3-4426-a32c-58ff137d8a69 req-9a5456ed-0f81-4040-ac9c-3d33be1efcfc service nova] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Updating instance_info_cache with network_info: [{"id": "0e8b1816-285f-49ca-8fd5-3f672c8d42f9", "address": "fa:16:3e:99:5e:b7", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8b1816-28", "ovs_interfaceid": "0e8b1816-285f-49ca-8fd5-3f672c8d42f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:15:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3f0f0045-d9e3-4426-a32c-58ff137d8a69 req-9a5456ed-0f81-4040-ac9c-3d33be1efcfc service nova] Releasing lock "refresh_cache-b8a52b1b-bcd0-493c-9887-af867acf019f" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:15:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:15:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:15:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "b8a52b1b-bcd0-493c-9887-af867acf019f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:15:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "b8a52b1b-bcd0-493c-9887-af867acf019f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:15:55 user nova-compute[73056]: DEBUG nova.objects.instance [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lazy-loading 'flavor' on Instance uuid b8a52b1b-bcd0-493c-9887-af867acf019f {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:15:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:15:55 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "b8a52b1b-bcd0-493c-9887-af867acf019f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:15:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "b8a52b1b-bcd0-493c-9887-af867acf019f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:15:56 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "b8a52b1b-bcd0-493c-9887-af867acf019f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:15:56 user nova-compute[73056]: INFO nova.compute.manager [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Attaching volume 57b70cfe-3fe2-4380-951f-3f350d567376 to /dev/vdb
Aug 14 17:15:56 user nova-compute[73056]: DEBUG os_brick.utils [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 17:15:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:15:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:15:56 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c660bc62-cfc8-4776-8538-431d3b1c95e5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:15:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:15:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:15:56 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14390b3-231f-4231-9be4-07bf15d6741d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:15:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:15:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:15:56 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26b7d6d-7b0b-4109-8d57-94e4e4787bcd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:15:56 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b16bad1-ad54-482e-8a47-e293896c460a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:15:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:15:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 17:15:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 17:15:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:15:56 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 17:15:56 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 17:15:56 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c5cf4d-4a60-4e67-83e8-833c47216435]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:15:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 17:15:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 17:15:56 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 17:15:56 user nova-compute[73056]: DEBUG os_brick.utils [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 17:15:56 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Updating existing volume attachment record: 89b15d33-0769-413b-bb37-f684c1cce1b6 {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 17:15:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:15:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:16:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:16:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DNQCPWac', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 17:16:04 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 17:16:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 17:16:04 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 17:16:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 17:16:04 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 17:16:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376 -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ecccbd-0899-461f-957f-230c2ce4ac76]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 17:16:04 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376 -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55870e3-cedc-4191-95f1-399379213c38]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376] added
Aug 14 17:16:04 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c923aef-db7d-476f-bd92-f400038ab31b]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3981e14-69fe-4e78-a20f-4681b6bced7c]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DNQCPWac {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DNQCPWac" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35664bb-77a7-495f-8d57-8bc8f21e94e3]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DNQCPWac'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[db644c60-fb03-4e0f-a422-6311690586d5]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[74528255-3f79-49bc-b704-0821f6b6a3f8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 17:16:04 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 17:16:04 user nova-compute[73056]:  {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 17:16:04 user nova-compute[73056]: WARNING os_brick.initiator.connectors.iscsi [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 17:16:04 user nova-compute[73056]: 
Aug 14 17:16:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376 -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5516c8-3c46-42ad-9863-3c1d57fc6ed1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376, portal: 172.16.0.220,3260]
Aug 14 17:16:04 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376, portal: 172.16.0.220,3260] successful.
Aug 14 17:16:04 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65b2449-4ae9-4578-a79d-fe29588e1d82]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6ad37c-6454-401a-8b8a-6a745584c301]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376 (non-flash)
Aug 14 17:16:04 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376 (non-flash)
Aug 14 17:16:04 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[caad13f0-804e-4847-b016-452aa2901be4]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 17:16:04 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DNQCPWac', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 17:16:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:16:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 17:16:05 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '26331643765333338', 'path': '/dev/sdb'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 17:16:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331643765333338', 'path': '/dev/sdb'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 17:16:05 user nova-compute[73056]: DEBUG nova.objects.instance [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lazy-loading 'flavor' on Instance uuid b8a52b1b-bcd0-493c-9887-af867acf019f {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:16:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 17:16:05 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 17:16:05 user nova-compute[73056]:   <source dev="/dev/sdb"/>
Aug 14 17:16:05 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 17:16:05 user nova-compute[73056]:   <serial>57b70cfe-3fe2-4380-951f-3f350d567376</serial>
Aug 14 17:16:05 user nova-compute[73056]: </disk>
Aug 14 17:16:05 user nova-compute[73056]:  {{(pid=73056) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 17:16:06 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 17:16:06 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 17:16:06 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] No VIF found with MAC fa:16:3e:99:5e:b7, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 17:16:06 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-ae0bd0cc-21a7-4eef-91a7-113b041a6d96 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "b8a52b1b-bcd0-493c-9887-af867acf019f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.484s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:16:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:16:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Acquiring lock "860cb53c-f023-4c4b-9f04-7a90c8274974" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:16:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Lock "860cb53c-f023-4c4b-9f04-7a90c8274974" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:16:07 user nova-compute[73056]: DEBUG nova.compute.manager [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 17:16:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:16:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:16:07 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 17:16:07 user nova-compute[73056]: INFO nova.compute.claims [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Claim successful on node user
Aug 14 17:16:08 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:16:08 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:16:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.263s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:16:08 user nova-compute[73056]: DEBUG nova.compute.manager [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 17:16:08 user nova-compute[73056]: DEBUG nova.compute.manager [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 17:16:08 user nova-compute[73056]: DEBUG nova.network.neutron [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 17:16:08 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 17:16:08 user nova-compute[73056]: DEBUG nova.compute.manager [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 17:16:08 user nova-compute[73056]: DEBUG nova.policy [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b0e100f63e194a008fb7a581bf54441a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97951b9947e47f7a891f30b978035df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 17:16:08 user nova-compute[73056]: DEBUG nova.compute.manager [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 17:16:08 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 17:16:08 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Creating image(s)
Aug 14 17:16:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Acquiring lock "/opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:16:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Lock "/opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:16:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Lock "/opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.066s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:16:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.225s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Acquiring lock "c889592ab94cd0b0ce896f27a2af0323771db234" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:16:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:16:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:16:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.178s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk 1073741824" returned: 0 in 0.064s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:08 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:16:08 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:09 user nova-compute[73056]: DEBUG nova.network.neutron [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Successfully created port: af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8 {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 17:16:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.171s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:09 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Checking if we can resize image /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 17:16:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:09 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:09 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Cannot resize image /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 17:16:09 user nova-compute[73056]: DEBUG nova.objects.instance [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Lazy-loading 'migration_context' on Instance uuid 860cb53c-f023-4c4b-9f04-7a90c8274974 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:16:09 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 17:16:09 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Ensure instance console log exists: /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 17:16:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:16:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:16:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG nova.network.neutron [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Successfully updated port: af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8 {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Acquiring lock "refresh_cache-860cb53c-f023-4c4b-9f04-7a90c8274974" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Acquired lock "refresh_cache-860cb53c-f023-4c4b-9f04-7a90c8274974" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG nova.network.neutron [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG nova.compute.manager [req-22dddf92-1838-4442-87dc-2cdee5af3541 req-c9284d72-90bf-4940-b7d1-9e3cff759b9d service nova] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Received event network-changed-af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG nova.compute.manager [req-22dddf92-1838-4442-87dc-2cdee5af3541 req-c9284d72-90bf-4940-b7d1-9e3cff759b9d service nova] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Refreshing instance network info cache due to event network-changed-af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-22dddf92-1838-4442-87dc-2cdee5af3541 req-c9284d72-90bf-4940-b7d1-9e3cff759b9d service nova] Acquiring lock "refresh_cache-860cb53c-f023-4c4b-9f04-7a90c8274974" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG nova.network.neutron [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "b8a52b1b-bcd0-493c-9887-af867acf019f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "b8a52b1b-bcd0-493c-9887-af867acf019f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG nova.objects.instance [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lazy-loading 'flavor' on Instance uuid b8a52b1b-bcd0-493c-9887-af867acf019f {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "b8a52b1b-bcd0-493c-9887-af867acf019f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG nova.network.neutron [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Updating instance_info_cache with network_info: [{"id": "af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8", "address": "fa:16:3e:10:e5:ed", "network": {"id": "1eeafbdd-7525-48a9-9369-706d1955dbf9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-507921951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97951b9947e47f7a891f30b978035df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3b7f5f-d9", "ovs_interfaceid": "af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Releasing lock "refresh_cache-860cb53c-f023-4c4b-9f04-7a90c8274974" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG nova.compute.manager [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Instance network_info: |[{"id": "af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8", "address": "fa:16:3e:10:e5:ed", "network": {"id": "1eeafbdd-7525-48a9-9369-706d1955dbf9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-507921951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97951b9947e47f7a891f30b978035df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3b7f5f-d9", "ovs_interfaceid": "af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-22dddf92-1838-4442-87dc-2cdee5af3541 req-c9284d72-90bf-4940-b7d1-9e3cff759b9d service nova] Acquired lock "refresh_cache-860cb53c-f023-4c4b-9f04-7a90c8274974" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG nova.network.neutron [req-22dddf92-1838-4442-87dc-2cdee5af3541 req-c9284d72-90bf-4940-b7d1-9e3cff759b9d service nova] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Refreshing network info cache for port af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8 {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Start _get_guest_xml network_info=[{"id": "af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8", "address": "fa:16:3e:10:e5:ed", "network": {"id": "1eeafbdd-7525-48a9-9369-706d1955dbf9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-507921951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97951b9947e47f7a891f30b978035df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3b7f5f-d9", "ovs_interfaceid": "af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 17:16:10 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:16:10 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:16:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "b8a52b1b-bcd0-493c-9887-af867acf019f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "b8a52b1b-bcd0-493c-9887-af867acf019f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:16:10 user nova-compute[73056]: INFO nova.compute.manager [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Attaching volume 3d49f9ea-d4e9-47a9-82e4-6302d391c0c2 to /dev/vdc
Aug 14 17:16:10 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T17:16:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-398372750',display_name='tempest-ServersNegativeTestJSON-server-398372750',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-398372750',id=49,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f97951b9947e47f7a891f30b978035df',ramdisk_id='',reservation_id='r-h8skp04x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-490931314',owner_user_name='tempest-ServersNegativeTestJSON-490931314-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T17:16:08Z,user_data=None,user_id='b0e100f63e194a008fb7a581bf54441a',uuid=860cb53c-f023-4c4b-9f04-7a90c8274974,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8", "address": "fa:16:3e:10:e5:ed", "network": {"id": "1eeafbdd-7525-48a9-9369-706d1955dbf9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-507921951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97951b9947e47f7a891f30b978035df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3b7f5f-d9", "ovs_interfaceid": "af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Converting VIF {"id": "af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8", "address": "fa:16:3e:10:e5:ed", "network": {"id": "1eeafbdd-7525-48a9-9369-706d1955dbf9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-507921951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97951b9947e47f7a891f30b978035df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3b7f5f-d9", "ovs_interfaceid": "af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:e5:ed,bridge_name='br-int',has_traffic_filtering=True,id=af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8,network=Network(1eeafbdd-7525-48a9-9369-706d1955dbf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3b7f5f-d9') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG nova.objects.instance [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Lazy-loading 'pci_devices' on Instance uuid 860cb53c-f023-4c4b-9f04-7a90c8274974 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] End _get_guest_xml xml=<domain type="kvm">
Aug 14 17:16:10 user nova-compute[73056]:   <uuid>860cb53c-f023-4c4b-9f04-7a90c8274974</uuid>
Aug 14 17:16:10 user nova-compute[73056]:   <name>instance-00000031</name>
Aug 14 17:16:10 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 17:16:10 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 17:16:10 user nova-compute[73056]:   <metadata>
Aug 14 17:16:10 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 17:16:10 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 17:16:10 user nova-compute[73056]:       <nova:name>tempest-ServersNegativeTestJSON-server-398372750</nova:name>
Aug 14 17:16:10 user nova-compute[73056]:       <nova:creationTime>2023-08-14 17:16:10</nova:creationTime>
Aug 14 17:16:10 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 17:16:10 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 17:16:10 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 17:16:10 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 17:16:10 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 17:16:10 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 17:16:10 user nova-compute[73056]:       </nova:flavor>
Aug 14 17:16:10 user nova-compute[73056]:       <nova:owner>
Aug 14 17:16:10 user nova-compute[73056]:         <nova:user uuid="b0e100f63e194a008fb7a581bf54441a">tempest-ServersNegativeTestJSON-490931314-project-member</nova:user>
Aug 14 17:16:10 user nova-compute[73056]:         <nova:project uuid="f97951b9947e47f7a891f30b978035df">tempest-ServersNegativeTestJSON-490931314</nova:project>
Aug 14 17:16:10 user nova-compute[73056]:       </nova:owner>
Aug 14 17:16:10 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 17:16:10 user nova-compute[73056]:       <nova:ports>
Aug 14 17:16:10 user nova-compute[73056]:         <nova:port uuid="af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8">
Aug 14 17:16:10 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 14 17:16:10 user nova-compute[73056]:         </nova:port>
Aug 14 17:16:10 user nova-compute[73056]:       </nova:ports>
Aug 14 17:16:10 user nova-compute[73056]:     </nova:instance>
Aug 14 17:16:10 user nova-compute[73056]:   </metadata>
Aug 14 17:16:10 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 17:16:10 user nova-compute[73056]:     <system>
Aug 14 17:16:10 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 17:16:10 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 17:16:10 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 17:16:10 user nova-compute[73056]:       <entry name="serial">860cb53c-f023-4c4b-9f04-7a90c8274974</entry>
Aug 14 17:16:10 user nova-compute[73056]:       <entry name="uuid">860cb53c-f023-4c4b-9f04-7a90c8274974</entry>
Aug 14 17:16:10 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 17:16:10 user nova-compute[73056]:     </system>
Aug 14 17:16:10 user nova-compute[73056]:   </sysinfo>
Aug 14 17:16:10 user nova-compute[73056]:   <os>
Aug 14 17:16:10 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 17:16:10 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 17:16:10 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 17:16:10 user nova-compute[73056]:   </os>
Aug 14 17:16:10 user nova-compute[73056]:   <features>
Aug 14 17:16:10 user nova-compute[73056]:     <acpi/>
Aug 14 17:16:10 user nova-compute[73056]:     <apic/>
Aug 14 17:16:10 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 17:16:10 user nova-compute[73056]:   </features>
Aug 14 17:16:10 user nova-compute[73056]:   <clock offset="utc">
Aug 14 17:16:10 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 17:16:10 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 17:16:10 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 17:16:10 user nova-compute[73056]:   </clock>
Aug 14 17:16:10 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 17:16:10 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 17:16:10 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 17:16:10 user nova-compute[73056]:   </cpu>
Aug 14 17:16:10 user nova-compute[73056]:   <devices>
Aug 14 17:16:10 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 17:16:10 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 17:16:10 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk"/>
Aug 14 17:16:10 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 17:16:10 user nova-compute[73056]:     </disk>
Aug 14 17:16:10 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 17:16:10 user nova-compute[73056]:       <mac address="fa:16:3e:10:e5:ed"/>
Aug 14 17:16:10 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 17:16:10 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 17:16:10 user nova-compute[73056]:       <target dev="tapaf3b7f5f-d9"/>
Aug 14 17:16:10 user nova-compute[73056]:     </interface>
Aug 14 17:16:10 user nova-compute[73056]:     <serial type="pty">
Aug 14 17:16:10 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/console.log" append="off"/>
Aug 14 17:16:10 user nova-compute[73056]:     </serial>
Aug 14 17:16:10 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 17:16:10 user nova-compute[73056]:     <video>
Aug 14 17:16:10 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 17:16:10 user nova-compute[73056]:     </video>
Aug 14 17:16:10 user nova-compute[73056]:     <rng model="virtio">
Aug 14 17:16:10 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 17:16:10 user nova-compute[73056]:     </rng>
Aug 14 17:16:10 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 17:16:10 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 17:16:10 user nova-compute[73056]:       <stats period="10"/>
Aug 14 17:16:10 user nova-compute[73056]:     </memballoon>
Aug 14 17:16:10 user nova-compute[73056]:   </devices>
Aug 14 17:16:10 user nova-compute[73056]: </domain>
Aug 14 17:16:10 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T17:16:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-398372750',display_name='tempest-ServersNegativeTestJSON-server-398372750',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-398372750',id=49,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f97951b9947e47f7a891f30b978035df',ramdisk_id='',reservation_id='r-h8skp04x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-490931314',owner_user_name='tempest-ServersNegativeTestJSON-490931314-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T17:16:08Z,user_data=None,user_id='b0e100f63e194a008fb7a581bf54441a',uuid=860cb53c-f023-4c4b-9f04-7a90c8274974,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8", "address": "fa:16:3e:10:e5:ed", "network": {"id": "1eeafbdd-7525-48a9-9369-706d1955dbf9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-507921951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97951b9947e47f7a891f30b978035df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3b7f5f-d9", "ovs_interfaceid": "af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Converting VIF {"id": "af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8", "address": "fa:16:3e:10:e5:ed", "network": {"id": "1eeafbdd-7525-48a9-9369-706d1955dbf9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-507921951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97951b9947e47f7a891f30b978035df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3b7f5f-d9", "ovs_interfaceid": "af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:e5:ed,bridge_name='br-int',has_traffic_filtering=True,id=af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8,network=Network(1eeafbdd-7525-48a9-9369-706d1955dbf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3b7f5f-d9') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG os_vif [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:e5:ed,bridge_name='br-int',has_traffic_filtering=True,id=af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8,network=Network(1eeafbdd-7525-48a9-9369-706d1955dbf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3b7f5f-d9') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf3b7f5f-d9, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaf3b7f5f-d9, col_values=(('external_ids', {'iface-id': 'af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:e5:ed', 'vm-uuid': '860cb53c-f023-4c4b-9f04-7a90c8274974'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:16:10 user nova-compute[73056]: INFO os_vif [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:e5:ed,bridge_name='br-int',has_traffic_filtering=True,id=af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8,network=Network(1eeafbdd-7525-48a9-9369-706d1955dbf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3b7f5f-d9')
Aug 14 17:16:10 user nova-compute[73056]: DEBUG os_brick.utils [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5b605a-aa0a-4878-9452-237cc0b24a21]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] No VIF found with MAC fa:16:3e:10:e5:ed, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7566978b-b111-4209-a5da-bd9c59de34c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f75145-2d5a-4752-a1ea-c7f16a848b42]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46b8dc9-3c38-44bc-8681-71bc2c3df672]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 17:16:10 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 17:16:10 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[db109dda-a097-4bdd-bc19-b1795137ed09]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG os_brick.utils [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 17:16:10 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Updating existing volume attachment record: 72e54d5c-d2c1-45c6-ba32-b876463d0335 {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 17:16:11 user nova-compute[73056]: DEBUG nova.network.neutron [req-22dddf92-1838-4442-87dc-2cdee5af3541 req-c9284d72-90bf-4940-b7d1-9e3cff759b9d service nova] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Updated VIF entry in instance network info cache for port af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 17:16:11 user nova-compute[73056]: DEBUG nova.network.neutron [req-22dddf92-1838-4442-87dc-2cdee5af3541 req-c9284d72-90bf-4940-b7d1-9e3cff759b9d service nova] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Updating instance_info_cache with network_info: [{"id": "af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8", "address": "fa:16:3e:10:e5:ed", "network": {"id": "1eeafbdd-7525-48a9-9369-706d1955dbf9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-507921951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97951b9947e47f7a891f30b978035df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3b7f5f-d9", "ovs_interfaceid": "af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:16:11 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-22dddf92-1838-4442-87dc-2cdee5af3541 req-c9284d72-90bf-4940-b7d1-9e3cff759b9d service nova] Releasing lock "refresh_cache-860cb53c-f023-4c4b-9f04-7a90c8274974" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:16:11 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:16:11 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:16:11 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:16:12 user nova-compute[73056]: DEBUG nova.compute.manager [req-941c06ad-c515-421c-b82a-1ab3f0b031f6 req-4df4dc5c-0092-41c0-9f56-0958b5f5b4b8 service nova] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Received event network-vif-plugged-af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:16:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-941c06ad-c515-421c-b82a-1ab3f0b031f6 req-4df4dc5c-0092-41c0-9f56-0958b5f5b4b8 service nova] Acquiring lock "860cb53c-f023-4c4b-9f04-7a90c8274974-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:16:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-941c06ad-c515-421c-b82a-1ab3f0b031f6 req-4df4dc5c-0092-41c0-9f56-0958b5f5b4b8 service nova] Lock "860cb53c-f023-4c4b-9f04-7a90c8274974-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:16:12 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-941c06ad-c515-421c-b82a-1ab3f0b031f6 req-4df4dc5c-0092-41c0-9f56-0958b5f5b4b8 service nova] Lock "860cb53c-f023-4c4b-9f04-7a90c8274974-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:16:12 user nova-compute[73056]: DEBUG nova.compute.manager [req-941c06ad-c515-421c-b82a-1ab3f0b031f6 req-4df4dc5c-0092-41c0-9f56-0958b5f5b4b8 service nova] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] No waiting events found dispatching network-vif-plugged-af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:16:12 user nova-compute[73056]: WARNING nova.compute.manager [req-941c06ad-c515-421c-b82a-1ab3f0b031f6 req-4df4dc5c-0092-41c0-9f56-0958b5f5b4b8 service nova] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Received unexpected event network-vif-plugged-af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8 for instance with vm_state building and task_state spawning.
Aug 14 17:16:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:16:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:16:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:16:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:16:14 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692033374.012405, 860cb53c-f023-4c4b-9f04-7a90c8274974 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:16:14 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] VM Resumed (Lifecycle Event)
Aug 14 17:16:14 user nova-compute[73056]: DEBUG nova.compute.manager [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 17:16:14 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 17:16:14 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Instance spawned successfully.
Aug 14 17:16:14 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 17:16:14 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:16:14 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 17:16:14 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:16:14 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:16:14 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:16:14 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:16:14 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:16:14 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:16:14 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 17:16:14 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692033374.015943, 860cb53c-f023-4c4b-9f04-7a90c8274974 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:16:14 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] VM Started (Lifecycle Event)
Aug 14 17:16:14 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:16:14 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 17:16:14 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 17:16:14 user nova-compute[73056]: INFO nova.compute.manager [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Took 5.71 seconds to spawn the instance on the hypervisor.
Aug 14 17:16:14 user nova-compute[73056]: DEBUG nova.compute.manager [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:16:14 user nova-compute[73056]: INFO nova.compute.manager [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Took 6.28 seconds to build instance.
Aug 14 17:16:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-55b12b5b-f2ec-4d65-b016-1dd654a4c87b tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Lock "860cb53c-f023-4c4b-9f04-7a90c8274974" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.402s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:16:14 user nova-compute[73056]: DEBUG nova.compute.manager [req-31c06e13-c9cf-460f-84af-a5e3fb1700e3 req-61fd9da0-9ea5-4873-b91d-eb0ec4c70d68 service nova] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Received event network-vif-plugged-af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:16:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-31c06e13-c9cf-460f-84af-a5e3fb1700e3 req-61fd9da0-9ea5-4873-b91d-eb0ec4c70d68 service nova] Acquiring lock "860cb53c-f023-4c4b-9f04-7a90c8274974-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:16:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-31c06e13-c9cf-460f-84af-a5e3fb1700e3 req-61fd9da0-9ea5-4873-b91d-eb0ec4c70d68 service nova] Lock "860cb53c-f023-4c4b-9f04-7a90c8274974-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:16:14 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-31c06e13-c9cf-460f-84af-a5e3fb1700e3 req-61fd9da0-9ea5-4873-b91d-eb0ec4c70d68 service nova] Lock "860cb53c-f023-4c4b-9f04-7a90c8274974-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:16:14 user nova-compute[73056]: DEBUG nova.compute.manager [req-31c06e13-c9cf-460f-84af-a5e3fb1700e3 req-61fd9da0-9ea5-4873-b91d-eb0ec4c70d68 service nova] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] No waiting events found dispatching network-vif-plugged-af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:16:14 user nova-compute[73056]: WARNING nova.compute.manager [req-31c06e13-c9cf-460f-84af-a5e3fb1700e3 req-61fd9da0-9ea5-4873-b91d-eb0ec4c70d68 service nova] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Received unexpected event network-vif-plugged-af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8 for instance with vm_state active and task_state None.
Aug 14 17:16:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:16:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nPgrfCqz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 17:16:19 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 17:16:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 17:16:19 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 17:16:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 17:16:19 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 17:16:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2 -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[972e2379-7165-4490-92a4-eaa0d2109d6d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 17:16:19 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2 -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a60ada5-b761-43fc-8945-8fa1e9924ad7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2] added
Aug 14 17:16:19 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[19dd0773-12ef-4bd7-b299-219c16b332bc]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b658c335-1567-4365-84e4-d5b881b7ace0]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nPgrfCqz {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nPgrfCqz" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db42845-498b-471f-918a-01d65c515623]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nPgrfCqz'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8dd8ebe-b088-45e1-9b63-8e5e19134767]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f5bb9e-da39-45be-8a2f-7738fbcaf7f9]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376 (non-flash)
Aug 14 17:16:19 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376 (non-flash)
Aug 14 17:16:19 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2 -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1e77cc-d02c-4a48-810b-68b9b98559fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2, portal: 172.16.0.220,3260]
Aug 14 17:16:19 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2, portal: 172.16.0.220,3260] successful.
Aug 14 17:16:19 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7b602f-d196-4871-948a-a97778957bce]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab94d03-e99b-47ee-b1d7-5eade451a05c]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376 (non-flash)
Aug 14 17:16:19 user nova-compute[73056]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2 (non-flash)
Aug 14 17:16:19 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376 (non-flash)
Aug 14 17:16:19 user nova-compute[73056]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2 (non-flash)
Aug 14 17:16:19 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9cf143-5f4f-4570-a0e5-a7070d95621a]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 17:16:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nPgrfCqz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 17:16:20 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:16:20 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:16:20 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 17:16:20 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 17:16:20 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26665336262613966', 'path': '/dev/sdc'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 17:16:20 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665336262613966', 'path': '/dev/sdc'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 17:16:20 user nova-compute[73056]: DEBUG nova.objects.instance [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lazy-loading 'flavor' on Instance uuid b8a52b1b-bcd0-493c-9887-af867acf019f {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:16:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:16:20 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 17:16:20 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 17:16:20 user nova-compute[73056]:   <source dev="/dev/sdc"/>
Aug 14 17:16:20 user nova-compute[73056]:   <target dev="vdc" bus="virtio"/>
Aug 14 17:16:20 user nova-compute[73056]:   <serial>3d49f9ea-d4e9-47a9-82e4-6302d391c0c2</serial>
Aug 14 17:16:20 user nova-compute[73056]: </disk>
Aug 14 17:16:20 user nova-compute[73056]:  {{(pid=73056) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 17:16:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 17:16:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 17:16:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 17:16:21 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] No VIF found with MAC fa:16:3e:99:5e:b7, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 17:16:21 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-cf0c6b9c-c497-47b4-8471-b7c64951a45f tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "b8a52b1b-bcd0-493c-9887-af867acf019f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.790s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:16:22 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:16:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c9465806-353a-4302-9fca-9b4ccec1ca41 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "b8a52b1b-bcd0-493c-9887-af867acf019f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:16:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c9465806-353a-4302-9fca-9b4ccec1ca41 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "b8a52b1b-bcd0-493c-9887-af867acf019f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:16:22 user nova-compute[73056]: INFO nova.compute.manager [None req-c9465806-353a-4302-9fca-9b4ccec1ca41 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Detaching volume 57b70cfe-3fe2-4380-951f-3f350d567376
Aug 14 17:16:22 user nova-compute[73056]: INFO nova.virt.block_device [None req-c9465806-353a-4302-9fca-9b4ccec1ca41 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Attempting to driver detach volume 57b70cfe-3fe2-4380-951f-3f350d567376 from mountpoint /dev/vdb
Aug 14 17:16:22 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-c9465806-353a-4302-9fca-9b4ccec1ca41 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Attempting to detach device vdb from instance b8a52b1b-bcd0-493c-9887-af867acf019f from the persistent domain config. {{(pid=73056) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 17:16:22 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-c9465806-353a-4302-9fca-9b4ccec1ca41 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 17:16:22 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 17:16:22 user nova-compute[73056]:   <source dev="/dev/sdb"/>
Aug 14 17:16:22 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 17:16:22 user nova-compute[73056]:   <serial>57b70cfe-3fe2-4380-951f-3f350d567376</serial>
Aug 14 17:16:22 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 17:16:22 user nova-compute[73056]: </disk>
Aug 14 17:16:22 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 17:16:22 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-c9465806-353a-4302-9fca-9b4ccec1ca41 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Successfully detached device vdb from instance b8a52b1b-bcd0-493c-9887-af867acf019f from the persistent domain config.
Aug 14 17:16:22 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-c9465806-353a-4302-9fca-9b4ccec1ca41 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b8a52b1b-bcd0-493c-9887-af867acf019f from the live domain config. {{(pid=73056) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 17:16:22 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-c9465806-353a-4302-9fca-9b4ccec1ca41 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 17:16:22 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 17:16:22 user nova-compute[73056]:   <source dev="/dev/sdb"/>
Aug 14 17:16:22 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 17:16:22 user nova-compute[73056]:   <serial>57b70cfe-3fe2-4380-951f-3f350d567376</serial>
Aug 14 17:16:22 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 17:16:22 user nova-compute[73056]: </disk>
Aug 14 17:16:22 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Received event <DeviceRemovedEvent: 1692033383.44345, b8a52b1b-bcd0-493c-9887-af867acf019f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73056) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-c9465806-353a-4302-9fca-9b4ccec1ca41 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b8a52b1b-bcd0-493c-9887-af867acf019f {{(pid=73056) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 17:16:23 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-c9465806-353a-4302-9fca-9b4ccec1ca41 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Successfully detached device vdb from instance b8a52b1b-bcd0-493c-9887-af867acf019f from the live domain config.
Aug 14 17:16:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9465806-353a-4302-9fca-9b4ccec1ca41 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9465806-353a-4302-9fca-9b4ccec1ca41 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DNQCPWac', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 17:16:23 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-c9465806-353a-4302-9fca-9b4ccec1ca41 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 17:16:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-c9465806-353a-4302-9fca-9b4ccec1ca41 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-c9465806-353a-4302-9fca-9b4ccec1ca41 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9465806-353a-4302-9fca-9b4ccec1ca41 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[747fc079-1196-4168-b55f-096c463e27bf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[9739b6f5-b52b-4afa-afde-4b4a637555ab]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9465806-353a-4302-9fca-9b4ccec1ca41 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376 (non-flash)
Aug 14 17:16:23 user nova-compute[73056]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2 (non-flash)
Aug 14 17:16:23 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9465806-353a-4302-9fca-9b4ccec1ca41 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376 (non-flash)
Aug 14 17:16:23 user nova-compute[73056]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2 (non-flash)
Aug 14 17:16:23 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9465806-353a-4302-9fca-9b4ccec1ca41 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff2dce4f400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376'): ({'sdb'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-c9465806-353a-4302-9fca-9b4ccec1ca41 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Removing single pathed devices sdb {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85fd6b0-b43f-453f-9f68-939d5e60e4e2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7cf99e6-a024-4ad1-8855-21883f46098e]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-c9465806-353a-4302-9fca-9b4ccec1ca41 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Flushing IO for device /dev/sdb {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ef4fd4-50b2-4d73-8ea0-41b407792502]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-c9465806-353a-4302-9fca-9b4ccec1ca41 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c57d542-cdfe-4694-938c-1fda8efc8610]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-c9465806-353a-4302-9fca-9b4ccec1ca41 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-c9465806-353a-4302-9fca-9b4ccec1ca41 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] SCSI volumes sdb have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9465806-353a-4302-9fca-9b4ccec1ca41 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db027e8-2c96-483b-84c6-191854175550]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9465806-353a-4302-9fca-9b4ccec1ca41 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376 -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[0730ef0e-745c-4300-bd90-d4eb2fa3acbd]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9465806-353a-4302-9fca-9b4ccec1ca41 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376, portal: 172.16.0.220,3260]
Aug 14 17:16:23 user nova-compute[73056]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376, portal: 172.16.0.220,3260] successful.
Aug 14 17:16:23 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376 -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57b70cfe-3fe2-4380-951f-3f350d567376 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42cd363-eec1-41ee-9940-4fde968ba58d]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9465806-353a-4302-9fca-9b4ccec1ca41 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-c9465806-353a-4302-9fca-9b4ccec1ca41 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.250s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9465806-353a-4302-9fca-9b4ccec1ca41 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] <== disconnect_volume: return (251ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9465806-353a-4302-9fca-9b4ccec1ca41 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 17:16:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:16:24 user nova-compute[73056]: DEBUG nova.objects.instance [None req-c9465806-353a-4302-9fca-9b4ccec1ca41 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lazy-loading 'flavor' on Instance uuid b8a52b1b-bcd0-493c-9887-af867acf019f {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:16:24 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-c9465806-353a-4302-9fca-9b4ccec1ca41 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "b8a52b1b-bcd0-493c-9887-af867acf019f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.642s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-beaf0fac-3d7f-4bfc-a4aa-9091fc57c5e1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "b8a52b1b-bcd0-493c-9887-af867acf019f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-beaf0fac-3d7f-4bfc-a4aa-9091fc57c5e1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "b8a52b1b-bcd0-493c-9887-af867acf019f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:16:25 user nova-compute[73056]: INFO nova.compute.manager [None req-beaf0fac-3d7f-4bfc-a4aa-9091fc57c5e1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Detaching volume 3d49f9ea-d4e9-47a9-82e4-6302d391c0c2
Aug 14 17:16:25 user nova-compute[73056]: INFO nova.virt.block_device [None req-beaf0fac-3d7f-4bfc-a4aa-9091fc57c5e1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Attempting to driver detach volume 3d49f9ea-d4e9-47a9-82e4-6302d391c0c2 from mountpoint /dev/vdc
Aug 14 17:16:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-beaf0fac-3d7f-4bfc-a4aa-9091fc57c5e1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Attempting to detach device vdc from instance b8a52b1b-bcd0-493c-9887-af867acf019f from the persistent domain config. {{(pid=73056) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-beaf0fac-3d7f-4bfc-a4aa-9091fc57c5e1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 17:16:25 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 17:16:25 user nova-compute[73056]:   <source dev="/dev/sdc"/>
Aug 14 17:16:25 user nova-compute[73056]:   <target dev="vdc" bus="virtio"/>
Aug 14 17:16:25 user nova-compute[73056]:   <serial>3d49f9ea-d4e9-47a9-82e4-6302d391c0c2</serial>
Aug 14 17:16:25 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 17:16:25 user nova-compute[73056]: </disk>
Aug 14 17:16:25 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Rebuilding the list of instances to heal {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 17:16:25 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-beaf0fac-3d7f-4bfc-a4aa-9091fc57c5e1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Successfully detached device vdc from instance b8a52b1b-bcd0-493c-9887-af867acf019f from the persistent domain config.
Aug 14 17:16:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-beaf0fac-3d7f-4bfc-a4aa-9091fc57c5e1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance b8a52b1b-bcd0-493c-9887-af867acf019f from the live domain config. {{(pid=73056) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-beaf0fac-3d7f-4bfc-a4aa-9091fc57c5e1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 17:16:25 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 17:16:25 user nova-compute[73056]:   <source dev="/dev/sdc"/>
Aug 14 17:16:25 user nova-compute[73056]:   <target dev="vdc" bus="virtio"/>
Aug 14 17:16:25 user nova-compute[73056]:   <serial>3d49f9ea-d4e9-47a9-82e4-6302d391c0c2</serial>
Aug 14 17:16:25 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 17:16:25 user nova-compute[73056]: </disk>
Aug 14 17:16:25 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-b8a52b1b-bcd0-493c-9887-af867acf019f" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-b8a52b1b-bcd0-493c-9887-af867acf019f" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG nova.objects.instance [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lazy-loading 'info_cache' on Instance uuid b8a52b1b-bcd0-493c-9887-af867acf019f {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Received event <DeviceRemovedEvent: 1692033385.7735796, b8a52b1b-bcd0-493c-9887-af867acf019f => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73056) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-beaf0fac-3d7f-4bfc-a4aa-9091fc57c5e1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance b8a52b1b-bcd0-493c-9887-af867acf019f {{(pid=73056) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 17:16:25 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-beaf0fac-3d7f-4bfc-a4aa-9091fc57c5e1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Successfully detached device vdc from instance b8a52b1b-bcd0-493c-9887-af867acf019f from the live domain config.
Aug 14 17:16:25 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-beaf0fac-3d7f-4bfc-a4aa-9091fc57c5e1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-beaf0fac-3d7f-4bfc-a4aa-9091fc57c5e1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nPgrfCqz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 17:16:25 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-beaf0fac-3d7f-4bfc-a4aa-9091fc57c5e1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 17:16:25 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-beaf0fac-3d7f-4bfc-a4aa-9091fc57c5e1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-beaf0fac-3d7f-4bfc-a4aa-9091fc57c5e1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-beaf0fac-3d7f-4bfc-a4aa-9091fc57c5e1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f22309-ef6a-44b3-910d-740833051ada]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce03aa9-ed70-4ec6-a928-6a06b92cb361]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-beaf0fac-3d7f-4bfc-a4aa-9091fc57c5e1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2 (non-flash)
Aug 14 17:16:25 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-beaf0fac-3d7f-4bfc-a4aa-9091fc57c5e1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2 (non-flash)
Aug 14 17:16:25 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-beaf0fac-3d7f-4bfc-a4aa-9091fc57c5e1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff30074e710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2'): ({'sdc'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-beaf0fac-3d7f-4bfc-a4aa-9091fc57c5e1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Removing single pathed devices sdc {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f0fb6c-9e17-4991-906e-4b8590cd0771]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a2b8c2-4bd8-49a4-accd-d1c1563de533]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-beaf0fac-3d7f-4bfc-a4aa-9091fc57c5e1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Flushing IO for device /dev/sdc {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Updating instance_info_cache with network_info: [{"id": "0e8b1816-285f-49ca-8fd5-3f672c8d42f9", "address": "fa:16:3e:99:5e:b7", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8b1816-28", "ovs_interfaceid": "0e8b1816-285f-49ca-8fd5-3f672c8d42f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1051bf-0f96-4bce-9844-56933f205a9d]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-beaf0fac-3d7f-4bfc-a4aa-9091fc57c5e1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-b8a52b1b-bcd0-493c-9887-af867acf019f" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21315fe-75e7-4d2c-9fe7-fb31ea4adc5b]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-beaf0fac-3d7f-4bfc-a4aa-9091fc57c5e1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-beaf0fac-3d7f-4bfc-a4aa-9091fc57c5e1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] SCSI volumes sdc have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-beaf0fac-3d7f-4bfc-a4aa-9091fc57c5e1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f98139-6f29-4fb4-81c6-73e4e2474977]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-beaf0fac-3d7f-4bfc-a4aa-9091fc57c5e1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:16:25 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2 -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:26 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c775dc-5171-4bb9-ace8-89c51c12bdff]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-beaf0fac-3d7f-4bfc-a4aa-9091fc57c5e1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2, portal: 172.16.0.220,3260]
Aug 14 17:16:26 user nova-compute[73056]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2, portal: 172.16.0.220,3260] successful.
Aug 14 17:16:26 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:16:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2 -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:26 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d49f9ea-d4e9-47a9-82e4-6302d391c0c2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:26 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62f57c2-6992-4fd8-804d-b56ca9de6866]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:16:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-beaf0fac-3d7f-4bfc-a4aa-9091fc57c5e1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:16:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-beaf0fac-3d7f-4bfc-a4aa-9091fc57c5e1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 17:16:26 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-beaf0fac-3d7f-4bfc-a4aa-9091fc57c5e1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] <== disconnect_volume: return (276ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 17:16:26 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-beaf0fac-3d7f-4bfc-a4aa-9091fc57c5e1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 17:16:26 user nova-compute[73056]: DEBUG nova.objects.instance [None req-beaf0fac-3d7f-4bfc-a4aa-9091fc57c5e1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lazy-loading 'flavor' on Instance uuid b8a52b1b-bcd0-493c-9887-af867acf019f {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:16:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-beaf0fac-3d7f-4bfc-a4aa-9091fc57c5e1 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "b8a52b1b-bcd0-493c-9887-af867acf019f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.562s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:16:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3c7c56b4-4644-477f-a740-3f3bc7660cf7 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "b8a52b1b-bcd0-493c-9887-af867acf019f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:16:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3c7c56b4-4644-477f-a740-3f3bc7660cf7 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "b8a52b1b-bcd0-493c-9887-af867acf019f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:16:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3c7c56b4-4644-477f-a740-3f3bc7660cf7 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "b8a52b1b-bcd0-493c-9887-af867acf019f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:16:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3c7c56b4-4644-477f-a740-3f3bc7660cf7 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "b8a52b1b-bcd0-493c-9887-af867acf019f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:16:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3c7c56b4-4644-477f-a740-3f3bc7660cf7 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "b8a52b1b-bcd0-493c-9887-af867acf019f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:16:27 user nova-compute[73056]: INFO nova.compute.manager [None req-3c7c56b4-4644-477f-a740-3f3bc7660cf7 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Terminating instance
Aug 14 17:16:27 user nova-compute[73056]: DEBUG nova.compute.manager [None req-3c7c56b4-4644-477f-a740-3f3bc7660cf7 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 17:16:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:16:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:16:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:16:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:16:28 user nova-compute[73056]: DEBUG nova.compute.manager [req-127605c3-b3e7-4c7d-ba08-f45a2a05760c req-50afa733-7581-4eb5-aa84-175f43a3868b service nova] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Received event network-vif-unplugged-0e8b1816-285f-49ca-8fd5-3f672c8d42f9 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:16:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-127605c3-b3e7-4c7d-ba08-f45a2a05760c req-50afa733-7581-4eb5-aa84-175f43a3868b service nova] Acquiring lock "b8a52b1b-bcd0-493c-9887-af867acf019f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:16:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-127605c3-b3e7-4c7d-ba08-f45a2a05760c req-50afa733-7581-4eb5-aa84-175f43a3868b service nova] Lock "b8a52b1b-bcd0-493c-9887-af867acf019f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:16:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-127605c3-b3e7-4c7d-ba08-f45a2a05760c req-50afa733-7581-4eb5-aa84-175f43a3868b service nova] Lock "b8a52b1b-bcd0-493c-9887-af867acf019f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:16:28 user nova-compute[73056]: DEBUG nova.compute.manager [req-127605c3-b3e7-4c7d-ba08-f45a2a05760c req-50afa733-7581-4eb5-aa84-175f43a3868b service nova] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] No waiting events found dispatching network-vif-unplugged-0e8b1816-285f-49ca-8fd5-3f672c8d42f9 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:16:28 user nova-compute[73056]: DEBUG nova.compute.manager [req-127605c3-b3e7-4c7d-ba08-f45a2a05760c req-50afa733-7581-4eb5-aa84-175f43a3868b service nova] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Received event network-vif-unplugged-0e8b1816-285f-49ca-8fd5-3f672c8d42f9 for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 17:16:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:16:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:16:28 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Instance destroyed successfully.
Aug 14 17:16:28 user nova-compute[73056]: DEBUG nova.objects.instance [None req-3c7c56b4-4644-477f-a740-3f3bc7660cf7 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lazy-loading 'resources' on Instance uuid b8a52b1b-bcd0-493c-9887-af867acf019f {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:16:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-3c7c56b4-4644-477f-a740-3f3bc7660cf7 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T17:14:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1787890632',display_name='tempest-AttachVolumeTestJSON-server-1787890632',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1787890632',id=48,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiqFQ9jmpfA1gcwScSEzYgMTzDIuvVWJ47gAgo/o3S8pUNqjBCZYJuZRMhehC2bLpzs6Ie2XYwTYMCRU31Vxai8S325VR+ZEnlIH+7eRI2hxjFhGDMJZht/qFjVmrw/vg==',key_name='tempest-keypair-932455183',keypairs=<?>,launch_index=0,launched_at=2023-08-14T17:14:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='415a7291b35546b5ac324280d37d50ae',ramdisk_id='',reservation_id='r-45450rib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-112776827',owner_user_name='tempest-AttachVolumeTestJSON-112776827-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T17:14:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bf4bfed609343c78b0d828db45d5ab7',uuid=b8a52b1b-bcd0-493c-9887-af867acf019f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e8b1816-285f-49ca-8fd5-3f672c8d42f9", "address": "fa:16:3e:99:5e:b7", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8b1816-28", "ovs_interfaceid": "0e8b1816-285f-49ca-8fd5-3f672c8d42f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 17:16:28 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-3c7c56b4-4644-477f-a740-3f3bc7660cf7 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Converting VIF {"id": "0e8b1816-285f-49ca-8fd5-3f672c8d42f9", "address": "fa:16:3e:99:5e:b7", "network": {"id": "7e2ce9fb-4bdc-441f-ae4a-30224b2712e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-15170553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415a7291b35546b5ac324280d37d50ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8b1816-28", "ovs_interfaceid": "0e8b1816-285f-49ca-8fd5-3f672c8d42f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:16:28 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-3c7c56b4-4644-477f-a740-3f3bc7660cf7 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:5e:b7,bridge_name='br-int',has_traffic_filtering=True,id=0e8b1816-285f-49ca-8fd5-3f672c8d42f9,network=Network(7e2ce9fb-4bdc-441f-ae4a-30224b2712e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e8b1816-28') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:16:28 user nova-compute[73056]: DEBUG os_vif [None req-3c7c56b4-4644-477f-a740-3f3bc7660cf7 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:5e:b7,bridge_name='br-int',has_traffic_filtering=True,id=0e8b1816-285f-49ca-8fd5-3f672c8d42f9,network=Network(7e2ce9fb-4bdc-441f-ae4a-30224b2712e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e8b1816-28') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 17:16:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:16:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e8b1816-28, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:16:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:16:28 user nova-compute[73056]: INFO os_vif [None req-3c7c56b4-4644-477f-a740-3f3bc7660cf7 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:5e:b7,bridge_name='br-int',has_traffic_filtering=True,id=0e8b1816-285f-49ca-8fd5-3f672c8d42f9,network=Network(7e2ce9fb-4bdc-441f-ae4a-30224b2712e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e8b1816-28')
Aug 14 17:16:28 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-3c7c56b4-4644-477f-a740-3f3bc7660cf7 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Deleting instance files /opt/stack/data/nova/instances/b8a52b1b-bcd0-493c-9887-af867acf019f_del
Aug 14 17:16:28 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-3c7c56b4-4644-477f-a740-3f3bc7660cf7 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Deletion of /opt/stack/data/nova/instances/b8a52b1b-bcd0-493c-9887-af867acf019f_del complete
Aug 14 17:16:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:16:28 user nova-compute[73056]: INFO nova.compute.manager [None req-3c7c56b4-4644-477f-a740-3f3bc7660cf7 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 14 17:16:28 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-3c7c56b4-4644-477f-a740-3f3bc7660cf7 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 17:16:28 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 17:16:28 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 17:16:29 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:16:29 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:16:29 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:16:29 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Took 0.96 seconds to deallocate network for instance.
Aug 14 17:16:29 user nova-compute[73056]: DEBUG nova.compute.manager [req-f6fffd9e-e9ba-4001-8d9e-1c66cdf5c307 req-8e9e02cf-0967-4abf-bfbf-a27cc1c747a5 service nova] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Received event network-vif-deleted-0e8b1816-285f-49ca-8fd5-3f672c8d42f9 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:16:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3c7c56b4-4644-477f-a740-3f3bc7660cf7 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:16:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3c7c56b4-4644-477f-a740-3f3bc7660cf7 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:16:29 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-3c7c56b4-4644-477f-a740-3f3bc7660cf7 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:16:29 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-3c7c56b4-4644-477f-a740-3f3bc7660cf7 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:16:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3c7c56b4-4644-477f-a740-3f3bc7660cf7 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.143s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:16:30 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-3c7c56b4-4644-477f-a740-3f3bc7660cf7 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Deleted allocations for instance b8a52b1b-bcd0-493c-9887-af867acf019f
Aug 14 17:16:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3c7c56b4-4644-477f-a740-3f3bc7660cf7 tempest-AttachVolumeTestJSON-112776827 tempest-AttachVolumeTestJSON-112776827-project-member] Lock "b8a52b1b-bcd0-493c-9887-af867acf019f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.189s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:16:30 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:16:30 user nova-compute[73056]: DEBUG nova.compute.manager [req-d1078b0b-6251-4e98-bc51-60bf5910612e req-afce7ca7-2231-4dc4-9469-a386f6646023 service nova] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Received event network-vif-plugged-0e8b1816-285f-49ca-8fd5-3f672c8d42f9 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:16:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-d1078b0b-6251-4e98-bc51-60bf5910612e req-afce7ca7-2231-4dc4-9469-a386f6646023 service nova] Acquiring lock "b8a52b1b-bcd0-493c-9887-af867acf019f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:16:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-d1078b0b-6251-4e98-bc51-60bf5910612e req-afce7ca7-2231-4dc4-9469-a386f6646023 service nova] Lock "b8a52b1b-bcd0-493c-9887-af867acf019f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:16:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-d1078b0b-6251-4e98-bc51-60bf5910612e req-afce7ca7-2231-4dc4-9469-a386f6646023 service nova] Lock "b8a52b1b-bcd0-493c-9887-af867acf019f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:16:30 user nova-compute[73056]: DEBUG nova.compute.manager [req-d1078b0b-6251-4e98-bc51-60bf5910612e req-afce7ca7-2231-4dc4-9469-a386f6646023 service nova] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] No waiting events found dispatching network-vif-plugged-0e8b1816-285f-49ca-8fd5-3f672c8d42f9 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:16:30 user nova-compute[73056]: WARNING nova.compute.manager [req-d1078b0b-6251-4e98-bc51-60bf5910612e req-afce7ca7-2231-4dc4-9469-a386f6646023 service nova] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Received unexpected event network-vif-plugged-0e8b1816-285f-49ca-8fd5-3f672c8d42f9 for instance with vm_state deleted and task_state None.
Aug 14 17:16:32 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:16:33 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:16:33 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:16:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:16:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:16:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:16:33 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 17:16:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:16:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:16:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:16:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:16:34 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:16:34 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:16:34 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=8667MB free_disk=25.173404693603516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 17:16:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:16:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:16:34 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 860cb53c-f023-4c4b-9f04-7a90c8274974 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:16:34 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 17:16:34 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 17:16:34 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:16:34 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:16:34 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 17:16:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.196s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:16:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:16:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:16:43 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692033388.731777, b8a52b1b-bcd0-493c-9887-af867acf019f => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:16:43 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] VM Stopped (Lifecycle Event)
Aug 14 17:16:43 user nova-compute[73056]: DEBUG nova.compute.manager [None req-451bfb7a-6571-451e-a9c8-db98c4cb5498 None None] [instance: b8a52b1b-bcd0-493c-9887-af867acf019f] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:16:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:16:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:16:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:16:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:16:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:16:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:16:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:16:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:16:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:16:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:16:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:17:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:17:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:17:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:17:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:17:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:17:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:17:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:17:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:17:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:17:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:17:20 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:17:20 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:17:20 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 17:17:20 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:17:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:17:24 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:17:25 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:17:25 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 17:17:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-860cb53c-f023-4c4b-9f04-7a90c8274974" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:17:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-860cb53c-f023-4c4b-9f04-7a90c8274974" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:17:25 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 17:17:25 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Updating instance_info_cache with network_info: [{"id": "af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8", "address": "fa:16:3e:10:e5:ed", "network": {"id": "1eeafbdd-7525-48a9-9369-706d1955dbf9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-507921951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97951b9947e47f7a891f30b978035df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3b7f5f-d9", "ovs_interfaceid": "af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:17:25 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-860cb53c-f023-4c4b-9f04-7a90c8274974" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:17:25 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 17:17:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:17:29 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:17:29 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:17:29 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73056) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 17:17:30 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:17:32 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:17:33 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:17:33 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:17:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:17:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:17:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:17:33 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 17:17:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:17:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:17:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:17:33 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:17:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:17:34 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:17:34 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:17:34 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=8720MB free_disk=25.170753479003906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 17:17:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:17:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:17:34 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 860cb53c-f023-4c4b-9f04-7a90c8274974 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:17:34 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 17:17:34 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 17:17:34 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:17:34 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:17:34 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 17:17:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.360s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:17:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:17:39 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:17:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:17:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:17:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:17:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:17:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:17:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:17:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:17:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:17:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:17:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Acquiring lock "5ac14b1f-c5dd-4ded-9969-fc51264fe514" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:17:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Lock "5ac14b1f-c5dd-4ded-9969-fc51264fe514" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:17:59 user nova-compute[73056]: DEBUG nova.compute.manager [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 17:17:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:17:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:17:59 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 17:17:59 user nova-compute[73056]: INFO nova.compute.claims [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Claim successful on node user
Aug 14 17:17:59 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:17:59 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:17:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.224s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:17:59 user nova-compute[73056]: DEBUG nova.compute.manager [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 17:17:59 user nova-compute[73056]: DEBUG nova.compute.manager [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 17:17:59 user nova-compute[73056]: DEBUG nova.network.neutron [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 17:17:59 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 17:17:59 user nova-compute[73056]: DEBUG nova.compute.manager [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 17:17:59 user nova-compute[73056]: DEBUG nova.policy [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b0e100f63e194a008fb7a581bf54441a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97951b9947e47f7a891f30b978035df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 17:17:59 user nova-compute[73056]: DEBUG nova.compute.manager [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 17:17:59 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 17:17:59 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Creating image(s)
Aug 14 17:17:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Acquiring lock "/opt/stack/data/nova/instances/5ac14b1f-c5dd-4ded-9969-fc51264fe514/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:17:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Lock "/opt/stack/data/nova/instances/5ac14b1f-c5dd-4ded-9969-fc51264fe514/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:17:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Lock "/opt/stack/data/nova/instances/5ac14b1f-c5dd-4ded-9969-fc51264fe514/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:17:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:17:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.178s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:17:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Acquiring lock "c889592ab94cd0b0ce896f27a2af0323771db234" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:17:59 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:17:59 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:18:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.193s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:18:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/5ac14b1f-c5dd-4ded-9969-fc51264fe514/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:18:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/5ac14b1f-c5dd-4ded-9969-fc51264fe514/disk 1073741824" returned: 0 in 0.051s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:18:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:18:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:18:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.181s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:18:00 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5ac14b1f-c5dd-4ded-9969-fc51264fe514/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 17:18:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac14b1f-c5dd-4ded-9969-fc51264fe514/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:18:00 user nova-compute[73056]: DEBUG nova.network.neutron [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Successfully created port: 574aff47-4a76-4c11-9e42-4d1361c9918a {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 17:18:00 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac14b1f-c5dd-4ded-9969-fc51264fe514/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:18:00 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Cannot resize image /opt/stack/data/nova/instances/5ac14b1f-c5dd-4ded-9969-fc51264fe514/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 17:18:00 user nova-compute[73056]: DEBUG nova.objects.instance [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Lazy-loading 'migration_context' on Instance uuid 5ac14b1f-c5dd-4ded-9969-fc51264fe514 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:18:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 17:18:00 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Ensure instance console log exists: /opt/stack/data/nova/instances/5ac14b1f-c5dd-4ded-9969-fc51264fe514/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 17:18:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:18:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:18:00 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:18:01 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:18:01 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Cleaning up deleted instances {{(pid=73056) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 17:18:01 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] There are 0 instances to clean {{(pid=73056) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 17:18:01 user nova-compute[73056]: DEBUG nova.network.neutron [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Successfully updated port: 574aff47-4a76-4c11-9e42-4d1361c9918a {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 17:18:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Acquiring lock "refresh_cache-5ac14b1f-c5dd-4ded-9969-fc51264fe514" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:18:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Acquired lock "refresh_cache-5ac14b1f-c5dd-4ded-9969-fc51264fe514" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:18:01 user nova-compute[73056]: DEBUG nova.network.neutron [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 17:18:01 user nova-compute[73056]: DEBUG nova.compute.manager [req-706a0df3-0ff6-44b6-9bc3-eb5b504962fb req-d3fb0b5c-3dd1-4c70-afd7-c08f94d16818 service nova] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Received event network-changed-574aff47-4a76-4c11-9e42-4d1361c9918a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:18:01 user nova-compute[73056]: DEBUG nova.compute.manager [req-706a0df3-0ff6-44b6-9bc3-eb5b504962fb req-d3fb0b5c-3dd1-4c70-afd7-c08f94d16818 service nova] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Refreshing instance network info cache due to event network-changed-574aff47-4a76-4c11-9e42-4d1361c9918a. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 17:18:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-706a0df3-0ff6-44b6-9bc3-eb5b504962fb req-d3fb0b5c-3dd1-4c70-afd7-c08f94d16818 service nova] Acquiring lock "refresh_cache-5ac14b1f-c5dd-4ded-9969-fc51264fe514" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:18:01 user nova-compute[73056]: DEBUG nova.network.neutron [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 17:18:01 user nova-compute[73056]: DEBUG nova.network.neutron [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Updating instance_info_cache with network_info: [{"id": "574aff47-4a76-4c11-9e42-4d1361c9918a", "address": "fa:16:3e:26:ad:6b", "network": {"id": "1eeafbdd-7525-48a9-9369-706d1955dbf9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-507921951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97951b9947e47f7a891f30b978035df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap574aff47-4a", "ovs_interfaceid": "574aff47-4a76-4c11-9e42-4d1361c9918a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:18:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Releasing lock "refresh_cache-5ac14b1f-c5dd-4ded-9969-fc51264fe514" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:18:01 user nova-compute[73056]: DEBUG nova.compute.manager [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Instance network_info: |[{"id": "574aff47-4a76-4c11-9e42-4d1361c9918a", "address": "fa:16:3e:26:ad:6b", "network": {"id": "1eeafbdd-7525-48a9-9369-706d1955dbf9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-507921951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97951b9947e47f7a891f30b978035df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap574aff47-4a", "ovs_interfaceid": "574aff47-4a76-4c11-9e42-4d1361c9918a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 17:18:01 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-706a0df3-0ff6-44b6-9bc3-eb5b504962fb req-d3fb0b5c-3dd1-4c70-afd7-c08f94d16818 service nova] Acquired lock "refresh_cache-5ac14b1f-c5dd-4ded-9969-fc51264fe514" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:18:01 user nova-compute[73056]: DEBUG nova.network.neutron [req-706a0df3-0ff6-44b6-9bc3-eb5b504962fb req-d3fb0b5c-3dd1-4c70-afd7-c08f94d16818 service nova] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Refreshing network info cache for port 574aff47-4a76-4c11-9e42-4d1361c9918a {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 17:18:01 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Start _get_guest_xml network_info=[{"id": "574aff47-4a76-4c11-9e42-4d1361c9918a", "address": "fa:16:3e:26:ad:6b", "network": {"id": "1eeafbdd-7525-48a9-9369-706d1955dbf9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-507921951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97951b9947e47f7a891f30b978035df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap574aff47-4a", "ovs_interfaceid": "574aff47-4a76-4c11-9e42-4d1361c9918a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 17:18:01 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:18:01 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:18:01 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 17:18:01 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 17:18:01 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 17:18:01 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 17:18:01 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 17:18:01 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 17:18:01 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 17:18:01 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 17:18:01 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 17:18:01 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 17:18:01 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 17:18:01 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 17:18:01 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 17:18:01 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 17:18:01 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 17:18:01 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 17:18:01 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T17:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1732497550',display_name='tempest-ServersNegativeTestJSON-server-1732497550',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1732497550',id=50,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f97951b9947e47f7a891f30b978035df',ramdisk_id='',reservation_id='r-hchsx67x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-490931314',owner_user_name='tempest-ServersNegativeTestJSON-490931314-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T17:18:00Z,user_data=None,user_id='b0e100f63e194a008fb7a581bf54441a',uuid=5ac14b1f-c5dd-4ded-9969-fc51264fe514,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "574aff47-4a76-4c11-9e42-4d1361c9918a", "address": "fa:16:3e:26:ad:6b", "network": {"id": "1eeafbdd-7525-48a9-9369-706d1955dbf9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-507921951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97951b9947e47f7a891f30b978035df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap574aff47-4a", "ovs_interfaceid": "574aff47-4a76-4c11-9e42-4d1361c9918a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 17:18:01 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Converting VIF {"id": "574aff47-4a76-4c11-9e42-4d1361c9918a", "address": "fa:16:3e:26:ad:6b", "network": {"id": "1eeafbdd-7525-48a9-9369-706d1955dbf9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-507921951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97951b9947e47f7a891f30b978035df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap574aff47-4a", "ovs_interfaceid": "574aff47-4a76-4c11-9e42-4d1361c9918a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:18:01 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:ad:6b,bridge_name='br-int',has_traffic_filtering=True,id=574aff47-4a76-4c11-9e42-4d1361c9918a,network=Network(1eeafbdd-7525-48a9-9369-706d1955dbf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap574aff47-4a') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:18:01 user nova-compute[73056]: DEBUG nova.objects.instance [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Lazy-loading 'pci_devices' on Instance uuid 5ac14b1f-c5dd-4ded-9969-fc51264fe514 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:18:01 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] End _get_guest_xml xml=<domain type="kvm">
Aug 14 17:18:01 user nova-compute[73056]:   <uuid>5ac14b1f-c5dd-4ded-9969-fc51264fe514</uuid>
Aug 14 17:18:01 user nova-compute[73056]:   <name>instance-00000032</name>
Aug 14 17:18:01 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 17:18:01 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 17:18:01 user nova-compute[73056]:   <metadata>
Aug 14 17:18:01 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 17:18:01 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 17:18:01 user nova-compute[73056]:       <nova:name>tempest-ServersNegativeTestJSON-server-1732497550</nova:name>
Aug 14 17:18:01 user nova-compute[73056]:       <nova:creationTime>2023-08-14 17:18:01</nova:creationTime>
Aug 14 17:18:01 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 17:18:01 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 17:18:01 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 17:18:01 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 17:18:01 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 17:18:01 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 17:18:01 user nova-compute[73056]:       </nova:flavor>
Aug 14 17:18:01 user nova-compute[73056]:       <nova:owner>
Aug 14 17:18:01 user nova-compute[73056]:         <nova:user uuid="b0e100f63e194a008fb7a581bf54441a">tempest-ServersNegativeTestJSON-490931314-project-member</nova:user>
Aug 14 17:18:01 user nova-compute[73056]:         <nova:project uuid="f97951b9947e47f7a891f30b978035df">tempest-ServersNegativeTestJSON-490931314</nova:project>
Aug 14 17:18:01 user nova-compute[73056]:       </nova:owner>
Aug 14 17:18:01 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 17:18:01 user nova-compute[73056]:       <nova:ports>
Aug 14 17:18:01 user nova-compute[73056]:         <nova:port uuid="574aff47-4a76-4c11-9e42-4d1361c9918a">
Aug 14 17:18:01 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 17:18:01 user nova-compute[73056]:         </nova:port>
Aug 14 17:18:01 user nova-compute[73056]:       </nova:ports>
Aug 14 17:18:01 user nova-compute[73056]:     </nova:instance>
Aug 14 17:18:01 user nova-compute[73056]:   </metadata>
Aug 14 17:18:01 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 17:18:01 user nova-compute[73056]:     <system>
Aug 14 17:18:01 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 17:18:01 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 17:18:01 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 17:18:01 user nova-compute[73056]:       <entry name="serial">5ac14b1f-c5dd-4ded-9969-fc51264fe514</entry>
Aug 14 17:18:01 user nova-compute[73056]:       <entry name="uuid">5ac14b1f-c5dd-4ded-9969-fc51264fe514</entry>
Aug 14 17:18:01 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 17:18:01 user nova-compute[73056]:     </system>
Aug 14 17:18:01 user nova-compute[73056]:   </sysinfo>
Aug 14 17:18:01 user nova-compute[73056]:   <os>
Aug 14 17:18:01 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 17:18:01 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 17:18:01 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 17:18:01 user nova-compute[73056]:   </os>
Aug 14 17:18:01 user nova-compute[73056]:   <features>
Aug 14 17:18:01 user nova-compute[73056]:     <acpi/>
Aug 14 17:18:01 user nova-compute[73056]:     <apic/>
Aug 14 17:18:01 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 17:18:01 user nova-compute[73056]:   </features>
Aug 14 17:18:01 user nova-compute[73056]:   <clock offset="utc">
Aug 14 17:18:01 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 17:18:01 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 17:18:01 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 17:18:01 user nova-compute[73056]:   </clock>
Aug 14 17:18:01 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 17:18:01 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 17:18:01 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 17:18:01 user nova-compute[73056]:   </cpu>
Aug 14 17:18:01 user nova-compute[73056]:   <devices>
Aug 14 17:18:01 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 17:18:01 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 17:18:01 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/5ac14b1f-c5dd-4ded-9969-fc51264fe514/disk"/>
Aug 14 17:18:01 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 17:18:01 user nova-compute[73056]:     </disk>
Aug 14 17:18:01 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 17:18:01 user nova-compute[73056]:       <mac address="fa:16:3e:26:ad:6b"/>
Aug 14 17:18:01 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 17:18:01 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 17:18:01 user nova-compute[73056]:       <target dev="tap574aff47-4a"/>
Aug 14 17:18:01 user nova-compute[73056]:     </interface>
Aug 14 17:18:01 user nova-compute[73056]:     <serial type="pty">
Aug 14 17:18:01 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/5ac14b1f-c5dd-4ded-9969-fc51264fe514/console.log" append="off"/>
Aug 14 17:18:01 user nova-compute[73056]:     </serial>
Aug 14 17:18:01 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 17:18:01 user nova-compute[73056]:     <video>
Aug 14 17:18:01 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 17:18:01 user nova-compute[73056]:     </video>
Aug 14 17:18:01 user nova-compute[73056]:     <rng model="virtio">
Aug 14 17:18:01 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 17:18:01 user nova-compute[73056]:     </rng>
Aug 14 17:18:01 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 17:18:01 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 17:18:01 user nova-compute[73056]:       <stats period="10"/>
Aug 14 17:18:01 user nova-compute[73056]:     </memballoon>
Aug 14 17:18:01 user nova-compute[73056]:   </devices>
Aug 14 17:18:01 user nova-compute[73056]: </domain>
Aug 14 17:18:01 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 17:18:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T17:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1732497550',display_name='tempest-ServersNegativeTestJSON-server-1732497550',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1732497550',id=50,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f97951b9947e47f7a891f30b978035df',ramdisk_id='',reservation_id='r-hchsx67x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-490931314',owner_user_name='tempest-ServersNegativeTestJSON-490931314-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T17:18:00Z,user_data=None,user_id='b0e100f63e194a008fb7a581bf54441a',uuid=5ac14b1f-c5dd-4ded-9969-fc51264fe514,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "574aff47-4a76-4c11-9e42-4d1361c9918a", "address": "fa:16:3e:26:ad:6b", "network": {"id": "1eeafbdd-7525-48a9-9369-706d1955dbf9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-507921951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97951b9947e47f7a891f30b978035df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap574aff47-4a", "ovs_interfaceid": "574aff47-4a76-4c11-9e42-4d1361c9918a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 17:18:02 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Converting VIF {"id": "574aff47-4a76-4c11-9e42-4d1361c9918a", "address": "fa:16:3e:26:ad:6b", "network": {"id": "1eeafbdd-7525-48a9-9369-706d1955dbf9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-507921951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97951b9947e47f7a891f30b978035df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap574aff47-4a", "ovs_interfaceid": "574aff47-4a76-4c11-9e42-4d1361c9918a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:18:02 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:ad:6b,bridge_name='br-int',has_traffic_filtering=True,id=574aff47-4a76-4c11-9e42-4d1361c9918a,network=Network(1eeafbdd-7525-48a9-9369-706d1955dbf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap574aff47-4a') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:18:02 user nova-compute[73056]: DEBUG os_vif [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:ad:6b,bridge_name='br-int',has_traffic_filtering=True,id=574aff47-4a76-4c11-9e42-4d1361c9918a,network=Network(1eeafbdd-7525-48a9-9369-706d1955dbf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap574aff47-4a') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 17:18:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:18:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:18:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 17:18:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:18:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap574aff47-4a, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:18:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap574aff47-4a, col_values=(('external_ids', {'iface-id': '574aff47-4a76-4c11-9e42-4d1361c9918a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:ad:6b', 'vm-uuid': '5ac14b1f-c5dd-4ded-9969-fc51264fe514'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:18:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:18:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:18:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:18:02 user nova-compute[73056]: INFO os_vif [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:ad:6b,bridge_name='br-int',has_traffic_filtering=True,id=574aff47-4a76-4c11-9e42-4d1361c9918a,network=Network(1eeafbdd-7525-48a9-9369-706d1955dbf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap574aff47-4a')
Aug 14 17:18:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 17:18:02 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] No VIF found with MAC fa:16:3e:26:ad:6b, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 17:18:02 user nova-compute[73056]: DEBUG nova.network.neutron [req-706a0df3-0ff6-44b6-9bc3-eb5b504962fb req-d3fb0b5c-3dd1-4c70-afd7-c08f94d16818 service nova] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Updated VIF entry in instance network info cache for port 574aff47-4a76-4c11-9e42-4d1361c9918a. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 17:18:02 user nova-compute[73056]: DEBUG nova.network.neutron [req-706a0df3-0ff6-44b6-9bc3-eb5b504962fb req-d3fb0b5c-3dd1-4c70-afd7-c08f94d16818 service nova] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Updating instance_info_cache with network_info: [{"id": "574aff47-4a76-4c11-9e42-4d1361c9918a", "address": "fa:16:3e:26:ad:6b", "network": {"id": "1eeafbdd-7525-48a9-9369-706d1955dbf9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-507921951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97951b9947e47f7a891f30b978035df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap574aff47-4a", "ovs_interfaceid": "574aff47-4a76-4c11-9e42-4d1361c9918a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:18:02 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-706a0df3-0ff6-44b6-9bc3-eb5b504962fb req-d3fb0b5c-3dd1-4c70-afd7-c08f94d16818 service nova] Releasing lock "refresh_cache-5ac14b1f-c5dd-4ded-9969-fc51264fe514" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:18:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:18:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:18:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:18:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:18:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:18:03 user nova-compute[73056]: DEBUG nova.compute.manager [req-d084be1d-2ea8-4688-9457-6d84a3949323 req-8e948d08-46bb-4a5f-8b9e-f5f7a6e5a60e service nova] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Received event network-vif-plugged-574aff47-4a76-4c11-9e42-4d1361c9918a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:18:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-d084be1d-2ea8-4688-9457-6d84a3949323 req-8e948d08-46bb-4a5f-8b9e-f5f7a6e5a60e service nova] Acquiring lock "5ac14b1f-c5dd-4ded-9969-fc51264fe514-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:18:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-d084be1d-2ea8-4688-9457-6d84a3949323 req-8e948d08-46bb-4a5f-8b9e-f5f7a6e5a60e service nova] Lock "5ac14b1f-c5dd-4ded-9969-fc51264fe514-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:18:03 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-d084be1d-2ea8-4688-9457-6d84a3949323 req-8e948d08-46bb-4a5f-8b9e-f5f7a6e5a60e service nova] Lock "5ac14b1f-c5dd-4ded-9969-fc51264fe514-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:18:03 user nova-compute[73056]: DEBUG nova.compute.manager [req-d084be1d-2ea8-4688-9457-6d84a3949323 req-8e948d08-46bb-4a5f-8b9e-f5f7a6e5a60e service nova] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] No waiting events found dispatching network-vif-plugged-574aff47-4a76-4c11-9e42-4d1361c9918a {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:18:03 user nova-compute[73056]: WARNING nova.compute.manager [req-d084be1d-2ea8-4688-9457-6d84a3949323 req-8e948d08-46bb-4a5f-8b9e-f5f7a6e5a60e service nova] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Received unexpected event network-vif-plugged-574aff47-4a76-4c11-9e42-4d1361c9918a for instance with vm_state building and task_state spawning.
Aug 14 17:18:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:18:05 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692033485.5494697, 5ac14b1f-c5dd-4ded-9969-fc51264fe514 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:18:05 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] VM Resumed (Lifecycle Event)
Aug 14 17:18:05 user nova-compute[73056]: DEBUG nova.compute.manager [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 17:18:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 17:18:05 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Instance spawned successfully.
Aug 14 17:18:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 17:18:05 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:18:05 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 17:18:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:18:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:18:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:18:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:18:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:18:05 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:18:05 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 17:18:05 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692033485.5550086, 5ac14b1f-c5dd-4ded-9969-fc51264fe514 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:18:05 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] VM Started (Lifecycle Event)
Aug 14 17:18:05 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:18:05 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 17:18:05 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 17:18:05 user nova-compute[73056]: INFO nova.compute.manager [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Took 6.00 seconds to spawn the instance on the hypervisor.
Aug 14 17:18:05 user nova-compute[73056]: DEBUG nova.compute.manager [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:18:05 user nova-compute[73056]: DEBUG nova.compute.manager [req-e0b0df84-7a91-4d34-8a07-08cd1d1a2597 req-63b5792a-5c0d-4964-8d3c-b886ef9fff7e service nova] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Received event network-vif-plugged-574aff47-4a76-4c11-9e42-4d1361c9918a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:18:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e0b0df84-7a91-4d34-8a07-08cd1d1a2597 req-63b5792a-5c0d-4964-8d3c-b886ef9fff7e service nova] Acquiring lock "5ac14b1f-c5dd-4ded-9969-fc51264fe514-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:18:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e0b0df84-7a91-4d34-8a07-08cd1d1a2597 req-63b5792a-5c0d-4964-8d3c-b886ef9fff7e service nova] Lock "5ac14b1f-c5dd-4ded-9969-fc51264fe514-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:18:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e0b0df84-7a91-4d34-8a07-08cd1d1a2597 req-63b5792a-5c0d-4964-8d3c-b886ef9fff7e service nova] Lock "5ac14b1f-c5dd-4ded-9969-fc51264fe514-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:18:05 user nova-compute[73056]: DEBUG nova.compute.manager [req-e0b0df84-7a91-4d34-8a07-08cd1d1a2597 req-63b5792a-5c0d-4964-8d3c-b886ef9fff7e service nova] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] No waiting events found dispatching network-vif-plugged-574aff47-4a76-4c11-9e42-4d1361c9918a {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:18:05 user nova-compute[73056]: WARNING nova.compute.manager [req-e0b0df84-7a91-4d34-8a07-08cd1d1a2597 req-63b5792a-5c0d-4964-8d3c-b886ef9fff7e service nova] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Received unexpected event network-vif-plugged-574aff47-4a76-4c11-9e42-4d1361c9918a for instance with vm_state building and task_state spawning.
Aug 14 17:18:05 user nova-compute[73056]: INFO nova.compute.manager [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Took 6.54 seconds to build instance.
Aug 14 17:18:05 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2449f105-2a0d-4706-b6f7-fdaae8032dac tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Lock "5ac14b1f-c5dd-4ded-9969-fc51264fe514" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.643s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:18:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:18:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:18:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:18:20 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:18:20 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:18:20 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 17:18:22 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:18:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:18:26 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:18:26 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:18:26 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 17:18:26 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Rebuilding the list of instances to heal {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 17:18:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-860cb53c-f023-4c4b-9f04-7a90c8274974" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:18:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-860cb53c-f023-4c4b-9f04-7a90c8274974" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:18:26 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 17:18:26 user nova-compute[73056]: DEBUG nova.objects.instance [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lazy-loading 'info_cache' on Instance uuid 860cb53c-f023-4c4b-9f04-7a90c8274974 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:18:26 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Updating instance_info_cache with network_info: [{"id": "af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8", "address": "fa:16:3e:10:e5:ed", "network": {"id": "1eeafbdd-7525-48a9-9369-706d1955dbf9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-507921951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97951b9947e47f7a891f30b978035df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3b7f5f-d9", "ovs_interfaceid": "af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:18:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-860cb53c-f023-4c4b-9f04-7a90c8274974" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:18:27 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 17:18:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:18:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:18:30 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:18:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:18:32 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:18:33 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:18:33 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:18:33 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:18:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:18:34 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:18:34 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:18:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:18:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:18:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:18:34 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 17:18:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac14b1f-c5dd-4ded-9969-fc51264fe514/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:18:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac14b1f-c5dd-4ded-9969-fc51264fe514/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:18:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac14b1f-c5dd-4ded-9969-fc51264fe514/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:18:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac14b1f-c5dd-4ded-9969-fc51264fe514/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:18:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:18:35 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:18:35 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:18:35 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:18:35 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:18:35 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:18:35 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=8560MB free_disk=25.140052795410156GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 17:18:35 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:18:35 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:18:35 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 860cb53c-f023-4c4b-9f04-7a90c8274974 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:18:35 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 5ac14b1f-c5dd-4ded-9969-fc51264fe514 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:18:35 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 17:18:35 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 17:18:35 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Refreshing inventories for resource provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 17:18:35 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Updating ProviderTree inventory for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 17:18:35 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Updating inventory in ProviderTree for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 17:18:35 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Refreshing aggregate associations for resource provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b, aggregates: None {{(pid=73056) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 17:18:35 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Refreshing trait associations for resource provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=73056) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 17:18:35 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:18:35 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:18:35 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 17:18:35 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.372s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:18:37 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:18:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:18:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:18:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:18:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:18:57 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:19:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:19:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:19:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:19:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:19:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:19:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:19:02 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:19:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:19:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:19:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:19:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:19:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:19:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:19:12 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:19:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:19:22 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:19:22 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:19:22 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:19:22 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 17:19:26 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:19:26 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 17:19:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-5ac14b1f-c5dd-4ded-9969-fc51264fe514" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:19:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-5ac14b1f-c5dd-4ded-9969-fc51264fe514" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:19:26 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 17:19:26 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Updating instance_info_cache with network_info: [{"id": "574aff47-4a76-4c11-9e42-4d1361c9918a", "address": "fa:16:3e:26:ad:6b", "network": {"id": "1eeafbdd-7525-48a9-9369-706d1955dbf9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-507921951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97951b9947e47f7a891f30b978035df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap574aff47-4a", "ovs_interfaceid": "574aff47-4a76-4c11-9e42-4d1361c9918a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:19:26 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-5ac14b1f-c5dd-4ded-9969-fc51264fe514" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:19:26 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 17:19:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:19:27 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:19:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:19:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:19:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:19:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:19:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:19:32 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:19:32 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:19:33 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:19:33 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:19:34 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:19:34 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:19:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:19:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:19:34 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:19:34 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 17:19:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac14b1f-c5dd-4ded-9969-fc51264fe514/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:19:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac14b1f-c5dd-4ded-9969-fc51264fe514/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:19:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac14b1f-c5dd-4ded-9969-fc51264fe514/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:19:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac14b1f-c5dd-4ded-9969-fc51264fe514/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:19:34 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:19:35 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:19:35 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:19:35 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:19:35 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:19:35 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:19:35 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=8699MB free_disk=25.13912582397461GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 17:19:35 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:19:35 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:19:35 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 860cb53c-f023-4c4b-9f04-7a90c8274974 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:19:35 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 5ac14b1f-c5dd-4ded-9969-fc51264fe514 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:19:35 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 17:19:35 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 17:19:35 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:19:35 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:19:35 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 17:19:35 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:19:37 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:19:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:19:47 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:19:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-1aabb14f-4982-4c8e-910e-2539941ec0ff tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Acquiring lock "5ac14b1f-c5dd-4ded-9969-fc51264fe514" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:19:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-1aabb14f-4982-4c8e-910e-2539941ec0ff tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Lock "5ac14b1f-c5dd-4ded-9969-fc51264fe514" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:19:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-1aabb14f-4982-4c8e-910e-2539941ec0ff tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Acquiring lock "5ac14b1f-c5dd-4ded-9969-fc51264fe514-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:19:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-1aabb14f-4982-4c8e-910e-2539941ec0ff tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Lock "5ac14b1f-c5dd-4ded-9969-fc51264fe514-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:19:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-1aabb14f-4982-4c8e-910e-2539941ec0ff tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Lock "5ac14b1f-c5dd-4ded-9969-fc51264fe514-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.003s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:19:49 user nova-compute[73056]: INFO nova.compute.manager [None req-1aabb14f-4982-4c8e-910e-2539941ec0ff tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Terminating instance
Aug 14 17:19:49 user nova-compute[73056]: DEBUG nova.compute.manager [None req-1aabb14f-4982-4c8e-910e-2539941ec0ff tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 17:19:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:19:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:19:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:19:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:19:49 user nova-compute[73056]: DEBUG nova.compute.manager [req-e6cea21a-1c2f-4278-85f1-76ed08895ec4 req-dd093a9c-99dd-46f4-a736-eb1a38a49ae1 service nova] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Received event network-vif-unplugged-574aff47-4a76-4c11-9e42-4d1361c9918a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:19:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e6cea21a-1c2f-4278-85f1-76ed08895ec4 req-dd093a9c-99dd-46f4-a736-eb1a38a49ae1 service nova] Acquiring lock "5ac14b1f-c5dd-4ded-9969-fc51264fe514-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:19:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e6cea21a-1c2f-4278-85f1-76ed08895ec4 req-dd093a9c-99dd-46f4-a736-eb1a38a49ae1 service nova] Lock "5ac14b1f-c5dd-4ded-9969-fc51264fe514-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:19:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e6cea21a-1c2f-4278-85f1-76ed08895ec4 req-dd093a9c-99dd-46f4-a736-eb1a38a49ae1 service nova] Lock "5ac14b1f-c5dd-4ded-9969-fc51264fe514-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:19:49 user nova-compute[73056]: DEBUG nova.compute.manager [req-e6cea21a-1c2f-4278-85f1-76ed08895ec4 req-dd093a9c-99dd-46f4-a736-eb1a38a49ae1 service nova] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] No waiting events found dispatching network-vif-unplugged-574aff47-4a76-4c11-9e42-4d1361c9918a {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:19:49 user nova-compute[73056]: DEBUG nova.compute.manager [req-e6cea21a-1c2f-4278-85f1-76ed08895ec4 req-dd093a9c-99dd-46f4-a736-eb1a38a49ae1 service nova] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Received event network-vif-unplugged-574aff47-4a76-4c11-9e42-4d1361c9918a for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 17:19:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:19:50 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Instance destroyed successfully.
Aug 14 17:19:50 user nova-compute[73056]: DEBUG nova.objects.instance [None req-1aabb14f-4982-4c8e-910e-2539941ec0ff tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Lazy-loading 'resources' on Instance uuid 5ac14b1f-c5dd-4ded-9969-fc51264fe514 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:19:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-1aabb14f-4982-4c8e-910e-2539941ec0ff tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T17:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1732497550',display_name='tempest-ServersNegativeTestJSON-server-1732497550',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1732497550',id=50,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T17:18:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f97951b9947e47f7a891f30b978035df',ramdisk_id='',reservation_id='r-hchsx67x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-490931314',owner_user_name='tempest-ServersNegativeTestJSON-490931314-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T17:18:06Z,user_data=None,user_id='b0e100f63e194a008fb7a581bf54441a',uuid=5ac14b1f-c5dd-4ded-9969-fc51264fe514,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "574aff47-4a76-4c11-9e42-4d1361c9918a", "address": "fa:16:3e:26:ad:6b", "network": {"id": "1eeafbdd-7525-48a9-9369-706d1955dbf9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-507921951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97951b9947e47f7a891f30b978035df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap574aff47-4a", "ovs_interfaceid": "574aff47-4a76-4c11-9e42-4d1361c9918a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 17:19:50 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-1aabb14f-4982-4c8e-910e-2539941ec0ff tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Converting VIF {"id": "574aff47-4a76-4c11-9e42-4d1361c9918a", "address": "fa:16:3e:26:ad:6b", "network": {"id": "1eeafbdd-7525-48a9-9369-706d1955dbf9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-507921951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97951b9947e47f7a891f30b978035df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap574aff47-4a", "ovs_interfaceid": "574aff47-4a76-4c11-9e42-4d1361c9918a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:19:50 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-1aabb14f-4982-4c8e-910e-2539941ec0ff tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:ad:6b,bridge_name='br-int',has_traffic_filtering=True,id=574aff47-4a76-4c11-9e42-4d1361c9918a,network=Network(1eeafbdd-7525-48a9-9369-706d1955dbf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap574aff47-4a') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:19:50 user nova-compute[73056]: DEBUG os_vif [None req-1aabb14f-4982-4c8e-910e-2539941ec0ff tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:ad:6b,bridge_name='br-int',has_traffic_filtering=True,id=574aff47-4a76-4c11-9e42-4d1361c9918a,network=Network(1eeafbdd-7525-48a9-9369-706d1955dbf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap574aff47-4a') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 17:19:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:19:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap574aff47-4a, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:19:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:19:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:19:50 user nova-compute[73056]: INFO os_vif [None req-1aabb14f-4982-4c8e-910e-2539941ec0ff tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:ad:6b,bridge_name='br-int',has_traffic_filtering=True,id=574aff47-4a76-4c11-9e42-4d1361c9918a,network=Network(1eeafbdd-7525-48a9-9369-706d1955dbf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap574aff47-4a')
Aug 14 17:19:50 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-1aabb14f-4982-4c8e-910e-2539941ec0ff tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Deleting instance files /opt/stack/data/nova/instances/5ac14b1f-c5dd-4ded-9969-fc51264fe514_del
Aug 14 17:19:50 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-1aabb14f-4982-4c8e-910e-2539941ec0ff tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Deletion of /opt/stack/data/nova/instances/5ac14b1f-c5dd-4ded-9969-fc51264fe514_del complete
Aug 14 17:19:50 user nova-compute[73056]: INFO nova.compute.manager [None req-1aabb14f-4982-4c8e-910e-2539941ec0ff tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 14 17:19:50 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-1aabb14f-4982-4c8e-910e-2539941ec0ff tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 17:19:50 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 17:19:50 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 17:19:50 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:19:50 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Took 0.61 seconds to deallocate network for instance.
Aug 14 17:19:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-1aabb14f-4982-4c8e-910e-2539941ec0ff tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:19:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-1aabb14f-4982-4c8e-910e-2539941ec0ff tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:19:50 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-1aabb14f-4982-4c8e-910e-2539941ec0ff tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:19:50 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-1aabb14f-4982-4c8e-910e-2539941ec0ff tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:19:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-1aabb14f-4982-4c8e-910e-2539941ec0ff tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.128s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:19:50 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-1aabb14f-4982-4c8e-910e-2539941ec0ff tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Deleted allocations for instance 5ac14b1f-c5dd-4ded-9969-fc51264fe514
Aug 14 17:19:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-1aabb14f-4982-4c8e-910e-2539941ec0ff tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Lock "5ac14b1f-c5dd-4ded-9969-fc51264fe514" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.829s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:19:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-382eacc5-c7c4-4f12-9cff-68a5065f493b req-4cf104d7-4639-44b2-bd44-c161609f5a95 service nova] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Received event network-vif-plugged-574aff47-4a76-4c11-9e42-4d1361c9918a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:19:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-382eacc5-c7c4-4f12-9cff-68a5065f493b req-4cf104d7-4639-44b2-bd44-c161609f5a95 service nova] Acquiring lock "5ac14b1f-c5dd-4ded-9969-fc51264fe514-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:19:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-382eacc5-c7c4-4f12-9cff-68a5065f493b req-4cf104d7-4639-44b2-bd44-c161609f5a95 service nova] Lock "5ac14b1f-c5dd-4ded-9969-fc51264fe514-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:19:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-382eacc5-c7c4-4f12-9cff-68a5065f493b req-4cf104d7-4639-44b2-bd44-c161609f5a95 service nova] Lock "5ac14b1f-c5dd-4ded-9969-fc51264fe514-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:19:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-382eacc5-c7c4-4f12-9cff-68a5065f493b req-4cf104d7-4639-44b2-bd44-c161609f5a95 service nova] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] No waiting events found dispatching network-vif-plugged-574aff47-4a76-4c11-9e42-4d1361c9918a {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:19:51 user nova-compute[73056]: WARNING nova.compute.manager [req-382eacc5-c7c4-4f12-9cff-68a5065f493b req-4cf104d7-4639-44b2-bd44-c161609f5a95 service nova] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Received unexpected event network-vif-plugged-574aff47-4a76-4c11-9e42-4d1361c9918a for instance with vm_state deleted and task_state None.
Aug 14 17:19:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-382eacc5-c7c4-4f12-9cff-68a5065f493b req-4cf104d7-4639-44b2-bd44-c161609f5a95 service nova] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Received event network-vif-deleted-574aff47-4a76-4c11-9e42-4d1361c9918a {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:19:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:20:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:20:05 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692033590.0548787, 5ac14b1f-c5dd-4ded-9969-fc51264fe514 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:20:05 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] VM Stopped (Lifecycle Event)
Aug 14 17:20:05 user nova-compute[73056]: DEBUG nova.compute.manager [None req-c2e6d8f2-8a7d-444c-af98-ad833fe1babf None None] [instance: 5ac14b1f-c5dd-4ded-9969-fc51264fe514] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:20:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:20:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:20:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:20:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:20:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:20:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:20:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:20:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:20:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:20:24 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:20:24 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:20:24 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 17:20:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:20:27 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:20:27 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 17:20:27 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Rebuilding the list of instances to heal {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 17:20:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-860cb53c-f023-4c4b-9f04-7a90c8274974" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:20:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-860cb53c-f023-4c4b-9f04-7a90c8274974" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:20:27 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 17:20:27 user nova-compute[73056]: DEBUG nova.objects.instance [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lazy-loading 'info_cache' on Instance uuid 860cb53c-f023-4c4b-9f04-7a90c8274974 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:20:27 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Updating instance_info_cache with network_info: [{"id": "af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8", "address": "fa:16:3e:10:e5:ed", "network": {"id": "1eeafbdd-7525-48a9-9369-706d1955dbf9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-507921951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97951b9947e47f7a891f30b978035df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3b7f5f-d9", "ovs_interfaceid": "af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:20:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-860cb53c-f023-4c4b-9f04-7a90c8274974" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:20:27 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 17:20:29 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:20:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:20:34 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:20:34 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:20:34 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:20:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:20:36 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:20:36 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:20:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:20:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:20:36 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:20:36 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 17:20:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:20:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:20:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:20:36 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:20:37 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:20:37 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:20:37 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=8782MB free_disk=25.16632080078125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 17:20:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:20:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:20:37 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 860cb53c-f023-4c4b-9f04-7a90c8274974 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:20:37 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 17:20:37 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 17:20:37 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:20:37 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:20:37 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 17:20:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.208s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:20:38 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:20:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:20:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:20:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:20:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:20:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:20:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:20:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:20:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:20:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:21:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:21:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:21:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:21:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:21:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:21:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:21:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:21:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:21:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:21:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:21:23 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:21:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:21:25 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:21:25 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 17:21:28 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:21:28 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 17:21:28 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Rebuilding the list of instances to heal {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 17:21:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-860cb53c-f023-4c4b-9f04-7a90c8274974" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:21:28 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-860cb53c-f023-4c4b-9f04-7a90c8274974" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:21:28 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 17:21:28 user nova-compute[73056]: DEBUG nova.objects.instance [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lazy-loading 'info_cache' on Instance uuid 860cb53c-f023-4c4b-9f04-7a90c8274974 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:21:28 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Updating instance_info_cache with network_info: [{"id": "af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8", "address": "fa:16:3e:10:e5:ed", "network": {"id": "1eeafbdd-7525-48a9-9369-706d1955dbf9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-507921951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97951b9947e47f7a891f30b978035df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3b7f5f-d9", "ovs_interfaceid": "af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:21:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-860cb53c-f023-4c4b-9f04-7a90c8274974" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:21:29 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 17:21:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:21:30 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:21:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:21:35 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:21:35 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:21:36 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:21:36 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:21:37 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:21:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:21:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:21:37 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:21:37 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 17:21:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:21:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:21:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:21:37 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:21:38 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:21:38 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:21:38 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=8789MB free_disk=25.165748596191406GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 17:21:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:21:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:21:38 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 860cb53c-f023-4c4b-9f04-7a90c8274974 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:21:38 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 17:21:38 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 17:21:38 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:21:38 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:21:38 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 17:21:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:21:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:21:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:21:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:21:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:22:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:22:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:22:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:22:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:22:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:22:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:22:26 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:22:27 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:22:27 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 17:22:29 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:22:29 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 17:22:29 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Rebuilding the list of instances to heal {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 17:22:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-860cb53c-f023-4c4b-9f04-7a90c8274974" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:22:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-860cb53c-f023-4c4b-9f04-7a90c8274974" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:22:29 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 17:22:29 user nova-compute[73056]: DEBUG nova.objects.instance [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lazy-loading 'info_cache' on Instance uuid 860cb53c-f023-4c4b-9f04-7a90c8274974 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:22:30 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Updating instance_info_cache with network_info: [{"id": "af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8", "address": "fa:16:3e:10:e5:ed", "network": {"id": "1eeafbdd-7525-48a9-9369-706d1955dbf9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-507921951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97951b9947e47f7a891f30b978035df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3b7f5f-d9", "ovs_interfaceid": "af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:22:30 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-860cb53c-f023-4c4b-9f04-7a90c8274974" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:22:30 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 17:22:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:22:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:22:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:22:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:22:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:22:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:22:31 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:22:32 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:22:34 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:22:34 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73056) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 17:22:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:22:35 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:22:35 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:22:36 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:22:37 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:22:39 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:22:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:22:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:22:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:22:39 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 17:22:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:22:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:22:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:22:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:22:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:22:40 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:22:40 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:22:40 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=8776MB free_disk=25.165084838867188GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 17:22:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:22:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:22:40 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 860cb53c-f023-4c4b-9f04-7a90c8274974 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:22:40 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 17:22:40 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 17:22:40 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:22:40 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:22:40 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 17:22:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.326s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:22:43 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:22:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:22:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:22:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:23:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:23:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:23:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:23:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:23:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:23:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:23:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:23:06 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:23:06 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Cleaning up deleted instances {{(pid=73056) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 17:23:06 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] There are 0 instances to clean {{(pid=73056) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 17:23:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:23:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:23:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:23:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:23:26 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:23:28 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:23:28 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 17:23:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:23:31 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:23:31 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 17:23:31 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Rebuilding the list of instances to heal {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 17:23:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-860cb53c-f023-4c4b-9f04-7a90c8274974" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:23:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-860cb53c-f023-4c4b-9f04-7a90c8274974" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:23:31 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 17:23:31 user nova-compute[73056]: DEBUG nova.objects.instance [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lazy-loading 'info_cache' on Instance uuid 860cb53c-f023-4c4b-9f04-7a90c8274974 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:23:31 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Updating instance_info_cache with network_info: [{"id": "af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8", "address": "fa:16:3e:10:e5:ed", "network": {"id": "1eeafbdd-7525-48a9-9369-706d1955dbf9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-507921951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97951b9947e47f7a891f30b978035df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3b7f5f-d9", "ovs_interfaceid": "af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:23:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-860cb53c-f023-4c4b-9f04-7a90c8274974" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:23:31 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 17:23:33 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:23:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:23:35 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:23:35 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:23:38 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:23:39 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:23:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:23:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:23:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:23:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:23:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:23:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:23:40 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:23:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:23:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:23:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:23:40 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 17:23:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:23:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:23:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:23:40 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:23:41 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:23:41 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:23:41 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=8787MB free_disk=25.164535522460938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 17:23:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:23:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:23:41 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 860cb53c-f023-4c4b-9f04-7a90c8274974 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:23:41 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 17:23:41 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 17:23:41 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Refreshing inventories for resource provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 17:23:41 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Updating ProviderTree inventory for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 17:23:41 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Updating inventory in ProviderTree for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 17:23:41 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Refreshing aggregate associations for resource provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b, aggregates: None {{(pid=73056) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 17:23:41 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Refreshing trait associations for resource provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=73056) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 17:23:41 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:23:41 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:23:41 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 17:23:41 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.296s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:23:44 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:23:44 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Triggering sync for uuid 860cb53c-f023-4c4b-9f04-7a90c8274974 {{(pid=73056) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 17:23:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "860cb53c-f023-4c4b-9f04-7a90c8274974" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:23:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "860cb53c-f023-4c4b-9f04-7a90c8274974" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:23:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "860cb53c-f023-4c4b-9f04-7a90c8274974" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:23:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:23:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:23:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:23:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:23:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:23:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:23:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:23:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:24:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:24:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:24:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:24:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:24:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:24:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:24:26 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:24:29 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:24:29 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 17:24:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:24:33 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:24:33 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:24:33 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 17:24:33 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Rebuilding the list of instances to heal {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 17:24:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-860cb53c-f023-4c4b-9f04-7a90c8274974" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:24:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-860cb53c-f023-4c4b-9f04-7a90c8274974" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:24:33 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 17:24:33 user nova-compute[73056]: DEBUG nova.objects.instance [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lazy-loading 'info_cache' on Instance uuid 860cb53c-f023-4c4b-9f04-7a90c8274974 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:24:33 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Updating instance_info_cache with network_info: [{"id": "af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8", "address": "fa:16:3e:10:e5:ed", "network": {"id": "1eeafbdd-7525-48a9-9369-706d1955dbf9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-507921951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97951b9947e47f7a891f30b978035df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3b7f5f-d9", "ovs_interfaceid": "af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:24:33 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-860cb53c-f023-4c4b-9f04-7a90c8274974" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:24:33 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 17:24:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:24:36 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:24:36 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:24:39 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:24:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:24:40 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:24:42 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:24:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:24:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:24:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:24:42 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 17:24:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:24:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:24:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:24:42 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:24:43 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:24:43 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:24:43 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=8786MB free_disk=25.163898468017578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 17:24:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:24:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:24:43 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance 860cb53c-f023-4c4b-9f04-7a90c8274974 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:24:43 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 17:24:43 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 17:24:43 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:24:43 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:24:43 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 17:24:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:24:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:24:48 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:24:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:24:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:25:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:25:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:25:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:25:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:25:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:25:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:25:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:25:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a713f3ce-2a9c-4542-a80a-9613129cb860 tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Acquiring lock "860cb53c-f023-4c4b-9f04-7a90c8274974" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:25:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a713f3ce-2a9c-4542-a80a-9613129cb860 tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Lock "860cb53c-f023-4c4b-9f04-7a90c8274974" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:25:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a713f3ce-2a9c-4542-a80a-9613129cb860 tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Acquiring lock "860cb53c-f023-4c4b-9f04-7a90c8274974-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:25:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a713f3ce-2a9c-4542-a80a-9613129cb860 tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Lock "860cb53c-f023-4c4b-9f04-7a90c8274974-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:25:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a713f3ce-2a9c-4542-a80a-9613129cb860 tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Lock "860cb53c-f023-4c4b-9f04-7a90c8274974-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:25:07 user nova-compute[73056]: INFO nova.compute.manager [None req-a713f3ce-2a9c-4542-a80a-9613129cb860 tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Terminating instance
Aug 14 17:25:07 user nova-compute[73056]: DEBUG nova.compute.manager [None req-a713f3ce-2a9c-4542-a80a-9613129cb860 tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 17:25:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:25:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:25:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:25:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:25:07 user nova-compute[73056]: DEBUG nova.compute.manager [req-e5c72e6b-e739-449f-80bb-2268904456a9 req-058eb983-0056-4b4b-b36a-ea33874f9258 service nova] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Received event network-vif-unplugged-af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:25:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e5c72e6b-e739-449f-80bb-2268904456a9 req-058eb983-0056-4b4b-b36a-ea33874f9258 service nova] Acquiring lock "860cb53c-f023-4c4b-9f04-7a90c8274974-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:25:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e5c72e6b-e739-449f-80bb-2268904456a9 req-058eb983-0056-4b4b-b36a-ea33874f9258 service nova] Lock "860cb53c-f023-4c4b-9f04-7a90c8274974-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:25:07 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-e5c72e6b-e739-449f-80bb-2268904456a9 req-058eb983-0056-4b4b-b36a-ea33874f9258 service nova] Lock "860cb53c-f023-4c4b-9f04-7a90c8274974-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:25:07 user nova-compute[73056]: DEBUG nova.compute.manager [req-e5c72e6b-e739-449f-80bb-2268904456a9 req-058eb983-0056-4b4b-b36a-ea33874f9258 service nova] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] No waiting events found dispatching network-vif-unplugged-af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:25:07 user nova-compute[73056]: DEBUG nova.compute.manager [req-e5c72e6b-e739-449f-80bb-2268904456a9 req-058eb983-0056-4b4b-b36a-ea33874f9258 service nova] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Received event network-vif-unplugged-af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8 for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 17:25:07 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:25:07 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Instance destroyed successfully.
Aug 14 17:25:07 user nova-compute[73056]: DEBUG nova.objects.instance [None req-a713f3ce-2a9c-4542-a80a-9613129cb860 tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Lazy-loading 'resources' on Instance uuid 860cb53c-f023-4c4b-9f04-7a90c8274974 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:25:07 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-a713f3ce-2a9c-4542-a80a-9613129cb860 tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T17:16:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-398372750',display_name='tempest-ServersNegativeTestJSON-server-398372750',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-398372750',id=49,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T17:16:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f97951b9947e47f7a891f30b978035df',ramdisk_id='',reservation_id='r-h8skp04x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-490931314',owner_user_name='tempest-ServersNegativeTestJSON-490931314-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T17:16:14Z,user_data=None,user_id='b0e100f63e194a008fb7a581bf54441a',uuid=860cb53c-f023-4c4b-9f04-7a90c8274974,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8", "address": "fa:16:3e:10:e5:ed", "network": {"id": "1eeafbdd-7525-48a9-9369-706d1955dbf9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-507921951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97951b9947e47f7a891f30b978035df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3b7f5f-d9", "ovs_interfaceid": "af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 17:25:07 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-a713f3ce-2a9c-4542-a80a-9613129cb860 tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Converting VIF {"id": "af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8", "address": "fa:16:3e:10:e5:ed", "network": {"id": "1eeafbdd-7525-48a9-9369-706d1955dbf9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-507921951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97951b9947e47f7a891f30b978035df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3b7f5f-d9", "ovs_interfaceid": "af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:25:07 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-a713f3ce-2a9c-4542-a80a-9613129cb860 tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:e5:ed,bridge_name='br-int',has_traffic_filtering=True,id=af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8,network=Network(1eeafbdd-7525-48a9-9369-706d1955dbf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3b7f5f-d9') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:25:07 user nova-compute[73056]: DEBUG os_vif [None req-a713f3ce-2a9c-4542-a80a-9613129cb860 tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:e5:ed,bridge_name='br-int',has_traffic_filtering=True,id=af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8,network=Network(1eeafbdd-7525-48a9-9369-706d1955dbf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3b7f5f-d9') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 17:25:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:25:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf3b7f5f-d9, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:25:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:25:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:25:08 user nova-compute[73056]: INFO os_vif [None req-a713f3ce-2a9c-4542-a80a-9613129cb860 tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:e5:ed,bridge_name='br-int',has_traffic_filtering=True,id=af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8,network=Network(1eeafbdd-7525-48a9-9369-706d1955dbf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3b7f5f-d9')
Aug 14 17:25:08 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-a713f3ce-2a9c-4542-a80a-9613129cb860 tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Deleting instance files /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974_del
Aug 14 17:25:08 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-a713f3ce-2a9c-4542-a80a-9613129cb860 tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Deletion of /opt/stack/data/nova/instances/860cb53c-f023-4c4b-9f04-7a90c8274974_del complete
Aug 14 17:25:08 user nova-compute[73056]: INFO nova.compute.manager [None req-a713f3ce-2a9c-4542-a80a-9613129cb860 tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 14 17:25:08 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-a713f3ce-2a9c-4542-a80a-9613129cb860 tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 17:25:08 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 17:25:08 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 17:25:09 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:25:09 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Took 1.03 seconds to deallocate network for instance.
Aug 14 17:25:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a713f3ce-2a9c-4542-a80a-9613129cb860 tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:25:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a713f3ce-2a9c-4542-a80a-9613129cb860 tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:25:09 user nova-compute[73056]: DEBUG nova.compute.manager [req-1e59c197-486e-4ea1-aa11-e7b410a39863 req-23374d85-a948-4af6-ae4b-f55b5b58ca94 service nova] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Received event network-vif-deleted-af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:25:09 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-a713f3ce-2a9c-4542-a80a-9613129cb860 tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:25:09 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-a713f3ce-2a9c-4542-a80a-9613129cb860 tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:25:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a713f3ce-2a9c-4542-a80a-9613129cb860 tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.113s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:25:09 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-a713f3ce-2a9c-4542-a80a-9613129cb860 tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Deleted allocations for instance 860cb53c-f023-4c4b-9f04-7a90c8274974
Aug 14 17:25:09 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-a713f3ce-2a9c-4542-a80a-9613129cb860 tempest-ServersNegativeTestJSON-490931314 tempest-ServersNegativeTestJSON-490931314-project-member] Lock "860cb53c-f023-4c4b-9f04-7a90c8274974" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.236s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:25:10 user nova-compute[73056]: DEBUG nova.compute.manager [req-d5cef170-1f65-4a40-8bbd-a0b4bee734ad req-aece0df0-a933-4f8f-b465-69f2e1517ca6 service nova] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Received event network-vif-plugged-af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8 {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:25:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-d5cef170-1f65-4a40-8bbd-a0b4bee734ad req-aece0df0-a933-4f8f-b465-69f2e1517ca6 service nova] Acquiring lock "860cb53c-f023-4c4b-9f04-7a90c8274974-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:25:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-d5cef170-1f65-4a40-8bbd-a0b4bee734ad req-aece0df0-a933-4f8f-b465-69f2e1517ca6 service nova] Lock "860cb53c-f023-4c4b-9f04-7a90c8274974-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:25:10 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-d5cef170-1f65-4a40-8bbd-a0b4bee734ad req-aece0df0-a933-4f8f-b465-69f2e1517ca6 service nova] Lock "860cb53c-f023-4c4b-9f04-7a90c8274974-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:25:10 user nova-compute[73056]: DEBUG nova.compute.manager [req-d5cef170-1f65-4a40-8bbd-a0b4bee734ad req-aece0df0-a933-4f8f-b465-69f2e1517ca6 service nova] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] No waiting events found dispatching network-vif-plugged-af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8 {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:25:10 user nova-compute[73056]: WARNING nova.compute.manager [req-d5cef170-1f65-4a40-8bbd-a0b4bee734ad req-aece0df0-a933-4f8f-b465-69f2e1517ca6 service nova] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Received unexpected event network-vif-plugged-af3b7f5f-d9f8-4ab1-9ea6-ee1b40005de8 for instance with vm_state deleted and task_state None.
Aug 14 17:25:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:25:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:25:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:25:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:25:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:25:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:25:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:25:22 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692033907.9533396, 860cb53c-f023-4c4b-9f04-7a90c8274974 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:25:22 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] VM Stopped (Lifecycle Event)
Aug 14 17:25:22 user nova-compute[73056]: DEBUG nova.compute.manager [None req-468f3f6a-ac8e-469d-9848-d1660ca2b81f None None] [instance: 860cb53c-f023-4c4b-9f04-7a90c8274974] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:25:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:25:26 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:25:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:25:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:25:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:25:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:25:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:25:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:25:30 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:25:30 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 17:25:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:25:35 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:25:35 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:25:35 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 17:25:35 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Rebuilding the list of instances to heal {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 17:25:35 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Didn't find any instances for network info cache update. {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 17:25:36 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:25:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:25:38 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:25:41 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:25:41 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:25:42 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:25:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:25:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:25:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:25:42 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 17:25:42 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:25:42 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:25:42 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=8918MB free_disk=25.19092559814453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 17:25:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:25:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:25:42 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 17:25:42 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 17:25:42 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:25:42 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:25:42 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 17:25:42 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:25:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:25:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:25:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:25:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:25:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:25:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:25:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:25:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:25:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:25:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:26:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:26:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:26:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:26:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:26:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:26:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:26:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:26:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:26:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:26:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:26:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:26:26 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:26:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:26:30 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:26:30 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 17:26:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:26:36 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:26:36 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 17:26:36 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Rebuilding the list of instances to heal {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 17:26:36 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Didn't find any instances for network info cache update. {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 17:26:37 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:26:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:26:38 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:26:40 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:26:41 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:26:41 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:26:42 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:26:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:26:43 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:26:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:26:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.004s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:26:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:26:43 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 17:26:43 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:26:43 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:26:43 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=8921MB free_disk=25.181385040283203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 17:26:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:26:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:26:43 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 17:26:43 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 17:26:43 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:26:43 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:26:43 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 17:26:43 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:26:47 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:26:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:26:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:26:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:26:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:26:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:26:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:26:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:26:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:27:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:27:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:27:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:27:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:27:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:27:26 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:27:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:27:32 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:27:32 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 17:27:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:27:36 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:27:36 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73056) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 17:27:36 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:27:37 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:27:37 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 17:27:37 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Rebuilding the list of instances to heal {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 17:27:37 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Didn't find any instances for network info cache update. {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 17:27:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:27:38 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:27:40 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:27:42 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:27:42 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:27:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:27:43 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:27:44 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:27:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:27:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:27:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:27:44 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 17:27:44 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:27:44 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:27:44 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=8921MB free_disk=25.179302215576172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 17:27:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:27:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:27:44 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 17:27:44 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 17:27:45 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:27:45 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:27:45 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 17:27:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.279s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:27:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:27:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:27:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:28:03 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:28:08 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:28:13 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:28:15 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:28:15 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Cleaning up deleted instances {{(pid=73056) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 17:28:15 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] There are 0 instances to clean {{(pid=73056) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 17:28:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:28:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:28:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:28:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:28:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:28:18 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:28:23 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:28:27 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:28:28 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:28:28 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:28:31 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:28:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:28:33 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:28:33 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 17:28:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:28:33 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:28:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:28:38 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:28:38 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:28:39 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:28:39 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 17:28:39 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Rebuilding the list of instances to heal {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 17:28:39 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Didn't find any instances for network info cache update. {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 17:28:41 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:28:43 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:28:43 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:28:44 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:28:44 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:28:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:28:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:28:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:28:44 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 17:28:44 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:28:44 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:28:44 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=8926MB free_disk=25.177349090576172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 17:28:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:28:44 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:28:44 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 17:28:44 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 17:28:44 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Refreshing inventories for resource provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 17:28:44 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Updating ProviderTree inventory for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 17:28:44 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Updating inventory in ProviderTree for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 17:28:44 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Refreshing aggregate associations for resource provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b, aggregates: None {{(pid=73056) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 17:28:45 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Refreshing trait associations for resource provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=73056) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 17:28:45 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:28:45 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:28:45 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 17:28:45 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:28:46 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:28:47 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:28:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Acquiring lock "e936a340-b16f-462b-b282-23d96a481d62" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:28:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "e936a340-b16f-462b-b282-23d96a481d62" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:28:48 user nova-compute[73056]: DEBUG nova.compute.manager [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 17:28:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:28:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:28:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:28:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:28:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:28:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:28:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:28:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:28:48 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 17:28:48 user nova-compute[73056]: INFO nova.compute.claims [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Claim successful on node user
Aug 14 17:28:48 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:28:48 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:28:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.200s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:28:48 user nova-compute[73056]: DEBUG nova.compute.manager [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 17:28:48 user nova-compute[73056]: DEBUG nova.compute.manager [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 17:28:48 user nova-compute[73056]: DEBUG nova.network.neutron [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 17:28:48 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 17:28:48 user nova-compute[73056]: DEBUG nova.compute.manager [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 17:28:48 user nova-compute[73056]: DEBUG nova.compute.manager [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 17:28:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 17:28:48 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Creating image(s)
Aug 14 17:28:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Acquiring lock "/opt/stack/data/nova/instances/e936a340-b16f-462b-b282-23d96a481d62/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:28:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "/opt/stack/data/nova/instances/e936a340-b16f-462b-b282-23d96a481d62/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:28:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "/opt/stack/data/nova/instances/e936a340-b16f-462b-b282-23d96a481d62/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:28:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:28:48 user nova-compute[73056]: DEBUG nova.policy [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cc1f9d0085ef4175815a04fa62d46a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7c1ba6a6948e0bbd33a5fd441a8b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 17:28:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.174s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:28:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Acquiring lock "c889592ab94cd0b0ce896f27a2af0323771db234" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:28:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:28:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:28:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.165s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:28:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/e936a340-b16f-462b-b282-23d96a481d62/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:28:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/e936a340-b16f-462b-b282-23d96a481d62/disk 1073741824" returned: 0 in 0.046s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:28:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:28:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:28:48 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:28:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.168s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:28:49 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e936a340-b16f-462b-b282-23d96a481d62/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 17:28:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e936a340-b16f-462b-b282-23d96a481d62/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:28:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e936a340-b16f-462b-b282-23d96a481d62/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:28:49 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Cannot resize image /opt/stack/data/nova/instances/e936a340-b16f-462b-b282-23d96a481d62/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 17:28:49 user nova-compute[73056]: DEBUG nova.objects.instance [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lazy-loading 'migration_context' on Instance uuid e936a340-b16f-462b-b282-23d96a481d62 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:28:49 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 17:28:49 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Ensure instance console log exists: /opt/stack/data/nova/instances/e936a340-b16f-462b-b282-23d96a481d62/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 17:28:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:28:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:28:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:28:49 user nova-compute[73056]: DEBUG nova.network.neutron [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Successfully created port: 7a743e2f-6806-429b-b836-73147f0938ea {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG nova.network.neutron [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Successfully updated port: 7a743e2f-6806-429b-b836-73147f0938ea {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Acquiring lock "refresh_cache-e936a340-b16f-462b-b282-23d96a481d62" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Acquired lock "refresh_cache-e936a340-b16f-462b-b282-23d96a481d62" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG nova.network.neutron [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG nova.compute.manager [req-4f2e9b33-74bb-4ec4-9805-163f5d604061 req-6e9bc8a6-5580-4190-b78e-a3eae2bf4d45 service nova] [instance: e936a340-b16f-462b-b282-23d96a481d62] Received event network-changed-7a743e2f-6806-429b-b836-73147f0938ea {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG nova.compute.manager [req-4f2e9b33-74bb-4ec4-9805-163f5d604061 req-6e9bc8a6-5580-4190-b78e-a3eae2bf4d45 service nova] [instance: e936a340-b16f-462b-b282-23d96a481d62] Refreshing instance network info cache due to event network-changed-7a743e2f-6806-429b-b836-73147f0938ea. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4f2e9b33-74bb-4ec4-9805-163f5d604061 req-6e9bc8a6-5580-4190-b78e-a3eae2bf4d45 service nova] Acquiring lock "refresh_cache-e936a340-b16f-462b-b282-23d96a481d62" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG nova.network.neutron [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG nova.network.neutron [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Updating instance_info_cache with network_info: [{"id": "7a743e2f-6806-429b-b836-73147f0938ea", "address": "fa:16:3e:5d:be:38", "network": {"id": "496d6e84-b52b-4e7b-90e5-e4acac832552", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2046688465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf7c1ba6a6948e0bbd33a5fd441a8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a743e2f-68", "ovs_interfaceid": "7a743e2f-6806-429b-b836-73147f0938ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Releasing lock "refresh_cache-e936a340-b16f-462b-b282-23d96a481d62" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG nova.compute.manager [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Instance network_info: |[{"id": "7a743e2f-6806-429b-b836-73147f0938ea", "address": "fa:16:3e:5d:be:38", "network": {"id": "496d6e84-b52b-4e7b-90e5-e4acac832552", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2046688465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf7c1ba6a6948e0bbd33a5fd441a8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a743e2f-68", "ovs_interfaceid": "7a743e2f-6806-429b-b836-73147f0938ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4f2e9b33-74bb-4ec4-9805-163f5d604061 req-6e9bc8a6-5580-4190-b78e-a3eae2bf4d45 service nova] Acquired lock "refresh_cache-e936a340-b16f-462b-b282-23d96a481d62" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG nova.network.neutron [req-4f2e9b33-74bb-4ec4-9805-163f5d604061 req-6e9bc8a6-5580-4190-b78e-a3eae2bf4d45 service nova] [instance: e936a340-b16f-462b-b282-23d96a481d62] Refreshing network info cache for port 7a743e2f-6806-429b-b836-73147f0938ea {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Start _get_guest_xml network_info=[{"id": "7a743e2f-6806-429b-b836-73147f0938ea", "address": "fa:16:3e:5d:be:38", "network": {"id": "496d6e84-b52b-4e7b-90e5-e4acac832552", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2046688465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf7c1ba6a6948e0bbd33a5fd441a8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a743e2f-68", "ovs_interfaceid": "7a743e2f-6806-429b-b836-73147f0938ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 17:28:50 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:28:50 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:28:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T17:28:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1343956225',display_name='tempest-VolumesSnapshotTestJSON-instance-1343956225',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1343956225',id=51,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJkoVsr/XeDj5eh9khTVcdsFu9Je7ddd6ATdhREirtCvMViFj75Mcr/mW0H2bCUKZTMZSJvRD+sA0k3KrNxZAXCsXbuEGDW9TWYtGZGUWI4t3i21clIH5USoFkIfr7Vcxw==',key_name='tempest-keypair-986627302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdf7c1ba6a6948e0bbd33a5fd441a8b2',ramdisk_id='',reservation_id='r-0tz1hrxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-110053267',owner_user_name='tempest-VolumesSnapshotTestJSON-110053267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T17:28:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc1f9d0085ef4175815a04fa62d46a6d',uuid=e936a340-b16f-462b-b282-23d96a481d62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a743e2f-6806-429b-b836-73147f0938ea", "address": "fa:16:3e:5d:be:38", "network": {"id": "496d6e84-b52b-4e7b-90e5-e4acac832552", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2046688465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf7c1ba6a6948e0bbd33a5fd441a8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a743e2f-68", "ovs_interfaceid": "7a743e2f-6806-429b-b836-73147f0938ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Converting VIF {"id": "7a743e2f-6806-429b-b836-73147f0938ea", "address": "fa:16:3e:5d:be:38", "network": {"id": "496d6e84-b52b-4e7b-90e5-e4acac832552", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2046688465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf7c1ba6a6948e0bbd33a5fd441a8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a743e2f-68", "ovs_interfaceid": "7a743e2f-6806-429b-b836-73147f0938ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:be:38,bridge_name='br-int',has_traffic_filtering=True,id=7a743e2f-6806-429b-b836-73147f0938ea,network=Network(496d6e84-b52b-4e7b-90e5-e4acac832552),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a743e2f-68') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG nova.objects.instance [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lazy-loading 'pci_devices' on Instance uuid e936a340-b16f-462b-b282-23d96a481d62 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] End _get_guest_xml xml=<domain type="kvm">
Aug 14 17:28:50 user nova-compute[73056]:   <uuid>e936a340-b16f-462b-b282-23d96a481d62</uuid>
Aug 14 17:28:50 user nova-compute[73056]:   <name>instance-00000033</name>
Aug 14 17:28:50 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 17:28:50 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 17:28:50 user nova-compute[73056]:   <metadata>
Aug 14 17:28:50 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 17:28:50 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 17:28:50 user nova-compute[73056]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1343956225</nova:name>
Aug 14 17:28:50 user nova-compute[73056]:       <nova:creationTime>2023-08-14 17:28:50</nova:creationTime>
Aug 14 17:28:50 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 17:28:50 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 17:28:50 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 17:28:50 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 17:28:50 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 17:28:50 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 17:28:50 user nova-compute[73056]:       </nova:flavor>
Aug 14 17:28:50 user nova-compute[73056]:       <nova:owner>
Aug 14 17:28:50 user nova-compute[73056]:         <nova:user uuid="cc1f9d0085ef4175815a04fa62d46a6d">tempest-VolumesSnapshotTestJSON-110053267-project-member</nova:user>
Aug 14 17:28:50 user nova-compute[73056]:         <nova:project uuid="fdf7c1ba6a6948e0bbd33a5fd441a8b2">tempest-VolumesSnapshotTestJSON-110053267</nova:project>
Aug 14 17:28:50 user nova-compute[73056]:       </nova:owner>
Aug 14 17:28:50 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 17:28:50 user nova-compute[73056]:       <nova:ports>
Aug 14 17:28:50 user nova-compute[73056]:         <nova:port uuid="7a743e2f-6806-429b-b836-73147f0938ea">
Aug 14 17:28:50 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 17:28:50 user nova-compute[73056]:         </nova:port>
Aug 14 17:28:50 user nova-compute[73056]:       </nova:ports>
Aug 14 17:28:50 user nova-compute[73056]:     </nova:instance>
Aug 14 17:28:50 user nova-compute[73056]:   </metadata>
Aug 14 17:28:50 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 17:28:50 user nova-compute[73056]:     <system>
Aug 14 17:28:50 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 17:28:50 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 17:28:50 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 17:28:50 user nova-compute[73056]:       <entry name="serial">e936a340-b16f-462b-b282-23d96a481d62</entry>
Aug 14 17:28:50 user nova-compute[73056]:       <entry name="uuid">e936a340-b16f-462b-b282-23d96a481d62</entry>
Aug 14 17:28:50 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 17:28:50 user nova-compute[73056]:     </system>
Aug 14 17:28:50 user nova-compute[73056]:   </sysinfo>
Aug 14 17:28:50 user nova-compute[73056]:   <os>
Aug 14 17:28:50 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 17:28:50 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 17:28:50 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 17:28:50 user nova-compute[73056]:   </os>
Aug 14 17:28:50 user nova-compute[73056]:   <features>
Aug 14 17:28:50 user nova-compute[73056]:     <acpi/>
Aug 14 17:28:50 user nova-compute[73056]:     <apic/>
Aug 14 17:28:50 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 17:28:50 user nova-compute[73056]:   </features>
Aug 14 17:28:50 user nova-compute[73056]:   <clock offset="utc">
Aug 14 17:28:50 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 17:28:50 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 17:28:50 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 17:28:50 user nova-compute[73056]:   </clock>
Aug 14 17:28:50 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 17:28:50 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 17:28:50 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 17:28:50 user nova-compute[73056]:   </cpu>
Aug 14 17:28:50 user nova-compute[73056]:   <devices>
Aug 14 17:28:50 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 17:28:50 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 17:28:50 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/e936a340-b16f-462b-b282-23d96a481d62/disk"/>
Aug 14 17:28:50 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 17:28:50 user nova-compute[73056]:     </disk>
Aug 14 17:28:50 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 17:28:50 user nova-compute[73056]:       <mac address="fa:16:3e:5d:be:38"/>
Aug 14 17:28:50 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 17:28:50 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 17:28:50 user nova-compute[73056]:       <target dev="tap7a743e2f-68"/>
Aug 14 17:28:50 user nova-compute[73056]:     </interface>
Aug 14 17:28:50 user nova-compute[73056]:     <serial type="pty">
Aug 14 17:28:50 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/e936a340-b16f-462b-b282-23d96a481d62/console.log" append="off"/>
Aug 14 17:28:50 user nova-compute[73056]:     </serial>
Aug 14 17:28:50 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 17:28:50 user nova-compute[73056]:     <video>
Aug 14 17:28:50 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 17:28:50 user nova-compute[73056]:     </video>
Aug 14 17:28:50 user nova-compute[73056]:     <rng model="virtio">
Aug 14 17:28:50 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 17:28:50 user nova-compute[73056]:     </rng>
Aug 14 17:28:50 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 17:28:50 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 17:28:50 user nova-compute[73056]:       <stats period="10"/>
Aug 14 17:28:50 user nova-compute[73056]:     </memballoon>
Aug 14 17:28:50 user nova-compute[73056]:   </devices>
Aug 14 17:28:50 user nova-compute[73056]: </domain>
Aug 14 17:28:50 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T17:28:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1343956225',display_name='tempest-VolumesSnapshotTestJSON-instance-1343956225',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1343956225',id=51,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJkoVsr/XeDj5eh9khTVcdsFu9Je7ddd6ATdhREirtCvMViFj75Mcr/mW0H2bCUKZTMZSJvRD+sA0k3KrNxZAXCsXbuEGDW9TWYtGZGUWI4t3i21clIH5USoFkIfr7Vcxw==',key_name='tempest-keypair-986627302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdf7c1ba6a6948e0bbd33a5fd441a8b2',ramdisk_id='',reservation_id='r-0tz1hrxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-110053267',owner_user_name='tempest-VolumesSnapshotTestJSON-110053267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T17:28:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc1f9d0085ef4175815a04fa62d46a6d',uuid=e936a340-b16f-462b-b282-23d96a481d62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a743e2f-6806-429b-b836-73147f0938ea", "address": "fa:16:3e:5d:be:38", "network": {"id": "496d6e84-b52b-4e7b-90e5-e4acac832552", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2046688465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf7c1ba6a6948e0bbd33a5fd441a8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a743e2f-68", "ovs_interfaceid": "7a743e2f-6806-429b-b836-73147f0938ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Converting VIF {"id": "7a743e2f-6806-429b-b836-73147f0938ea", "address": "fa:16:3e:5d:be:38", "network": {"id": "496d6e84-b52b-4e7b-90e5-e4acac832552", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2046688465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf7c1ba6a6948e0bbd33a5fd441a8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a743e2f-68", "ovs_interfaceid": "7a743e2f-6806-429b-b836-73147f0938ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:be:38,bridge_name='br-int',has_traffic_filtering=True,id=7a743e2f-6806-429b-b836-73147f0938ea,network=Network(496d6e84-b52b-4e7b-90e5-e4acac832552),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a743e2f-68') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG os_vif [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:be:38,bridge_name='br-int',has_traffic_filtering=True,id=7a743e2f-6806-429b-b836-73147f0938ea,network=Network(496d6e84-b52b-4e7b-90e5-e4acac832552),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a743e2f-68') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a743e2f-68, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7a743e2f-68, col_values=(('external_ids', {'iface-id': '7a743e2f-6806-429b-b836-73147f0938ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:be:38', 'vm-uuid': 'e936a340-b16f-462b-b282-23d96a481d62'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:28:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:28:50 user nova-compute[73056]: INFO os_vif [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:be:38,bridge_name='br-int',has_traffic_filtering=True,id=7a743e2f-6806-429b-b836-73147f0938ea,network=Network(496d6e84-b52b-4e7b-90e5-e4acac832552),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a743e2f-68')
Aug 14 17:28:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 17:28:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] No VIF found with MAC fa:16:3e:5d:be:38, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 17:28:51 user nova-compute[73056]: DEBUG nova.network.neutron [req-4f2e9b33-74bb-4ec4-9805-163f5d604061 req-6e9bc8a6-5580-4190-b78e-a3eae2bf4d45 service nova] [instance: e936a340-b16f-462b-b282-23d96a481d62] Updated VIF entry in instance network info cache for port 7a743e2f-6806-429b-b836-73147f0938ea. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 17:28:51 user nova-compute[73056]: DEBUG nova.network.neutron [req-4f2e9b33-74bb-4ec4-9805-163f5d604061 req-6e9bc8a6-5580-4190-b78e-a3eae2bf4d45 service nova] [instance: e936a340-b16f-462b-b282-23d96a481d62] Updating instance_info_cache with network_info: [{"id": "7a743e2f-6806-429b-b836-73147f0938ea", "address": "fa:16:3e:5d:be:38", "network": {"id": "496d6e84-b52b-4e7b-90e5-e4acac832552", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2046688465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf7c1ba6a6948e0bbd33a5fd441a8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a743e2f-68", "ovs_interfaceid": "7a743e2f-6806-429b-b836-73147f0938ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:28:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-4f2e9b33-74bb-4ec4-9805-163f5d604061 req-6e9bc8a6-5580-4190-b78e-a3eae2bf4d45 service nova] Releasing lock "refresh_cache-e936a340-b16f-462b-b282-23d96a481d62" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:28:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:28:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:28:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:28:52 user nova-compute[73056]: DEBUG nova.compute.manager [req-d73ad3fd-5532-4eb1-afd1-6ef96187fe89 req-8131916c-a302-48d7-b3d2-21ce5eaa0da1 service nova] [instance: e936a340-b16f-462b-b282-23d96a481d62] Received event network-vif-plugged-7a743e2f-6806-429b-b836-73147f0938ea {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:28:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-d73ad3fd-5532-4eb1-afd1-6ef96187fe89 req-8131916c-a302-48d7-b3d2-21ce5eaa0da1 service nova] Acquiring lock "e936a340-b16f-462b-b282-23d96a481d62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:28:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-d73ad3fd-5532-4eb1-afd1-6ef96187fe89 req-8131916c-a302-48d7-b3d2-21ce5eaa0da1 service nova] Lock "e936a340-b16f-462b-b282-23d96a481d62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:28:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-d73ad3fd-5532-4eb1-afd1-6ef96187fe89 req-8131916c-a302-48d7-b3d2-21ce5eaa0da1 service nova] Lock "e936a340-b16f-462b-b282-23d96a481d62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:28:52 user nova-compute[73056]: DEBUG nova.compute.manager [req-d73ad3fd-5532-4eb1-afd1-6ef96187fe89 req-8131916c-a302-48d7-b3d2-21ce5eaa0da1 service nova] [instance: e936a340-b16f-462b-b282-23d96a481d62] No waiting events found dispatching network-vif-plugged-7a743e2f-6806-429b-b836-73147f0938ea {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:28:52 user nova-compute[73056]: WARNING nova.compute.manager [req-d73ad3fd-5532-4eb1-afd1-6ef96187fe89 req-8131916c-a302-48d7-b3d2-21ce5eaa0da1 service nova] [instance: e936a340-b16f-462b-b282-23d96a481d62] Received unexpected event network-vif-plugged-7a743e2f-6806-429b-b836-73147f0938ea for instance with vm_state building and task_state spawning.
Aug 14 17:28:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:28:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:28:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:28:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:28:53 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:28:54 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692034134.3911417, e936a340-b16f-462b-b282-23d96a481d62 => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:28:54 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: e936a340-b16f-462b-b282-23d96a481d62] VM Resumed (Lifecycle Event)
Aug 14 17:28:54 user nova-compute[73056]: DEBUG nova.compute.manager [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 17:28:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 17:28:54 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: e936a340-b16f-462b-b282-23d96a481d62] Instance spawned successfully.
Aug 14 17:28:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 17:28:54 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: e936a340-b16f-462b-b282-23d96a481d62] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:28:54 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: e936a340-b16f-462b-b282-23d96a481d62] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 17:28:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:28:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:28:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:28:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:28:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:28:54 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:28:54 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: e936a340-b16f-462b-b282-23d96a481d62] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 17:28:54 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692034134.3932514, e936a340-b16f-462b-b282-23d96a481d62 => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:28:54 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: e936a340-b16f-462b-b282-23d96a481d62] VM Started (Lifecycle Event)
Aug 14 17:28:54 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: e936a340-b16f-462b-b282-23d96a481d62] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:28:54 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: e936a340-b16f-462b-b282-23d96a481d62] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 17:28:54 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: e936a340-b16f-462b-b282-23d96a481d62] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 17:28:54 user nova-compute[73056]: INFO nova.compute.manager [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Took 5.97 seconds to spawn the instance on the hypervisor.
Aug 14 17:28:54 user nova-compute[73056]: DEBUG nova.compute.manager [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:28:54 user nova-compute[73056]: INFO nova.compute.manager [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Took 6.47 seconds to build instance.
Aug 14 17:28:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-02e91ff7-ba7b-4dbe-9f5d-488e6d38c59f tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "e936a340-b16f-462b-b282-23d96a481d62" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.561s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:28:54 user nova-compute[73056]: DEBUG nova.compute.manager [req-13d1043a-dc0d-4a4d-9a83-1391ef410eb5 req-6a0650d4-39ac-48ee-80e4-c9ea716fec73 service nova] [instance: e936a340-b16f-462b-b282-23d96a481d62] Received event network-vif-plugged-7a743e2f-6806-429b-b836-73147f0938ea {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:28:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-13d1043a-dc0d-4a4d-9a83-1391ef410eb5 req-6a0650d4-39ac-48ee-80e4-c9ea716fec73 service nova] Acquiring lock "e936a340-b16f-462b-b282-23d96a481d62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:28:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-13d1043a-dc0d-4a4d-9a83-1391ef410eb5 req-6a0650d4-39ac-48ee-80e4-c9ea716fec73 service nova] Lock "e936a340-b16f-462b-b282-23d96a481d62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:28:54 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-13d1043a-dc0d-4a4d-9a83-1391ef410eb5 req-6a0650d4-39ac-48ee-80e4-c9ea716fec73 service nova] Lock "e936a340-b16f-462b-b282-23d96a481d62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:28:54 user nova-compute[73056]: DEBUG nova.compute.manager [req-13d1043a-dc0d-4a4d-9a83-1391ef410eb5 req-6a0650d4-39ac-48ee-80e4-c9ea716fec73 service nova] [instance: e936a340-b16f-462b-b282-23d96a481d62] No waiting events found dispatching network-vif-plugged-7a743e2f-6806-429b-b836-73147f0938ea {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:28:54 user nova-compute[73056]: WARNING nova.compute.manager [req-13d1043a-dc0d-4a4d-9a83-1391ef410eb5 req-6a0650d4-39ac-48ee-80e4-c9ea716fec73 service nova] [instance: e936a340-b16f-462b-b282-23d96a481d62] Received unexpected event network-vif-plugged-7a743e2f-6806-429b-b836-73147f0938ea for instance with vm_state active and task_state None.
Aug 14 17:28:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:28:58 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:29:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:29:04 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:29:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:29:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:29:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:29:14 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:29:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:29:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:29:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:29:24 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:29:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:29:30 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:29:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:29:35 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:29:35 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 17:29:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:29:39 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:29:40 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:29:40 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 17:29:40 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Rebuilding the list of instances to heal {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 17:29:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-e936a340-b16f-462b-b282-23d96a481d62" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:29:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-e936a340-b16f-462b-b282-23d96a481d62" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:29:40 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: e936a340-b16f-462b-b282-23d96a481d62] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 17:29:40 user nova-compute[73056]: DEBUG nova.objects.instance [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lazy-loading 'info_cache' on Instance uuid e936a340-b16f-462b-b282-23d96a481d62 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:29:40 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: e936a340-b16f-462b-b282-23d96a481d62] Updating instance_info_cache with network_info: [{"id": "7a743e2f-6806-429b-b836-73147f0938ea", "address": "fa:16:3e:5d:be:38", "network": {"id": "496d6e84-b52b-4e7b-90e5-e4acac832552", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2046688465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf7c1ba6a6948e0bbd33a5fd441a8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a743e2f-68", "ovs_interfaceid": "7a743e2f-6806-429b-b836-73147f0938ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:29:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-e936a340-b16f-462b-b282-23d96a481d62" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:29:40 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: e936a340-b16f-462b-b282-23d96a481d62] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 17:29:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:29:42 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:29:44 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:29:45 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:29:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:29:46 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:29:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:29:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:29:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:29:46 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 17:29:46 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e936a340-b16f-462b-b282-23d96a481d62/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:29:46 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e936a340-b16f-462b-b282-23d96a481d62/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:29:46 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e936a340-b16f-462b-b282-23d96a481d62/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:29:46 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e936a340-b16f-462b-b282-23d96a481d62/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:29:47 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:29:47 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:29:47 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=8752MB free_disk=25.147701263427734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 17:29:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:29:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:29:47 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance e936a340-b16f-462b-b282-23d96a481d62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:29:47 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 17:29:47 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 17:29:47 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:29:47 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:29:47 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 17:29:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.331s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:29:48 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:29:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:29:56 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:30:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:30:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:30:11 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:30:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:30:21 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:30:26 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:30:31 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:30:31 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:30:36 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:30:36 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:30:36 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 17:30:39 user nova-compute[73056]: DEBUG nova.compute.manager [req-3311084c-d0ad-4cba-81e1-d46baf1bb92b req-4f687b95-d557-4b2c-ac6e-ca35e4524700 service nova] [instance: e936a340-b16f-462b-b282-23d96a481d62] Received event network-changed-7a743e2f-6806-429b-b836-73147f0938ea {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:30:39 user nova-compute[73056]: DEBUG nova.compute.manager [req-3311084c-d0ad-4cba-81e1-d46baf1bb92b req-4f687b95-d557-4b2c-ac6e-ca35e4524700 service nova] [instance: e936a340-b16f-462b-b282-23d96a481d62] Refreshing instance network info cache due to event network-changed-7a743e2f-6806-429b-b836-73147f0938ea. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 17:30:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3311084c-d0ad-4cba-81e1-d46baf1bb92b req-4f687b95-d557-4b2c-ac6e-ca35e4524700 service nova] Acquiring lock "refresh_cache-e936a340-b16f-462b-b282-23d96a481d62" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:30:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3311084c-d0ad-4cba-81e1-d46baf1bb92b req-4f687b95-d557-4b2c-ac6e-ca35e4524700 service nova] Acquired lock "refresh_cache-e936a340-b16f-462b-b282-23d96a481d62" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:30:39 user nova-compute[73056]: DEBUG nova.network.neutron [req-3311084c-d0ad-4cba-81e1-d46baf1bb92b req-4f687b95-d557-4b2c-ac6e-ca35e4524700 service nova] [instance: e936a340-b16f-462b-b282-23d96a481d62] Refreshing network info cache for port 7a743e2f-6806-429b-b836-73147f0938ea {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 17:30:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Acquiring lock "e936a340-b16f-462b-b282-23d96a481d62" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:30:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "e936a340-b16f-462b-b282-23d96a481d62" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:30:39 user nova-compute[73056]: DEBUG nova.objects.instance [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lazy-loading 'flavor' on Instance uuid e936a340-b16f-462b-b282-23d96a481d62 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:30:39 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Ignoring supplied device name: /dev/vdb
Aug 14 17:30:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "e936a340-b16f-462b-b282-23d96a481d62" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:30:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Acquiring lock "e936a340-b16f-462b-b282-23d96a481d62" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:30:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "e936a340-b16f-462b-b282-23d96a481d62" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:30:39 user nova-compute[73056]: INFO nova.compute.manager [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Attaching volume 458ff61c-8f3d-423d-8cab-0b9013ee1f46 to /dev/vdb
Aug 14 17:30:39 user nova-compute[73056]: DEBUG nova.network.neutron [req-3311084c-d0ad-4cba-81e1-d46baf1bb92b req-4f687b95-d557-4b2c-ac6e-ca35e4524700 service nova] [instance: e936a340-b16f-462b-b282-23d96a481d62] Updated VIF entry in instance network info cache for port 7a743e2f-6806-429b-b836-73147f0938ea. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 17:30:39 user nova-compute[73056]: DEBUG nova.network.neutron [req-3311084c-d0ad-4cba-81e1-d46baf1bb92b req-4f687b95-d557-4b2c-ac6e-ca35e4524700 service nova] [instance: e936a340-b16f-462b-b282-23d96a481d62] Updating instance_info_cache with network_info: [{"id": "7a743e2f-6806-429b-b836-73147f0938ea", "address": "fa:16:3e:5d:be:38", "network": {"id": "496d6e84-b52b-4e7b-90e5-e4acac832552", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2046688465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf7c1ba6a6948e0bbd33a5fd441a8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a743e2f-68", "ovs_interfaceid": "7a743e2f-6806-429b-b836-73147f0938ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:30:39 user nova-compute[73056]: DEBUG os_brick.utils [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 17:30:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:30:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-3311084c-d0ad-4cba-81e1-d46baf1bb92b req-4f687b95-d557-4b2c-ac6e-ca35e4524700 service nova] Releasing lock "refresh_cache-e936a340-b16f-462b-b282-23d96a481d62" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:30:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:30:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c506d4a2-ec57-40d0-88c6-42219ce7e738]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:30:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:30:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:30:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37b91b7-f2f4-4244-8670-4107bbd037f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:30:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:30:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:30:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8dca462-9aad-4377-ac3a-0b025b9fbd7f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:30:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f518a60e-dfe0-4b25-9991-1cf5587d5948]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:30:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:30:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 17:30:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 17:30:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:30:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 17:30:39 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 17:30:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[db005206-a8d2-4877-b2a5-0593df3424dc]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:30:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 17:30:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 17:30:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 17:30:39 user nova-compute[73056]: DEBUG os_brick.utils [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 17:30:39 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Updating existing volume attachment record: d4c6f457-3dde-40da-a366-50ba18241c59 {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 17:30:40 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:30:40 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:30:40 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 17:30:40 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Rebuilding the list of instances to heal {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 17:30:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-e936a340-b16f-462b-b282-23d96a481d62" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:30:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-e936a340-b16f-462b-b282-23d96a481d62" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:30:40 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: e936a340-b16f-462b-b282-23d96a481d62] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 17:30:40 user nova-compute[73056]: DEBUG nova.objects.instance [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lazy-loading 'info_cache' on Instance uuid e936a340-b16f-462b-b282-23d96a481d62 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:30:40 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: e936a340-b16f-462b-b282-23d96a481d62] Updating instance_info_cache with network_info: [{"id": "7a743e2f-6806-429b-b836-73147f0938ea", "address": "fa:16:3e:5d:be:38", "network": {"id": "496d6e84-b52b-4e7b-90e5-e4acac832552", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2046688465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf7c1ba6a6948e0bbd33a5fd441a8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a743e2f-68", "ovs_interfaceid": "7a743e2f-6806-429b-b836-73147f0938ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:30:40 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-e936a340-b16f-462b-b282-23d96a481d62" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:30:40 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: e936a340-b16f-462b-b282-23d96a481d62] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 17:30:41 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:30:43 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:30:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:30:45 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:30:46 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:30:47 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:30:47 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:30:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:30:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:30:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:30:47 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 17:30:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e936a340-b16f-462b-b282-23d96a481d62/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:30:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e936a340-b16f-462b-b282-23d96a481d62/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:30:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e936a340-b16f-462b-b282-23d96a481d62/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:30:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e936a340-b16f-462b-b282-23d96a481d62/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LgupvTek', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 17:30:48 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 17:30:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 17:30:48 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 17:30:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 17:30:48 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 17:30:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46 -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:30:48 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:30:48 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:30:48 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=8773MB free_disk=25.14691162109375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd137515-374d-4186-95ba-728c2432ad81]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 17:30:48 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46 -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcec5e1a-749d-4317-b4d9-0271d7abbc32]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46] added
Aug 14 17:30:48 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[407f9958-4286-4148-890c-71a667a26c8a]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance e936a340-b16f-462b-b282-23d96a481d62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f131e22e-17b0-4c44-90c4-6b55971d1723]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LgupvTek {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LgupvTek" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92aada1-3c51-4f50-82ec-f52df3ab86da]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LgupvTek'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[959ea402-3f40-4668-95e6-b7bc5d0eec30]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca981199-8e29-4557-8a12-5df760edfdcf]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 17:30:48 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 17:30:48 user nova-compute[73056]:  {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 17:30:48 user nova-compute[73056]: WARNING os_brick.initiator.connectors.iscsi [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 17:30:48 user nova-compute[73056]: 
Aug 14 17:30:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46 -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa44f68-a4aa-4ec9-ad0e-b38be00588b8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46, portal: 172.16.0.220,3260]
Aug 14 17:30:48 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46, portal: 172.16.0.220,3260] successful.
Aug 14 17:30:48 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d51c58e-1c86-4274-b083-dec81c321223]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3207ec-76c2-407f-bcc5-7cf8bb6d9933]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46 (non-flash)
Aug 14 17:30:48 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46 (non-flash)
Aug 14 17:30:48 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[29cae338-9af0-4b3a-a120-d1042dbc5be6]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 17:30:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LgupvTek', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 17:30:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:30:49 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:30:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 17:30:49 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23364373764633562', 'path': '/dev/sdb'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 17:30:49 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364373764633562', 'path': '/dev/sdb'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 17:30:49 user nova-compute[73056]: DEBUG nova.objects.instance [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lazy-loading 'flavor' on Instance uuid e936a340-b16f-462b-b282-23d96a481d62 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:30:49 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 17:30:49 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 17:30:49 user nova-compute[73056]:   <source dev="/dev/sdb"/>
Aug 14 17:30:49 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 17:30:49 user nova-compute[73056]:   <serial>458ff61c-8f3d-423d-8cab-0b9013ee1f46</serial>
Aug 14 17:30:49 user nova-compute[73056]: </disk>
Aug 14 17:30:49 user nova-compute[73056]:  {{(pid=73056) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 17:30:49 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 17:30:49 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 17:30:49 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] No VIF found with MAC fa:16:3e:5d:be:38, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 17:30:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7426559c-a5fe-461e-8006-2481a6571eaa tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "e936a340-b16f-462b-b282-23d96a481d62" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.242s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:30:50 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:30:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:30:56 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:30:59 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:31:01 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:31:06 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:31:11 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:31:14 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:31:16 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:31:21 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:31:26 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:31:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fcd2a3f1-f049-4b9b-a006-17b44ead8099 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Acquiring lock "e936a340-b16f-462b-b282-23d96a481d62" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:31:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fcd2a3f1-f049-4b9b-a006-17b44ead8099 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "e936a340-b16f-462b-b282-23d96a481d62" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:31:27 user nova-compute[73056]: INFO nova.compute.manager [None req-fcd2a3f1-f049-4b9b-a006-17b44ead8099 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Detaching volume 458ff61c-8f3d-423d-8cab-0b9013ee1f46
Aug 14 17:31:27 user nova-compute[73056]: INFO nova.virt.block_device [None req-fcd2a3f1-f049-4b9b-a006-17b44ead8099 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Attempting to driver detach volume 458ff61c-8f3d-423d-8cab-0b9013ee1f46 from mountpoint /dev/vdb
Aug 14 17:31:27 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-fcd2a3f1-f049-4b9b-a006-17b44ead8099 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Attempting to detach device vdb from instance e936a340-b16f-462b-b282-23d96a481d62 from the persistent domain config. {{(pid=73056) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 17:31:27 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-fcd2a3f1-f049-4b9b-a006-17b44ead8099 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 17:31:27 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 17:31:27 user nova-compute[73056]:   <source dev="/dev/sdb"/>
Aug 14 17:31:27 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 17:31:27 user nova-compute[73056]:   <serial>458ff61c-8f3d-423d-8cab-0b9013ee1f46</serial>
Aug 14 17:31:27 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 17:31:27 user nova-compute[73056]: </disk>
Aug 14 17:31:27 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 17:31:27 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-fcd2a3f1-f049-4b9b-a006-17b44ead8099 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Successfully detached device vdb from instance e936a340-b16f-462b-b282-23d96a481d62 from the persistent domain config.
Aug 14 17:31:27 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-fcd2a3f1-f049-4b9b-a006-17b44ead8099 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e936a340-b16f-462b-b282-23d96a481d62 from the live domain config. {{(pid=73056) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 17:31:27 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-fcd2a3f1-f049-4b9b-a006-17b44ead8099 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 17:31:27 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 17:31:27 user nova-compute[73056]:   <source dev="/dev/sdb"/>
Aug 14 17:31:27 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 17:31:27 user nova-compute[73056]:   <serial>458ff61c-8f3d-423d-8cab-0b9013ee1f46</serial>
Aug 14 17:31:27 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 17:31:27 user nova-compute[73056]: </disk>
Aug 14 17:31:27 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 17:31:27 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Acquiring lock "e936a340-b16f-462b-b282-23d96a481d62" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Received event <DeviceRemovedEvent: 1692034288.2874422, e936a340-b16f-462b-b282-23d96a481d62 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73056) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-fcd2a3f1-f049-4b9b-a006-17b44ead8099 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e936a340-b16f-462b-b282-23d96a481d62 {{(pid=73056) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 17:31:28 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-fcd2a3f1-f049-4b9b-a006-17b44ead8099 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Successfully detached device vdb from instance e936a340-b16f-462b-b282-23d96a481d62 from the live domain config.
Aug 14 17:31:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcd2a3f1-f049-4b9b-a006-17b44ead8099 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd2a3f1-f049-4b9b-a006-17b44ead8099 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LgupvTek', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 17:31:28 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-fcd2a3f1-f049-4b9b-a006-17b44ead8099 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 17:31:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-fcd2a3f1-f049-4b9b-a006-17b44ead8099 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-fcd2a3f1-f049-4b9b-a006-17b44ead8099 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd2a3f1-f049-4b9b-a006-17b44ead8099 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7583eff-225a-4c3f-9baa-393862461243]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d058f3-405e-4397-b6b6-8ceb77b23ba7]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd2a3f1-f049-4b9b-a006-17b44ead8099 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46 (non-flash)
Aug 14 17:31:28 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd2a3f1-f049-4b9b-a006-17b44ead8099 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46 (non-flash)
Aug 14 17:31:28 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd2a3f1-f049-4b9b-a006-17b44ead8099 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff300601750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46'): ({'sdb'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-fcd2a3f1-f049-4b9b-a006-17b44ead8099 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Removing single pathed devices sdb {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f311553-6866-4535-896c-c1bfefdbfeb8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bd0e38-8925-460e-9b6f-692e438dd35b]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-fcd2a3f1-f049-4b9b-a006-17b44ead8099 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Flushing IO for device /dev/sdb {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4902a7b-b0c0-4f64-a7be-b360b2e328c6]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-fcd2a3f1-f049-4b9b-a006-17b44ead8099 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a307dc4e-0e4b-4915-907a-a4707c1010b6]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-fcd2a3f1-f049-4b9b-a006-17b44ead8099 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-fcd2a3f1-f049-4b9b-a006-17b44ead8099 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] SCSI volumes sdb have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd2a3f1-f049-4b9b-a006-17b44ead8099 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[a840302f-eb3f-40ef-9ed3-c49689d58b16]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd2a3f1-f049-4b9b-a006-17b44ead8099 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46 -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[59de3845-e649-4b39-836f-f1f507caba61]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd2a3f1-f049-4b9b-a006-17b44ead8099 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46, portal: 172.16.0.220,3260]
Aug 14 17:31:28 user nova-compute[73056]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46, portal: 172.16.0.220,3260] successful.
Aug 14 17:31:28 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46 -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d58341-95df-4ab7-9b61-ffdd580ac924]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd2a3f1-f049-4b9b-a006-17b44ead8099 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-fcd2a3f1-f049-4b9b-a006-17b44ead8099 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.251s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd2a3f1-f049-4b9b-a006-17b44ead8099 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] <== disconnect_volume: return (253ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 17:31:28 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcd2a3f1-f049-4b9b-a006-17b44ead8099 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 17:31:29 user nova-compute[73056]: DEBUG nova.objects.instance [None req-fcd2a3f1-f049-4b9b-a006-17b44ead8099 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lazy-loading 'flavor' on Instance uuid e936a340-b16f-462b-b282-23d96a481d62 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:31:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-fcd2a3f1-f049-4b9b-a006-17b44ead8099 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "e936a340-b16f-462b-b282-23d96a481d62" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.578s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:31:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "e936a340-b16f-462b-b282-23d96a481d62" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.403s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:31:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Acquiring lock "e936a340-b16f-462b-b282-23d96a481d62-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:31:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "e936a340-b16f-462b-b282-23d96a481d62-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:31:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "e936a340-b16f-462b-b282-23d96a481d62-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:31:29 user nova-compute[73056]: INFO nova.compute.manager [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Terminating instance
Aug 14 17:31:29 user nova-compute[73056]: DEBUG nova.compute.manager [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 17:31:29 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:31:29 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:31:29 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:31:29 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:31:29 user nova-compute[73056]: DEBUG nova.compute.manager [req-d27fb8cb-a3e3-4a93-9f48-a019c44d9a1a req-85ab6dad-c34e-4a5f-b7ec-6f7d4348ce8d service nova] [instance: e936a340-b16f-462b-b282-23d96a481d62] Received event network-vif-unplugged-7a743e2f-6806-429b-b836-73147f0938ea {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:31:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-d27fb8cb-a3e3-4a93-9f48-a019c44d9a1a req-85ab6dad-c34e-4a5f-b7ec-6f7d4348ce8d service nova] Acquiring lock "e936a340-b16f-462b-b282-23d96a481d62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:31:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-d27fb8cb-a3e3-4a93-9f48-a019c44d9a1a req-85ab6dad-c34e-4a5f-b7ec-6f7d4348ce8d service nova] Lock "e936a340-b16f-462b-b282-23d96a481d62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:31:29 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-d27fb8cb-a3e3-4a93-9f48-a019c44d9a1a req-85ab6dad-c34e-4a5f-b7ec-6f7d4348ce8d service nova] Lock "e936a340-b16f-462b-b282-23d96a481d62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:31:29 user nova-compute[73056]: DEBUG nova.compute.manager [req-d27fb8cb-a3e3-4a93-9f48-a019c44d9a1a req-85ab6dad-c34e-4a5f-b7ec-6f7d4348ce8d service nova] [instance: e936a340-b16f-462b-b282-23d96a481d62] No waiting events found dispatching network-vif-unplugged-7a743e2f-6806-429b-b836-73147f0938ea {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:31:29 user nova-compute[73056]: DEBUG nova.compute.manager [req-d27fb8cb-a3e3-4a93-9f48-a019c44d9a1a req-85ab6dad-c34e-4a5f-b7ec-6f7d4348ce8d service nova] [instance: e936a340-b16f-462b-b282-23d96a481d62] Received event network-vif-unplugged-7a743e2f-6806-429b-b836-73147f0938ea for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 17:31:29 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:31:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:31:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:31:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:31:30 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: e936a340-b16f-462b-b282-23d96a481d62] Instance destroyed successfully.
Aug 14 17:31:30 user nova-compute[73056]: DEBUG nova.objects.instance [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lazy-loading 'resources' on Instance uuid e936a340-b16f-462b-b282-23d96a481d62 {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:31:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:31:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T17:28:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1343956225',display_name='tempest-VolumesSnapshotTestJSON-instance-1343956225',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1343956225',id=51,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJkoVsr/XeDj5eh9khTVcdsFu9Je7ddd6ATdhREirtCvMViFj75Mcr/mW0H2bCUKZTMZSJvRD+sA0k3KrNxZAXCsXbuEGDW9TWYtGZGUWI4t3i21clIH5USoFkIfr7Vcxw==',key_name='tempest-keypair-986627302',keypairs=<?>,launch_index=0,launched_at=2023-08-14T17:28:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fdf7c1ba6a6948e0bbd33a5fd441a8b2',ramdisk_id='',reservation_id='r-0tz1hrxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-110053267',owner_user_name='tempest-VolumesSnapshotTestJSON-110053267-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T17:28:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc1f9d0085ef4175815a04fa62d46a6d',uuid=e936a340-b16f-462b-b282-23d96a481d62,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a743e2f-6806-429b-b836-73147f0938ea", "address": "fa:16:3e:5d:be:38", "network": {"id": "496d6e84-b52b-4e7b-90e5-e4acac832552", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2046688465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf7c1ba6a6948e0bbd33a5fd441a8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a743e2f-68", "ovs_interfaceid": "7a743e2f-6806-429b-b836-73147f0938ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 17:31:30 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Converting VIF {"id": "7a743e2f-6806-429b-b836-73147f0938ea", "address": "fa:16:3e:5d:be:38", "network": {"id": "496d6e84-b52b-4e7b-90e5-e4acac832552", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2046688465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf7c1ba6a6948e0bbd33a5fd441a8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a743e2f-68", "ovs_interfaceid": "7a743e2f-6806-429b-b836-73147f0938ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:31:30 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:be:38,bridge_name='br-int',has_traffic_filtering=True,id=7a743e2f-6806-429b-b836-73147f0938ea,network=Network(496d6e84-b52b-4e7b-90e5-e4acac832552),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a743e2f-68') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:31:30 user nova-compute[73056]: DEBUG os_vif [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:be:38,bridge_name='br-int',has_traffic_filtering=True,id=7a743e2f-6806-429b-b836-73147f0938ea,network=Network(496d6e84-b52b-4e7b-90e5-e4acac832552),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a743e2f-68') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 17:31:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:31:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a743e2f-68, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:31:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:31:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:31:30 user nova-compute[73056]: INFO os_vif [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:be:38,bridge_name='br-int',has_traffic_filtering=True,id=7a743e2f-6806-429b-b836-73147f0938ea,network=Network(496d6e84-b52b-4e7b-90e5-e4acac832552),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a743e2f-68')
Aug 14 17:31:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 17:31:30 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LgupvTek', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 17:31:30 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 17:31:30 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 17:31:30 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 17:31:30 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:458ff61c-8f3d-423d-8cab-0b9013ee1f46', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 17:31:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:31:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 21 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:31:30 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[45365ce4-883b-4b75-bca7-39c27473dee7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:31:30 user nova-compute[73056]: WARNING os_brick.initiator.connectors.iscsi [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
Aug 14 17:31:30 user nova-compute[73056]: 
Aug 14 17:31:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:31:30 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:31:30 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[54157e4a-74e2-4026-9547-112ca1178fa2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:31:30 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 17:31:30 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 17:31:30 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 17:31:30 user nova-compute[73056]:  {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 17:31:30 user nova-compute[73056]: WARNING os_brick.initiator.connectors.iscsi [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 17:31:30 user nova-compute[73056]: 
Aug 14 17:31:30 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff2dce47010>, {}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 17:31:30 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Disconnecting from: [] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 17:31:30 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.046s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 17:31:30 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] <== disconnect_volume: return (46ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 17:31:30 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 17:31:30 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Deleting instance files /opt/stack/data/nova/instances/e936a340-b16f-462b-b282-23d96a481d62_del
Aug 14 17:31:30 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Deletion of /opt/stack/data/nova/instances/e936a340-b16f-462b-b282-23d96a481d62_del complete
Aug 14 17:31:30 user nova-compute[73056]: INFO nova.compute.manager [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 14 17:31:30 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 17:31:30 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: e936a340-b16f-462b-b282-23d96a481d62] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 17:31:30 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: e936a340-b16f-462b-b282-23d96a481d62] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 17:31:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:31:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:31:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:31:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:31:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:31:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:31:31 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: e936a340-b16f-462b-b282-23d96a481d62] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:31:31 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: e936a340-b16f-462b-b282-23d96a481d62] Took 0.91 seconds to deallocate network for instance.
Aug 14 17:31:31 user nova-compute[73056]: DEBUG nova.compute.manager [req-be985527-5b06-42b3-b5cc-543d713bca87 req-c80ff10e-2aa3-4ca7-b501-24ff214d0c25 service nova] [instance: e936a340-b16f-462b-b282-23d96a481d62] Received event network-vif-deleted-7a743e2f-6806-429b-b836-73147f0938ea {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:31:31 user nova-compute[73056]: WARNING nova.volume.cinder [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Attachment d4c6f457-3dde-40da-a366-50ba18241c59 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = d4c6f457-3dde-40da-a366-50ba18241c59. (HTTP 404) (Request-ID: req-92b02744-6502-4ae2-80d9-79d05a177f6f)
Aug 14 17:31:31 user nova-compute[73056]: INFO nova.compute.manager [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: e936a340-b16f-462b-b282-23d96a481d62] Took 0.03 seconds to detach 1 volumes for instance.
Aug 14 17:31:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:31:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:31:31 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:31:31 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:31:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.110s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:31:31 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Deleted allocations for instance e936a340-b16f-462b-b282-23d96a481d62
Aug 14 17:31:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-7c53a9f6-7158-4dc3-9357-162be0f11227 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "e936a340-b16f-462b-b282-23d96a481d62" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.135s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:31:31 user nova-compute[73056]: DEBUG nova.compute.manager [req-1560a953-566e-4c10-9277-3f9dc6e56455 req-d1c537be-80db-4c32-857e-beec7e6c9a1a service nova] [instance: e936a340-b16f-462b-b282-23d96a481d62] Received event network-vif-plugged-7a743e2f-6806-429b-b836-73147f0938ea {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:31:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1560a953-566e-4c10-9277-3f9dc6e56455 req-d1c537be-80db-4c32-857e-beec7e6c9a1a service nova] Acquiring lock "e936a340-b16f-462b-b282-23d96a481d62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:31:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1560a953-566e-4c10-9277-3f9dc6e56455 req-d1c537be-80db-4c32-857e-beec7e6c9a1a service nova] Lock "e936a340-b16f-462b-b282-23d96a481d62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:31:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1560a953-566e-4c10-9277-3f9dc6e56455 req-d1c537be-80db-4c32-857e-beec7e6c9a1a service nova] Lock "e936a340-b16f-462b-b282-23d96a481d62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:31:31 user nova-compute[73056]: DEBUG nova.compute.manager [req-1560a953-566e-4c10-9277-3f9dc6e56455 req-d1c537be-80db-4c32-857e-beec7e6c9a1a service nova] [instance: e936a340-b16f-462b-b282-23d96a481d62] No waiting events found dispatching network-vif-plugged-7a743e2f-6806-429b-b836-73147f0938ea {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:31:31 user nova-compute[73056]: WARNING nova.compute.manager [req-1560a953-566e-4c10-9277-3f9dc6e56455 req-d1c537be-80db-4c32-857e-beec7e6c9a1a service nova] [instance: e936a340-b16f-462b-b282-23d96a481d62] Received unexpected event network-vif-plugged-7a743e2f-6806-429b-b836-73147f0938ea for instance with vm_state deleted and task_state None.
Aug 14 17:31:31 user nova-compute[73056]: DEBUG nova.compute.manager [req-1560a953-566e-4c10-9277-3f9dc6e56455 req-d1c537be-80db-4c32-857e-beec7e6c9a1a service nova] [instance: e936a340-b16f-462b-b282-23d96a481d62] Received event network-vif-plugged-7a743e2f-6806-429b-b836-73147f0938ea {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:31:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1560a953-566e-4c10-9277-3f9dc6e56455 req-d1c537be-80db-4c32-857e-beec7e6c9a1a service nova] Acquiring lock "e936a340-b16f-462b-b282-23d96a481d62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:31:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1560a953-566e-4c10-9277-3f9dc6e56455 req-d1c537be-80db-4c32-857e-beec7e6c9a1a service nova] Lock "e936a340-b16f-462b-b282-23d96a481d62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:31:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1560a953-566e-4c10-9277-3f9dc6e56455 req-d1c537be-80db-4c32-857e-beec7e6c9a1a service nova] Lock "e936a340-b16f-462b-b282-23d96a481d62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:31:31 user nova-compute[73056]: DEBUG nova.compute.manager [req-1560a953-566e-4c10-9277-3f9dc6e56455 req-d1c537be-80db-4c32-857e-beec7e6c9a1a service nova] [instance: e936a340-b16f-462b-b282-23d96a481d62] No waiting events found dispatching network-vif-plugged-7a743e2f-6806-429b-b836-73147f0938ea {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:31:31 user nova-compute[73056]: WARNING nova.compute.manager [req-1560a953-566e-4c10-9277-3f9dc6e56455 req-d1c537be-80db-4c32-857e-beec7e6c9a1a service nova] [instance: e936a340-b16f-462b-b282-23d96a481d62] Received unexpected event network-vif-plugged-7a743e2f-6806-429b-b836-73147f0938ea for instance with vm_state deleted and task_state None.
Aug 14 17:31:31 user nova-compute[73056]: DEBUG nova.compute.manager [req-1560a953-566e-4c10-9277-3f9dc6e56455 req-d1c537be-80db-4c32-857e-beec7e6c9a1a service nova] [instance: e936a340-b16f-462b-b282-23d96a481d62] Received event network-vif-plugged-7a743e2f-6806-429b-b836-73147f0938ea {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:31:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1560a953-566e-4c10-9277-3f9dc6e56455 req-d1c537be-80db-4c32-857e-beec7e6c9a1a service nova] Acquiring lock "e936a340-b16f-462b-b282-23d96a481d62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:31:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1560a953-566e-4c10-9277-3f9dc6e56455 req-d1c537be-80db-4c32-857e-beec7e6c9a1a service nova] Lock "e936a340-b16f-462b-b282-23d96a481d62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:31:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1560a953-566e-4c10-9277-3f9dc6e56455 req-d1c537be-80db-4c32-857e-beec7e6c9a1a service nova] Lock "e936a340-b16f-462b-b282-23d96a481d62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:31:31 user nova-compute[73056]: DEBUG nova.compute.manager [req-1560a953-566e-4c10-9277-3f9dc6e56455 req-d1c537be-80db-4c32-857e-beec7e6c9a1a service nova] [instance: e936a340-b16f-462b-b282-23d96a481d62] No waiting events found dispatching network-vif-plugged-7a743e2f-6806-429b-b836-73147f0938ea {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:31:31 user nova-compute[73056]: WARNING nova.compute.manager [req-1560a953-566e-4c10-9277-3f9dc6e56455 req-d1c537be-80db-4c32-857e-beec7e6c9a1a service nova] [instance: e936a340-b16f-462b-b282-23d96a481d62] Received unexpected event network-vif-plugged-7a743e2f-6806-429b-b836-73147f0938ea for instance with vm_state deleted and task_state None.
Aug 14 17:31:31 user nova-compute[73056]: DEBUG nova.compute.manager [req-1560a953-566e-4c10-9277-3f9dc6e56455 req-d1c537be-80db-4c32-857e-beec7e6c9a1a service nova] [instance: e936a340-b16f-462b-b282-23d96a481d62] Received event network-vif-unplugged-7a743e2f-6806-429b-b836-73147f0938ea {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:31:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1560a953-566e-4c10-9277-3f9dc6e56455 req-d1c537be-80db-4c32-857e-beec7e6c9a1a service nova] Acquiring lock "e936a340-b16f-462b-b282-23d96a481d62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:31:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1560a953-566e-4c10-9277-3f9dc6e56455 req-d1c537be-80db-4c32-857e-beec7e6c9a1a service nova] Lock "e936a340-b16f-462b-b282-23d96a481d62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:31:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1560a953-566e-4c10-9277-3f9dc6e56455 req-d1c537be-80db-4c32-857e-beec7e6c9a1a service nova] Lock "e936a340-b16f-462b-b282-23d96a481d62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:31:31 user nova-compute[73056]: DEBUG nova.compute.manager [req-1560a953-566e-4c10-9277-3f9dc6e56455 req-d1c537be-80db-4c32-857e-beec7e6c9a1a service nova] [instance: e936a340-b16f-462b-b282-23d96a481d62] No waiting events found dispatching network-vif-unplugged-7a743e2f-6806-429b-b836-73147f0938ea {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:31:31 user nova-compute[73056]: WARNING nova.compute.manager [req-1560a953-566e-4c10-9277-3f9dc6e56455 req-d1c537be-80db-4c32-857e-beec7e6c9a1a service nova] [instance: e936a340-b16f-462b-b282-23d96a481d62] Received unexpected event network-vif-unplugged-7a743e2f-6806-429b-b836-73147f0938ea for instance with vm_state deleted and task_state None.
Aug 14 17:31:31 user nova-compute[73056]: DEBUG nova.compute.manager [req-1560a953-566e-4c10-9277-3f9dc6e56455 req-d1c537be-80db-4c32-857e-beec7e6c9a1a service nova] [instance: e936a340-b16f-462b-b282-23d96a481d62] Received event network-vif-plugged-7a743e2f-6806-429b-b836-73147f0938ea {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:31:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1560a953-566e-4c10-9277-3f9dc6e56455 req-d1c537be-80db-4c32-857e-beec7e6c9a1a service nova] Acquiring lock "e936a340-b16f-462b-b282-23d96a481d62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:31:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1560a953-566e-4c10-9277-3f9dc6e56455 req-d1c537be-80db-4c32-857e-beec7e6c9a1a service nova] Lock "e936a340-b16f-462b-b282-23d96a481d62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:31:31 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1560a953-566e-4c10-9277-3f9dc6e56455 req-d1c537be-80db-4c32-857e-beec7e6c9a1a service nova] Lock "e936a340-b16f-462b-b282-23d96a481d62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:31:31 user nova-compute[73056]: DEBUG nova.compute.manager [req-1560a953-566e-4c10-9277-3f9dc6e56455 req-d1c537be-80db-4c32-857e-beec7e6c9a1a service nova] [instance: e936a340-b16f-462b-b282-23d96a481d62] No waiting events found dispatching network-vif-plugged-7a743e2f-6806-429b-b836-73147f0938ea {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:31:31 user nova-compute[73056]: WARNING nova.compute.manager [req-1560a953-566e-4c10-9277-3f9dc6e56455 req-d1c537be-80db-4c32-857e-beec7e6c9a1a service nova] [instance: e936a340-b16f-462b-b282-23d96a481d62] Received unexpected event network-vif-plugged-7a743e2f-6806-429b-b836-73147f0938ea for instance with vm_state deleted and task_state None.
Aug 14 17:31:33 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:31:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:31:38 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:31:38 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 17:31:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:31:41 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:31:42 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:31:42 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 17:31:42 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Rebuilding the list of instances to heal {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 17:31:42 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Didn't find any instances for network info cache update. {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 17:31:43 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:31:44 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:31:45 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692034290.074426, e936a340-b16f-462b-b282-23d96a481d62 => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:31:45 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: e936a340-b16f-462b-b282-23d96a481d62] VM Stopped (Lifecycle Event)
Aug 14 17:31:45 user nova-compute[73056]: DEBUG nova.compute.manager [None req-82f5b80c-200c-423e-9f19-c40375b05334 None None] [instance: e936a340-b16f-462b-b282-23d96a481d62] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:31:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:31:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:31:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:31:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:31:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:31:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:31:46 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:31:47 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:31:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:31:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:31:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:31:47 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 17:31:47 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:31:47 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:31:47 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=8861MB free_disk=25.173480987548828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 17:31:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:31:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:31:47 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 17:31:47 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 17:31:47 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:31:47 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:31:47 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 17:31:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.138s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:31:49 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:31:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:31:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:31:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:31:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:31:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:31:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:31:50 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:31:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:32:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:32:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:32:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:32:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:32:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:32:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:32:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:32:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:32:34 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:32:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:32:38 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:32:38 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 17:32:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:32:41 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:32:44 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:32:44 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 17:32:44 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Rebuilding the list of instances to heal {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 17:32:44 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Didn't find any instances for network info cache update. {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 17:32:44 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:32:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:32:46 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:32:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Acquiring lock "fbffc715-52da-4a96-83a1-f20898a078ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:32:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "fbffc715-52da-4a96-83a1-f20898a078ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:32:47 user nova-compute[73056]: DEBUG nova.compute.manager [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Starting instance... {{(pid=73056) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 17:32:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:32:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:32:47 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73056) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 17:32:47 user nova-compute[73056]: INFO nova.compute.claims [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Claim successful on node user
Aug 14 17:32:47 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:32:47 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:32:47 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:32:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:32:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.199s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:32:47 user nova-compute[73056]: DEBUG nova.compute.manager [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Start building networks asynchronously for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 17:32:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.011s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:32:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:32:47 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 17:32:47 user nova-compute[73056]: DEBUG nova.compute.manager [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Allocating IP information in the background. {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 17:32:47 user nova-compute[73056]: DEBUG nova.network.neutron [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] allocate_for_instance() {{(pid=73056) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 17:32:47 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 17:32:47 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:32:47 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:32:47 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=8896MB free_disk=25.164409637451172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 17:32:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:32:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:32:47 user nova-compute[73056]: DEBUG nova.compute.manager [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Start building block device mappings for instance. {{(pid=73056) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 17:32:47 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance fbffc715-52da-4a96-83a1-f20898a078ae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:32:47 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 17:32:47 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 17:32:47 user nova-compute[73056]: DEBUG nova.policy [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cc1f9d0085ef4175815a04fa62d46a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7c1ba6a6948e0bbd33a5fd441a8b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73056) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 17:32:47 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:32:47 user nova-compute[73056]: DEBUG nova.compute.manager [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Start spawning the instance on the hypervisor. {{(pid=73056) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 17:32:47 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Creating instance directory {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 17:32:47 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Creating image(s)
Aug 14 17:32:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Acquiring lock "/opt/stack/data/nova/instances/fbffc715-52da-4a96-83a1-f20898a078ae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:32:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "/opt/stack/data/nova/instances/fbffc715-52da-4a96-83a1-f20898a078ae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:32:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "/opt/stack/data/nova/instances/fbffc715-52da-4a96-83a1-f20898a078ae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:32:48 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:32:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:32:48 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 17:32:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.211s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:32:48 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:32:48 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73056) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 17:32:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.179s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:32:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Acquiring lock "c889592ab94cd0b0ce896f27a2af0323771db234" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:32:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:32:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:32:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.170s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:32:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/fbffc715-52da-4a96-83a1-f20898a078ae/disk 1073741824 {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:32:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234,backing_fmt=raw /opt/stack/data/nova/instances/fbffc715-52da-4a96-83a1-f20898a078ae/disk 1073741824" returned: 0 in 0.048s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:32:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "c889592ab94cd0b0ce896f27a2af0323771db234" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:32:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:32:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c889592ab94cd0b0ce896f27a2af0323771db234 --force-share --output=json" returned: 0 in 0.171s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:32:48 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fbffc715-52da-4a96-83a1-f20898a078ae/disk. size=1073741824 {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 17:32:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbffc715-52da-4a96-83a1-f20898a078ae/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:32:48 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbffc715-52da-4a96-83a1-f20898a078ae/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:32:48 user nova-compute[73056]: DEBUG nova.virt.disk.api [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Cannot resize image /opt/stack/data/nova/instances/fbffc715-52da-4a96-83a1-f20898a078ae/disk to a smaller size. {{(pid=73056) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 17:32:48 user nova-compute[73056]: DEBUG nova.objects.instance [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lazy-loading 'migration_context' on Instance uuid fbffc715-52da-4a96-83a1-f20898a078ae {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:32:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Created local disks {{(pid=73056) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 17:32:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Ensure instance console log exists: /opt/stack/data/nova/instances/fbffc715-52da-4a96-83a1-f20898a078ae/console.log {{(pid=73056) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 17:32:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:32:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:32:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:32:49 user nova-compute[73056]: DEBUG nova.network.neutron [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Successfully created port: 93c9385f-b22e-4272-b6d5-5ff92b938bec {{(pid=73056) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 17:32:49 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:32:49 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:32:49 user nova-compute[73056]: DEBUG nova.network.neutron [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Successfully updated port: 93c9385f-b22e-4272-b6d5-5ff92b938bec {{(pid=73056) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 17:32:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Acquiring lock "refresh_cache-fbffc715-52da-4a96-83a1-f20898a078ae" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:32:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Acquired lock "refresh_cache-fbffc715-52da-4a96-83a1-f20898a078ae" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:32:49 user nova-compute[73056]: DEBUG nova.network.neutron [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Building network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 17:32:49 user nova-compute[73056]: DEBUG nova.compute.manager [req-8e485623-1067-4403-92ff-540085212884 req-41b3e9b1-bff0-44b9-a8ff-3be977770c8d service nova] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Received event network-changed-93c9385f-b22e-4272-b6d5-5ff92b938bec {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:32:49 user nova-compute[73056]: DEBUG nova.compute.manager [req-8e485623-1067-4403-92ff-540085212884 req-41b3e9b1-bff0-44b9-a8ff-3be977770c8d service nova] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Refreshing instance network info cache due to event network-changed-93c9385f-b22e-4272-b6d5-5ff92b938bec. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 17:32:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8e485623-1067-4403-92ff-540085212884 req-41b3e9b1-bff0-44b9-a8ff-3be977770c8d service nova] Acquiring lock "refresh_cache-fbffc715-52da-4a96-83a1-f20898a078ae" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:32:49 user nova-compute[73056]: DEBUG nova.network.neutron [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Instance cache missing network info. {{(pid=73056) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG nova.network.neutron [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Updating instance_info_cache with network_info: [{"id": "93c9385f-b22e-4272-b6d5-5ff92b938bec", "address": "fa:16:3e:a3:2a:77", "network": {"id": "496d6e84-b52b-4e7b-90e5-e4acac832552", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2046688465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf7c1ba6a6948e0bbd33a5fd441a8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c9385f-b2", "ovs_interfaceid": "93c9385f-b22e-4272-b6d5-5ff92b938bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Releasing lock "refresh_cache-fbffc715-52da-4a96-83a1-f20898a078ae" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG nova.compute.manager [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Instance network_info: |[{"id": "93c9385f-b22e-4272-b6d5-5ff92b938bec", "address": "fa:16:3e:a3:2a:77", "network": {"id": "496d6e84-b52b-4e7b-90e5-e4acac832552", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2046688465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf7c1ba6a6948e0bbd33a5fd441a8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c9385f-b2", "ovs_interfaceid": "93c9385f-b22e-4272-b6d5-5ff92b938bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73056) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8e485623-1067-4403-92ff-540085212884 req-41b3e9b1-bff0-44b9-a8ff-3be977770c8d service nova] Acquired lock "refresh_cache-fbffc715-52da-4a96-83a1-f20898a078ae" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG nova.network.neutron [req-8e485623-1067-4403-92ff-540085212884 req-41b3e9b1-bff0-44b9-a8ff-3be977770c8d service nova] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Refreshing network info cache for port 93c9385f-b22e-4272-b6d5-5ff92b938bec {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Start _get_guest_xml network_info=[{"id": "93c9385f-b22e-4272-b6d5-5ff92b938bec", "address": "fa:16:3e:a3:2a:77", "network": {"id": "496d6e84-b52b-4e7b-90e5-e4acac832552", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2046688465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf7c1ba6a6948e0bbd33a5fd441a8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c9385f-b2", "ovs_interfaceid": "93c9385f-b22e-4272-b6d5-5ff92b938bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'image_id': '80fe003b-9902-44ab-86de-a284c1e79abd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 17:32:50 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:32:50 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:32:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] CPU controller missing on host. {{(pid=73056) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.host [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] CPU controller found on host. {{(pid=73056) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73056) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T16:32:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T16:32:12Z,direct_url=<?>,disk_format='qcow2',id=80fe003b-9902-44ab-86de-a284c1e79abd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e74ab11f44a44d9a834e80f2683d87d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T16:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Flavor limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Image limits 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Flavor pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Image pref 0:0:0 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Got 1 possible topologies {{(pid=73056) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG nova.virt.hardware [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73056) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T17:32:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-897192186',display_name='tempest-VolumesSnapshotTestJSON-instance-897192186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-897192186',id=52,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJultvAPBNgqiCOgiBcZK9vVNLz2Ro1PVQoaTOQb5sHSFQAlCIhijUaVA0MfuQ9n6S2/vc0jx2lCOcNbO8JHD1Il7ZAcwypoBKzAwdPkEaJ2ECsu1qQ8Y0+9H9VGyGPoRw==',key_name='tempest-keypair-70185107',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdf7c1ba6a6948e0bbd33a5fd441a8b2',ramdisk_id='',reservation_id='r-ih80k6ei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-110053267',owner_user_name='tempest-VolumesSnapshotTestJSON-110053267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T17:32:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc1f9d0085ef4175815a04fa62d46a6d',uuid=fbffc715-52da-4a96-83a1-f20898a078ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93c9385f-b22e-4272-b6d5-5ff92b938bec", "address": "fa:16:3e:a3:2a:77", "network": {"id": "496d6e84-b52b-4e7b-90e5-e4acac832552", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2046688465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf7c1ba6a6948e0bbd33a5fd441a8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c9385f-b2", "ovs_interfaceid": "93c9385f-b22e-4272-b6d5-5ff92b938bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73056) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Converting VIF {"id": "93c9385f-b22e-4272-b6d5-5ff92b938bec", "address": "fa:16:3e:a3:2a:77", "network": {"id": "496d6e84-b52b-4e7b-90e5-e4acac832552", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2046688465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf7c1ba6a6948e0bbd33a5fd441a8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c9385f-b2", "ovs_interfaceid": "93c9385f-b22e-4272-b6d5-5ff92b938bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:2a:77,bridge_name='br-int',has_traffic_filtering=True,id=93c9385f-b22e-4272-b6d5-5ff92b938bec,network=Network(496d6e84-b52b-4e7b-90e5-e4acac832552),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93c9385f-b2') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG nova.objects.instance [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lazy-loading 'pci_devices' on Instance uuid fbffc715-52da-4a96-83a1-f20898a078ae {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] End _get_guest_xml xml=<domain type="kvm">
Aug 14 17:32:50 user nova-compute[73056]:   <uuid>fbffc715-52da-4a96-83a1-f20898a078ae</uuid>
Aug 14 17:32:50 user nova-compute[73056]:   <name>instance-00000034</name>
Aug 14 17:32:50 user nova-compute[73056]:   <memory>524288</memory>
Aug 14 17:32:50 user nova-compute[73056]:   <vcpu>1</vcpu>
Aug 14 17:32:50 user nova-compute[73056]:   <metadata>
Aug 14 17:32:50 user nova-compute[73056]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 17:32:50 user nova-compute[73056]:       <nova:package version="0.0.0"/>
Aug 14 17:32:50 user nova-compute[73056]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-897192186</nova:name>
Aug 14 17:32:50 user nova-compute[73056]:       <nova:creationTime>2023-08-14 17:32:50</nova:creationTime>
Aug 14 17:32:50 user nova-compute[73056]:       <nova:flavor name="m1.tiny">
Aug 14 17:32:50 user nova-compute[73056]:         <nova:memory>512</nova:memory>
Aug 14 17:32:50 user nova-compute[73056]:         <nova:disk>1</nova:disk>
Aug 14 17:32:50 user nova-compute[73056]:         <nova:swap>0</nova:swap>
Aug 14 17:32:50 user nova-compute[73056]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 17:32:50 user nova-compute[73056]:         <nova:vcpus>1</nova:vcpus>
Aug 14 17:32:50 user nova-compute[73056]:       </nova:flavor>
Aug 14 17:32:50 user nova-compute[73056]:       <nova:owner>
Aug 14 17:32:50 user nova-compute[73056]:         <nova:user uuid="cc1f9d0085ef4175815a04fa62d46a6d">tempest-VolumesSnapshotTestJSON-110053267-project-member</nova:user>
Aug 14 17:32:50 user nova-compute[73056]:         <nova:project uuid="fdf7c1ba6a6948e0bbd33a5fd441a8b2">tempest-VolumesSnapshotTestJSON-110053267</nova:project>
Aug 14 17:32:50 user nova-compute[73056]:       </nova:owner>
Aug 14 17:32:50 user nova-compute[73056]:       <nova:root type="image" uuid="80fe003b-9902-44ab-86de-a284c1e79abd"/>
Aug 14 17:32:50 user nova-compute[73056]:       <nova:ports>
Aug 14 17:32:50 user nova-compute[73056]:         <nova:port uuid="93c9385f-b22e-4272-b6d5-5ff92b938bec">
Aug 14 17:32:50 user nova-compute[73056]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 14 17:32:50 user nova-compute[73056]:         </nova:port>
Aug 14 17:32:50 user nova-compute[73056]:       </nova:ports>
Aug 14 17:32:50 user nova-compute[73056]:     </nova:instance>
Aug 14 17:32:50 user nova-compute[73056]:   </metadata>
Aug 14 17:32:50 user nova-compute[73056]:   <sysinfo type="smbios">
Aug 14 17:32:50 user nova-compute[73056]:     <system>
Aug 14 17:32:50 user nova-compute[73056]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 17:32:50 user nova-compute[73056]:       <entry name="product">OpenStack Nova</entry>
Aug 14 17:32:50 user nova-compute[73056]:       <entry name="version">0.0.0</entry>
Aug 14 17:32:50 user nova-compute[73056]:       <entry name="serial">fbffc715-52da-4a96-83a1-f20898a078ae</entry>
Aug 14 17:32:50 user nova-compute[73056]:       <entry name="uuid">fbffc715-52da-4a96-83a1-f20898a078ae</entry>
Aug 14 17:32:50 user nova-compute[73056]:       <entry name="family">Virtual Machine</entry>
Aug 14 17:32:50 user nova-compute[73056]:     </system>
Aug 14 17:32:50 user nova-compute[73056]:   </sysinfo>
Aug 14 17:32:50 user nova-compute[73056]:   <os>
Aug 14 17:32:50 user nova-compute[73056]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 17:32:50 user nova-compute[73056]:     <boot dev="hd"/>
Aug 14 17:32:50 user nova-compute[73056]:     <smbios mode="sysinfo"/>
Aug 14 17:32:50 user nova-compute[73056]:   </os>
Aug 14 17:32:50 user nova-compute[73056]:   <features>
Aug 14 17:32:50 user nova-compute[73056]:     <acpi/>
Aug 14 17:32:50 user nova-compute[73056]:     <apic/>
Aug 14 17:32:50 user nova-compute[73056]:     <vmcoreinfo/>
Aug 14 17:32:50 user nova-compute[73056]:   </features>
Aug 14 17:32:50 user nova-compute[73056]:   <clock offset="utc">
Aug 14 17:32:50 user nova-compute[73056]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 17:32:50 user nova-compute[73056]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 17:32:50 user nova-compute[73056]:     <timer name="hpet" present="no"/>
Aug 14 17:32:50 user nova-compute[73056]:   </clock>
Aug 14 17:32:50 user nova-compute[73056]:   <cpu mode="custom" match="exact">
Aug 14 17:32:50 user nova-compute[73056]:     <model>Nehalem</model>
Aug 14 17:32:50 user nova-compute[73056]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 17:32:50 user nova-compute[73056]:   </cpu>
Aug 14 17:32:50 user nova-compute[73056]:   <devices>
Aug 14 17:32:50 user nova-compute[73056]:     <disk type="file" device="disk">
Aug 14 17:32:50 user nova-compute[73056]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 17:32:50 user nova-compute[73056]:       <source file="/opt/stack/data/nova/instances/fbffc715-52da-4a96-83a1-f20898a078ae/disk"/>
Aug 14 17:32:50 user nova-compute[73056]:       <target dev="vda" bus="virtio"/>
Aug 14 17:32:50 user nova-compute[73056]:     </disk>
Aug 14 17:32:50 user nova-compute[73056]:     <interface type="ethernet">
Aug 14 17:32:50 user nova-compute[73056]:       <mac address="fa:16:3e:a3:2a:77"/>
Aug 14 17:32:50 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 17:32:50 user nova-compute[73056]:       <mtu size="1442"/>
Aug 14 17:32:50 user nova-compute[73056]:       <target dev="tap93c9385f-b2"/>
Aug 14 17:32:50 user nova-compute[73056]:     </interface>
Aug 14 17:32:50 user nova-compute[73056]:     <serial type="pty">
Aug 14 17:32:50 user nova-compute[73056]:       <log file="/opt/stack/data/nova/instances/fbffc715-52da-4a96-83a1-f20898a078ae/console.log" append="off"/>
Aug 14 17:32:50 user nova-compute[73056]:     </serial>
Aug 14 17:32:50 user nova-compute[73056]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 17:32:50 user nova-compute[73056]:     <video>
Aug 14 17:32:50 user nova-compute[73056]:       <model type="virtio"/>
Aug 14 17:32:50 user nova-compute[73056]:     </video>
Aug 14 17:32:50 user nova-compute[73056]:     <rng model="virtio">
Aug 14 17:32:50 user nova-compute[73056]:       <backend model="random">/dev/urandom</backend>
Aug 14 17:32:50 user nova-compute[73056]:     </rng>
Aug 14 17:32:50 user nova-compute[73056]:     <controller type="usb" index="0" model="none"/>
Aug 14 17:32:50 user nova-compute[73056]:     <memballoon model="virtio">
Aug 14 17:32:50 user nova-compute[73056]:       <stats period="10"/>
Aug 14 17:32:50 user nova-compute[73056]:     </memballoon>
Aug 14 17:32:50 user nova-compute[73056]:   </devices>
Aug 14 17:32:50 user nova-compute[73056]: </domain>
Aug 14 17:32:50 user nova-compute[73056]:  {{(pid=73056) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T17:32:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-897192186',display_name='tempest-VolumesSnapshotTestJSON-instance-897192186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-897192186',id=52,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJultvAPBNgqiCOgiBcZK9vVNLz2Ro1PVQoaTOQb5sHSFQAlCIhijUaVA0MfuQ9n6S2/vc0jx2lCOcNbO8JHD1Il7ZAcwypoBKzAwdPkEaJ2ECsu1qQ8Y0+9H9VGyGPoRw==',key_name='tempest-keypair-70185107',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdf7c1ba6a6948e0bbd33a5fd441a8b2',ramdisk_id='',reservation_id='r-ih80k6ei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-110053267',owner_user_name='tempest-VolumesSnapshotTestJSON-110053267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T17:32:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc1f9d0085ef4175815a04fa62d46a6d',uuid=fbffc715-52da-4a96-83a1-f20898a078ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93c9385f-b22e-4272-b6d5-5ff92b938bec", "address": "fa:16:3e:a3:2a:77", "network": {"id": "496d6e84-b52b-4e7b-90e5-e4acac832552", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2046688465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf7c1ba6a6948e0bbd33a5fd441a8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c9385f-b2", "ovs_interfaceid": "93c9385f-b22e-4272-b6d5-5ff92b938bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Converting VIF {"id": "93c9385f-b22e-4272-b6d5-5ff92b938bec", "address": "fa:16:3e:a3:2a:77", "network": {"id": "496d6e84-b52b-4e7b-90e5-e4acac832552", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2046688465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf7c1ba6a6948e0bbd33a5fd441a8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c9385f-b2", "ovs_interfaceid": "93c9385f-b22e-4272-b6d5-5ff92b938bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:2a:77,bridge_name='br-int',has_traffic_filtering=True,id=93c9385f-b22e-4272-b6d5-5ff92b938bec,network=Network(496d6e84-b52b-4e7b-90e5-e4acac832552),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93c9385f-b2') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG os_vif [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:2a:77,bridge_name='br-int',has_traffic_filtering=True,id=93c9385f-b22e-4272-b6d5-5ff92b938bec,network=Network(496d6e84-b52b-4e7b-90e5-e4acac832552),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93c9385f-b2') {{(pid=73056) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93c9385f-b2, may_exist=True, interface_attrs={}) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap93c9385f-b2, col_values=(('external_ids', {'iface-id': '93c9385f-b22e-4272-b6d5-5ff92b938bec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:2a:77', 'vm-uuid': 'fbffc715-52da-4a96-83a1-f20898a078ae'}),), if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:32:50 user nova-compute[73056]: INFO os_vif [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:2a:77,bridge_name='br-int',has_traffic_filtering=True,id=93c9385f-b22e-4272-b6d5-5ff92b938bec,network=Network(496d6e84-b52b-4e7b-90e5-e4acac832552),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93c9385f-b2')
Aug 14 17:32:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] No VIF found with MAC fa:16:3e:a3:2a:77, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG nova.network.neutron [req-8e485623-1067-4403-92ff-540085212884 req-41b3e9b1-bff0-44b9-a8ff-3be977770c8d service nova] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Updated VIF entry in instance network info cache for port 93c9385f-b22e-4272-b6d5-5ff92b938bec. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG nova.network.neutron [req-8e485623-1067-4403-92ff-540085212884 req-41b3e9b1-bff0-44b9-a8ff-3be977770c8d service nova] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Updating instance_info_cache with network_info: [{"id": "93c9385f-b22e-4272-b6d5-5ff92b938bec", "address": "fa:16:3e:a3:2a:77", "network": {"id": "496d6e84-b52b-4e7b-90e5-e4acac832552", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2046688465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf7c1ba6a6948e0bbd33a5fd441a8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c9385f-b2", "ovs_interfaceid": "93c9385f-b22e-4272-b6d5-5ff92b938bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:32:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-8e485623-1067-4403-92ff-540085212884 req-41b3e9b1-bff0-44b9-a8ff-3be977770c8d service nova] Releasing lock "refresh_cache-fbffc715-52da-4a96-83a1-f20898a078ae" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:32:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:32:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:32:51 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:32:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-1dd0b813-31bb-42fb-9f44-4517d41bb813 req-c66b783d-e76b-4705-ae45-10428fee6338 service nova] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Received event network-vif-plugged-93c9385f-b22e-4272-b6d5-5ff92b938bec {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:32:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1dd0b813-31bb-42fb-9f44-4517d41bb813 req-c66b783d-e76b-4705-ae45-10428fee6338 service nova] Acquiring lock "fbffc715-52da-4a96-83a1-f20898a078ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:32:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1dd0b813-31bb-42fb-9f44-4517d41bb813 req-c66b783d-e76b-4705-ae45-10428fee6338 service nova] Lock "fbffc715-52da-4a96-83a1-f20898a078ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:32:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-1dd0b813-31bb-42fb-9f44-4517d41bb813 req-c66b783d-e76b-4705-ae45-10428fee6338 service nova] Lock "fbffc715-52da-4a96-83a1-f20898a078ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:32:51 user nova-compute[73056]: DEBUG nova.compute.manager [req-1dd0b813-31bb-42fb-9f44-4517d41bb813 req-c66b783d-e76b-4705-ae45-10428fee6338 service nova] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] No waiting events found dispatching network-vif-plugged-93c9385f-b22e-4272-b6d5-5ff92b938bec {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:32:51 user nova-compute[73056]: WARNING nova.compute.manager [req-1dd0b813-31bb-42fb-9f44-4517d41bb813 req-c66b783d-e76b-4705-ae45-10428fee6338 service nova] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Received unexpected event network-vif-plugged-93c9385f-b22e-4272-b6d5-5ff92b938bec for instance with vm_state building and task_state spawning.
Aug 14 17:32:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:32:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:32:52 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:32:52 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:32:52 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:32:53 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692034373.5234396, fbffc715-52da-4a96-83a1-f20898a078ae => Resumed> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:32:53 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] VM Resumed (Lifecycle Event)
Aug 14 17:32:53 user nova-compute[73056]: DEBUG nova.compute.manager [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Instance event wait completed in 0 seconds for  {{(pid=73056) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 17:32:53 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Guest created on hypervisor {{(pid=73056) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 17:32:53 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Instance spawned successfully.
Aug 14 17:32:53 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 17:32:53 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:32:53 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 17:32:53 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Found default for hw_cdrom_bus of ide {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:32:53 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Found default for hw_disk_bus of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:32:53 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Found default for hw_input_bus of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:32:53 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Found default for hw_pointer_model of None {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:32:53 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Found default for hw_video_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:32:53 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Found default for hw_vif_model of virtio {{(pid=73056) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 17:32:53 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 17:32:53 user nova-compute[73056]: DEBUG nova.virt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Emitting event <LifecycleEvent: 1692034373.5276337, fbffc715-52da-4a96-83a1-f20898a078ae => Started> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:32:53 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] VM Started (Lifecycle Event)
Aug 14 17:32:53 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:32:53 user nova-compute[73056]: DEBUG nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73056) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 17:32:53 user nova-compute[73056]: INFO nova.compute.manager [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 17:32:53 user nova-compute[73056]: INFO nova.compute.manager [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Took 5.67 seconds to spawn the instance on the hypervisor.
Aug 14 17:32:53 user nova-compute[73056]: DEBUG nova.compute.manager [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:32:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-d604c022-dcbd-40d8-83ed-eebf6e6b5df0 req-ee7e8d08-0b66-4a3e-9b57-cb152bef5fc6 service nova] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Received event network-vif-plugged-93c9385f-b22e-4272-b6d5-5ff92b938bec {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:32:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-d604c022-dcbd-40d8-83ed-eebf6e6b5df0 req-ee7e8d08-0b66-4a3e-9b57-cb152bef5fc6 service nova] Acquiring lock "fbffc715-52da-4a96-83a1-f20898a078ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:32:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-d604c022-dcbd-40d8-83ed-eebf6e6b5df0 req-ee7e8d08-0b66-4a3e-9b57-cb152bef5fc6 service nova] Lock "fbffc715-52da-4a96-83a1-f20898a078ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:32:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-d604c022-dcbd-40d8-83ed-eebf6e6b5df0 req-ee7e8d08-0b66-4a3e-9b57-cb152bef5fc6 service nova] Lock "fbffc715-52da-4a96-83a1-f20898a078ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:32:53 user nova-compute[73056]: DEBUG nova.compute.manager [req-d604c022-dcbd-40d8-83ed-eebf6e6b5df0 req-ee7e8d08-0b66-4a3e-9b57-cb152bef5fc6 service nova] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] No waiting events found dispatching network-vif-plugged-93c9385f-b22e-4272-b6d5-5ff92b938bec {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:32:53 user nova-compute[73056]: WARNING nova.compute.manager [req-d604c022-dcbd-40d8-83ed-eebf6e6b5df0 req-ee7e8d08-0b66-4a3e-9b57-cb152bef5fc6 service nova] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Received unexpected event network-vif-plugged-93c9385f-b22e-4272-b6d5-5ff92b938bec for instance with vm_state building and task_state spawning.
Aug 14 17:32:53 user nova-compute[73056]: INFO nova.compute.manager [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Took 6.58 seconds to build instance.
Aug 14 17:32:53 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-72df1734-5741-4762-967c-c8591ca8b5db tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "fbffc715-52da-4a96-83a1-f20898a078ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.680s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:32:54 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:32:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:33:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:33:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:33:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:33:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:33:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:33:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:33:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:33:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:33:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:33:14 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:33:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:33:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:33:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:33:20 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:33:20 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Cleaning up deleted instances {{(pid=73056) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 17:33:20 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] There are 0 instances to clean {{(pid=73056) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 17:33:24 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:33:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:33:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:33:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:33:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:33:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:33:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:33:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:33:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:33:34 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:33:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:33:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:33:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:33:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:33:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:33:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:33:39 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:33:39 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 17:33:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:33:42 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:33:44 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:33:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:33:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:33:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:33:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:33:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:33:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:33:46 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:33:46 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 17:33:46 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Rebuilding the list of instances to heal {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 17:33:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-fbffc715-52da-4a96-83a1-f20898a078ae" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:33:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-fbffc715-52da-4a96-83a1-f20898a078ae" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:33:46 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 17:33:46 user nova-compute[73056]: DEBUG nova.objects.instance [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lazy-loading 'info_cache' on Instance uuid fbffc715-52da-4a96-83a1-f20898a078ae {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:33:46 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Updating instance_info_cache with network_info: [{"id": "93c9385f-b22e-4272-b6d5-5ff92b938bec", "address": "fa:16:3e:a3:2a:77", "network": {"id": "496d6e84-b52b-4e7b-90e5-e4acac832552", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2046688465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf7c1ba6a6948e0bbd33a5fd441a8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c9385f-b2", "ovs_interfaceid": "93c9385f-b22e-4272-b6d5-5ff92b938bec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:33:46 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-fbffc715-52da-4a96-83a1-f20898a078ae" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:33:46 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 17:33:49 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:33:49 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:33:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:33:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:33:49 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:33:49 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 17:33:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbffc715-52da-4a96-83a1-f20898a078ae/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:33:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbffc715-52da-4a96-83a1-f20898a078ae/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:33:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbffc715-52da-4a96-83a1-f20898a078ae/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:33:49 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbffc715-52da-4a96-83a1-f20898a078ae/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:33:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:33:50 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:33:50 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:33:50 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=8754MB free_disk=25.13503646850586GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 17:33:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:33:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:33:50 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance fbffc715-52da-4a96-83a1-f20898a078ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:33:50 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 17:33:50 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 17:33:50 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Refreshing inventories for resource provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 17:33:50 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Updating ProviderTree inventory for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 17:33:50 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Updating inventory in ProviderTree for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 17:33:50 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Refreshing aggregate associations for resource provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b, aggregates: None {{(pid=73056) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 17:33:50 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Refreshing trait associations for resource provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=73056) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 17:33:50 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:33:50 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:33:50 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 17:33:50 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.323s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:33:51 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:33:54 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:33:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:34:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:34:04 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:34:04 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Triggering sync for uuid fbffc715-52da-4a96-83a1-f20898a078ae {{(pid=73056) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 17:34:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "fbffc715-52da-4a96-83a1-f20898a078ae" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:34:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "fbffc715-52da-4a96-83a1-f20898a078ae" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:34:04 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "fbffc715-52da-4a96-83a1-f20898a078ae" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:34:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:34:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:34:13 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:34:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:34:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:34:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:34:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:34:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:34:36 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:34:38 user nova-compute[73056]: DEBUG nova.compute.manager [req-fd83c045-49b5-4351-a0b7-87ac1bd1d922 req-373ed9b5-5ebc-4e94-9c9d-40c22eb14d5e service nova] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Received event network-changed-93c9385f-b22e-4272-b6d5-5ff92b938bec {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:34:38 user nova-compute[73056]: DEBUG nova.compute.manager [req-fd83c045-49b5-4351-a0b7-87ac1bd1d922 req-373ed9b5-5ebc-4e94-9c9d-40c22eb14d5e service nova] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Refreshing instance network info cache due to event network-changed-93c9385f-b22e-4272-b6d5-5ff92b938bec. {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 17:34:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-fd83c045-49b5-4351-a0b7-87ac1bd1d922 req-373ed9b5-5ebc-4e94-9c9d-40c22eb14d5e service nova] Acquiring lock "refresh_cache-fbffc715-52da-4a96-83a1-f20898a078ae" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:34:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-fd83c045-49b5-4351-a0b7-87ac1bd1d922 req-373ed9b5-5ebc-4e94-9c9d-40c22eb14d5e service nova] Acquired lock "refresh_cache-fbffc715-52da-4a96-83a1-f20898a078ae" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:34:38 user nova-compute[73056]: DEBUG nova.network.neutron [req-fd83c045-49b5-4351-a0b7-87ac1bd1d922 req-373ed9b5-5ebc-4e94-9c9d-40c22eb14d5e service nova] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Refreshing network info cache for port 93c9385f-b22e-4272-b6d5-5ff92b938bec {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 17:34:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Acquiring lock "fbffc715-52da-4a96-83a1-f20898a078ae" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:34:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "fbffc715-52da-4a96-83a1-f20898a078ae" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:34:38 user nova-compute[73056]: DEBUG nova.objects.instance [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lazy-loading 'flavor' on Instance uuid fbffc715-52da-4a96-83a1-f20898a078ae {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:34:38 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Ignoring supplied device name: /dev/vdb
Aug 14 17:34:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "fbffc715-52da-4a96-83a1-f20898a078ae" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:34:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Acquiring lock "fbffc715-52da-4a96-83a1-f20898a078ae" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:34:38 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "fbffc715-52da-4a96-83a1-f20898a078ae" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:34:38 user nova-compute[73056]: INFO nova.compute.manager [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Attaching volume dc74525c-7a91-4a64-86d6-7468f0251d91 to /dev/vdb
Aug 14 17:34:38 user nova-compute[73056]: DEBUG os_brick.utils [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 17:34:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:34:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:34:38 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4933f9-e45e-49e1-b5d4-5f2c9c442fcd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3223cddc864\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:34:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:34:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:34:38 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[84311761-f9ee-4c89-b14d-a5ea033db399]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:34:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:34:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:34:38 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2306715-e035-4bce-9c26-0b56cea515db]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:34:38 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2c5bea-adca-4c80-8b02-0d007bc80dd2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:34:38 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Running cmd (subprocess): nvme version {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:34:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] 'nvme version' failed. Not Retrying. {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 17:34:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] nvme not present on system {{(pid=73056) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 17:34:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:34:39 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 17:34:39 user nova-compute[73056]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 17:34:39 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[98008f37-9df6-4b1d-861f-699991d4d849]: (4, '') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:34:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73056) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 17:34:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 17:34:39 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.lightos [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] LIGHTOS: no hostnqn found. {{(pid=73056) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 17:34:39 user nova-compute[73056]: DEBUG os_brick.utils [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3223cddc864', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 17:34:39 user nova-compute[73056]: DEBUG nova.virt.block_device [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Updating existing volume attachment record: d9a95abc-3d2e-4724-921c-37efc8faf7c5 {{(pid=73056) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 17:34:39 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:34:39 user nova-compute[73056]: DEBUG nova.network.neutron [req-fd83c045-49b5-4351-a0b7-87ac1bd1d922 req-373ed9b5-5ebc-4e94-9c9d-40c22eb14d5e service nova] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Updated VIF entry in instance network info cache for port 93c9385f-b22e-4272-b6d5-5ff92b938bec. {{(pid=73056) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 17:34:39 user nova-compute[73056]: DEBUG nova.network.neutron [req-fd83c045-49b5-4351-a0b7-87ac1bd1d922 req-373ed9b5-5ebc-4e94-9c9d-40c22eb14d5e service nova] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Updating instance_info_cache with network_info: [{"id": "93c9385f-b22e-4272-b6d5-5ff92b938bec", "address": "fa:16:3e:a3:2a:77", "network": {"id": "496d6e84-b52b-4e7b-90e5-e4acac832552", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2046688465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf7c1ba6a6948e0bbd33a5fd441a8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c9385f-b2", "ovs_interfaceid": "93c9385f-b22e-4272-b6d5-5ff92b938bec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:34:39 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-fd83c045-49b5-4351-a0b7-87ac1bd1d922 req-373ed9b5-5ebc-4e94-9c9d-40c22eb14d5e service nova] Releasing lock "refresh_cache-fbffc715-52da-4a96-83a1-f20898a078ae" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:34:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:34:40 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:34:40 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 17:34:42 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:34:44 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:34:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:34:46 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:34:46 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Calling os-brick to attach iSCSI Volume {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 17:34:46 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gbtuZykx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 17:34:46 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 17:34:46 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 17:34:46 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 17:34:46 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 17:34:46 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 17:34:46 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 17:34:46 user nova-compute[73056]: INFO os_brick.initiator.connectors.iscsi [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 17:34:46 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91 -p 172.16.0.220:3260 {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:34:46 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:34:46 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b0ff94-8065-4258-af64-c16aa75caa06]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:34:46 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 17:34:46 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:34:46 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91 -p 172.16.0.220:3260 --interface default --op new {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:34:46 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:34:46 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b394eaf-f89d-463b-b319-8b4923d8174f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91] added\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:34:46 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91] added
Aug 14 17:34:46 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:34:46 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:34:46 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:34:46 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[beeb0799-573d-478e-a8dc-f9350bc49a25]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:34:46 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:34:46 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:34:46 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:34:46 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[86124640-b2fe-4891-8f0e-8829d6a4e52a]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:34:46 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gbtuZykx {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gbtuZykx" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[031c9f2a-0205-449a-8112-2f9513093238]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gbtuZykx'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b964ab23-c6bd-4871-ba16-5c87797dfcc5]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f690f487-ac31-4c7c-90a2-8217fe50be08]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 17:34:47 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 17:34:47 user nova-compute[73056]:  {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 17:34:47 user nova-compute[73056]: WARNING os_brick.initiator.connectors.iscsi [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 17:34:47 user nova-compute[73056]: 
Aug 14 17:34:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91 -p 172.16.0.220:3260 --login {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77abb5a-e2df-4631-b7ed-ba880c1ca771]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91, portal: 172.16.0.220,3260]
Aug 14 17:34:47 user nova-compute[73056]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91, portal: 172.16.0.220,3260] successful.
Aug 14 17:34:47 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4669c4-0284-4430-a3b8-f74e80456c3f]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[82926a5a-cc98-46ea-97ad-070229d2f87c]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91 (non-flash)
Aug 14 17:34:47 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91 (non-flash)
Aug 14 17:34:47 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Connected to 172.16.0.220:3260 {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=73056) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73056) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd506f52-3429-4fad-adbc-2e6037632ec6]: (4, ('- - 0', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73056) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gbtuZykx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73056) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Rebuilding the list of instances to heal {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "refresh_cache-fbffc715-52da-4a96-83a1-f20898a078ae" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquired lock "refresh_cache-fbffc715-52da-4a96-83a1-f20898a078ae" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Forcefully refreshing network info cache for instance {{(pid=73056) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG nova.objects.instance [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lazy-loading 'info_cache' on Instance uuid fbffc715-52da-4a96-83a1-f20898a078ae {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG nova.network.neutron [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Updating instance_info_cache with network_info: [{"id": "93c9385f-b22e-4272-b6d5-5ff92b938bec", "address": "fa:16:3e:a3:2a:77", "network": {"id": "496d6e84-b52b-4e7b-90e5-e4acac832552", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2046688465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf7c1ba6a6948e0bbd33a5fd441a8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c9385f-b2", "ovs_interfaceid": "93c9385f-b22e-4272-b6d5-5ff92b938bec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Releasing lock "refresh_cache-fbffc715-52da-4a96-83a1-f20898a078ae" {{(pid=73056) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 17:34:47 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Updated the network info_cache for instance {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 17:34:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 17:34:48 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23365623430636330', 'path': '/dev/sdb'} {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 17:34:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365623430636330', 'path': '/dev/sdb'} {{(pid=73056) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 17:34:48 user nova-compute[73056]: DEBUG nova.objects.instance [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lazy-loading 'flavor' on Instance uuid fbffc715-52da-4a96-83a1-f20898a078ae {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:34:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 17:34:48 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 17:34:48 user nova-compute[73056]:   <source dev="/dev/sdb"/>
Aug 14 17:34:48 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 17:34:48 user nova-compute[73056]:   <serial>dc74525c-7a91-4a64-86d6-7468f0251d91</serial>
Aug 14 17:34:48 user nova-compute[73056]: </disk>
Aug 14 17:34:48 user nova-compute[73056]:  {{(pid=73056) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 17:34:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] No BDM found with device name vda, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 17:34:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73056) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 17:34:48 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] No VIF found with MAC fa:16:3e:a3:2a:77, not building metadata {{(pid=73056) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 17:34:48 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-2cf15fff-cf39-4168-b5fb-a771cb04df7a tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "fbffc715-52da-4a96-83a1-f20898a078ae" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.878s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:34:49 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:34:49 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:34:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:34:51 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:34:51 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:34:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:34:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:34:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:34:51 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 17:34:51 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbffc715-52da-4a96-83a1-f20898a078ae/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:34:51 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbffc715-52da-4a96-83a1-f20898a078ae/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:34:51 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbffc715-52da-4a96-83a1-f20898a078ae/disk --force-share --output=json {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:34:51 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbffc715-52da-4a96-83a1-f20898a078ae/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73056) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:34:51 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73056) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 17:34:52 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:34:52 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:34:52 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=8736MB free_disk=25.134113311767578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 17:34:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:34:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:34:52 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Instance fbffc715-52da-4a96-83a1-f20898a078ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73056) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 17:34:52 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 17:34:52 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 17:34:52 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:34:52 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:34:52 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 17:34:52 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.253s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:34:54 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:34:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:34:55 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:34:56 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:35:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:35:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:35:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:35:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:35:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0939975b-a043-4b46-a424-b0d43083bfbb tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Acquiring lock "fbffc715-52da-4a96-83a1-f20898a078ae" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0939975b-a043-4b46-a424-b0d43083bfbb tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "fbffc715-52da-4a96-83a1-f20898a078ae" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:35:18 user nova-compute[73056]: INFO nova.compute.manager [None req-0939975b-a043-4b46-a424-b0d43083bfbb tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Detaching volume dc74525c-7a91-4a64-86d6-7468f0251d91
Aug 14 17:35:18 user nova-compute[73056]: INFO nova.virt.block_device [None req-0939975b-a043-4b46-a424-b0d43083bfbb tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Attempting to driver detach volume dc74525c-7a91-4a64-86d6-7468f0251d91 from mountpoint /dev/vdb
Aug 14 17:35:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-0939975b-a043-4b46-a424-b0d43083bfbb tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Attempting to detach device vdb from instance fbffc715-52da-4a96-83a1-f20898a078ae from the persistent domain config. {{(pid=73056) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-0939975b-a043-4b46-a424-b0d43083bfbb tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 17:35:18 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 17:35:18 user nova-compute[73056]:   <source dev="/dev/sdb"/>
Aug 14 17:35:18 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 17:35:18 user nova-compute[73056]:   <serial>dc74525c-7a91-4a64-86d6-7468f0251d91</serial>
Aug 14 17:35:18 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 17:35:18 user nova-compute[73056]: </disk>
Aug 14 17:35:18 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 17:35:18 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-0939975b-a043-4b46-a424-b0d43083bfbb tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Successfully detached device vdb from instance fbffc715-52da-4a96-83a1-f20898a078ae from the persistent domain config.
Aug 14 17:35:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-0939975b-a043-4b46-a424-b0d43083bfbb tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fbffc715-52da-4a96-83a1-f20898a078ae from the live domain config. {{(pid=73056) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.guest [None req-0939975b-a043-4b46-a424-b0d43083bfbb tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 17:35:18 user nova-compute[73056]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 17:35:18 user nova-compute[73056]:   <source dev="/dev/sdb"/>
Aug 14 17:35:18 user nova-compute[73056]:   <target dev="vdb" bus="virtio"/>
Aug 14 17:35:18 user nova-compute[73056]:   <serial>dc74525c-7a91-4a64-86d6-7468f0251d91</serial>
Aug 14 17:35:18 user nova-compute[73056]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 17:35:18 user nova-compute[73056]: </disk>
Aug 14 17:35:18 user nova-compute[73056]:  {{(pid=73056) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Acquiring lock "fbffc715-52da-4a96-83a1-f20898a078ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-5ede10c0-ea4c-4c89-a19d-e39553d4d75b None None] Received event <DeviceRemovedEvent: 1692034518.803416, fbffc715-52da-4a96-83a1-f20898a078ae => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73056) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.driver [None req-0939975b-a043-4b46-a424-b0d43083bfbb tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fbffc715-52da-4a96-83a1-f20898a078ae {{(pid=73056) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 17:35:18 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-0939975b-a043-4b46-a424-b0d43083bfbb tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Successfully detached device vdb from instance fbffc715-52da-4a96-83a1-f20898a078ae from the live domain config.
Aug 14 17:35:18 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0939975b-a043-4b46-a424-b0d43083bfbb tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939975b-a043-4b46-a424-b0d43083bfbb tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gbtuZykx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 17:35:18 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-0939975b-a043-4b46-a424-b0d43083bfbb tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 17:35:18 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-0939975b-a043-4b46-a424-b0d43083bfbb tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-0939975b-a043-4b46-a424-b0d43083bfbb tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939975b-a043-4b46-a424-b0d43083bfbb tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[dddc94f9-e590-487d-a66e-46f3290c2726]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f2242d-63eb-4d8b-b214-3af11718cd40]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91 (non-flash)\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939975b-a043-4b46-a424-b0d43083bfbb tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91 (non-flash)
Aug 14 17:35:18 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939975b-a043-4b46-a424-b0d43083bfbb tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91 (non-flash)
Aug 14 17:35:18 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939975b-a043-4b46-a424-b0d43083bfbb tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff300601750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91'): ({'sdb'}, set())}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-0939975b-a043-4b46-a424-b0d43083bfbb tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Removing single pathed devices sdb {{(pid=73056) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad99a48-d92c-434a-b68a-2833e52c1c4e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba57e8c-f424-436f-aeb5-820c1ef9eedd]: (4, ('ok\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-0939975b-a043-4b46-a424-b0d43083bfbb tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Flushing IO for device /dev/sdb {{(pid=73056) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e10f462-15e1-4ca9-94d2-b52cdc9c3505]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-0939975b-a043-4b46-a424-b0d43083bfbb tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73056) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[9627eba7-8cea-40e5-aa53-6d77c45d36e1]: (4, ('1', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-0939975b-a043-4b46-a424-b0d43083bfbb tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG os_brick.initiator.linuxscsi [None req-0939975b-a043-4b46-a424-b0d43083bfbb tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] SCSI volumes sdb have been removed. {{(pid=73056) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939975b-a043-4b46-a424-b0d43083bfbb tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91')] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4a1e52-8e33-4630-96c9-aa2a60ba2943]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939975b-a043-4b46-a424-b0d43083bfbb tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:35:18 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91 -p 172.16.0.220:3260 --logout {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:35:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:35:19 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4f8977-4de8-47e0-ba13-7c3439723aa2]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:35:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939975b-a043-4b46-a424-b0d43083bfbb tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91, portal: 172.16.0.220,3260]
Aug 14 17:35:19 user nova-compute[73056]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91, portal: 172.16.0.220,3260] successful.
Aug 14 17:35:19 user nova-compute[73056]:  stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:35:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91 -p 172.16.0.220:3260 --op delete {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:35:19 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:35:19 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a302cf-209a-4b1b-8559-4104104038f7]: (4, ('', '')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:35:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939975b-a043-4b46-a424-b0d43083bfbb tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73056) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 17:35:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-0939975b-a043-4b46-a424-b0d43083bfbb tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.252s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 17:35:19 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939975b-a043-4b46-a424-b0d43083bfbb tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] <== disconnect_volume: return (253ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 17:35:19 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0939975b-a043-4b46-a424-b0d43083bfbb tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 17:35:19 user nova-compute[73056]: DEBUG nova.objects.instance [None req-0939975b-a043-4b46-a424-b0d43083bfbb tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lazy-loading 'flavor' on Instance uuid fbffc715-52da-4a96-83a1-f20898a078ae {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:35:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-0939975b-a043-4b46-a424-b0d43083bfbb tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "fbffc715-52da-4a96-83a1-f20898a078ae" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.575s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:35:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "fbffc715-52da-4a96-83a1-f20898a078ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.443s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:35:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Acquiring lock "fbffc715-52da-4a96-83a1-f20898a078ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:35:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "fbffc715-52da-4a96-83a1-f20898a078ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:35:19 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "fbffc715-52da-4a96-83a1-f20898a078ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:35:19 user nova-compute[73056]: INFO nova.compute.manager [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Terminating instance
Aug 14 17:35:19 user nova-compute[73056]: DEBUG nova.compute.manager [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Start destroying the instance on the hypervisor. {{(pid=73056) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 17:35:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:35:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:35:19 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:35:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:35:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:35:20 user nova-compute[73056]: DEBUG nova.compute.manager [req-76d75206-e253-452d-b925-5e16de2200ec req-fb50a90f-e2c9-4fbb-a326-71fbadbd4c5a service nova] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Received event network-vif-unplugged-93c9385f-b22e-4272-b6d5-5ff92b938bec {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:35:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-76d75206-e253-452d-b925-5e16de2200ec req-fb50a90f-e2c9-4fbb-a326-71fbadbd4c5a service nova] Acquiring lock "fbffc715-52da-4a96-83a1-f20898a078ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:35:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-76d75206-e253-452d-b925-5e16de2200ec req-fb50a90f-e2c9-4fbb-a326-71fbadbd4c5a service nova] Lock "fbffc715-52da-4a96-83a1-f20898a078ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:35:20 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-76d75206-e253-452d-b925-5e16de2200ec req-fb50a90f-e2c9-4fbb-a326-71fbadbd4c5a service nova] Lock "fbffc715-52da-4a96-83a1-f20898a078ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:35:20 user nova-compute[73056]: DEBUG nova.compute.manager [req-76d75206-e253-452d-b925-5e16de2200ec req-fb50a90f-e2c9-4fbb-a326-71fbadbd4c5a service nova] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] No waiting events found dispatching network-vif-unplugged-93c9385f-b22e-4272-b6d5-5ff92b938bec {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:35:20 user nova-compute[73056]: DEBUG nova.compute.manager [req-76d75206-e253-452d-b925-5e16de2200ec req-fb50a90f-e2c9-4fbb-a326-71fbadbd4c5a service nova] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Received event network-vif-unplugged-93c9385f-b22e-4272-b6d5-5ff92b938bec for instance with task_state deleting. {{(pid=73056) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 17:35:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:35:20 user nova-compute[73056]: INFO nova.virt.libvirt.driver [-] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Instance destroyed successfully.
Aug 14 17:35:20 user nova-compute[73056]: DEBUG nova.objects.instance [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lazy-loading 'resources' on Instance uuid fbffc715-52da-4a96-83a1-f20898a078ae {{(pid=73056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 17:35:20 user nova-compute[73056]: DEBUG nova.virt.libvirt.vif [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T17:32:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-897192186',display_name='tempest-VolumesSnapshotTestJSON-instance-897192186',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-897192186',id=52,image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJultvAPBNgqiCOgiBcZK9vVNLz2Ro1PVQoaTOQb5sHSFQAlCIhijUaVA0MfuQ9n6S2/vc0jx2lCOcNbO8JHD1Il7ZAcwypoBKzAwdPkEaJ2ECsu1qQ8Y0+9H9VGyGPoRw==',key_name='tempest-keypair-70185107',keypairs=<?>,launch_index=0,launched_at=2023-08-14T17:32:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fdf7c1ba6a6948e0bbd33a5fd441a8b2',ramdisk_id='',reservation_id='r-ih80k6ei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='80fe003b-9902-44ab-86de-a284c1e79abd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-110053267',owner_user_name='tempest-VolumesSnapshotTestJSON-110053267-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T17:32:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc1f9d0085ef4175815a04fa62d46a6d',uuid=fbffc715-52da-4a96-83a1-f20898a078ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93c9385f-b22e-4272-b6d5-5ff92b938bec", "address": "fa:16:3e:a3:2a:77", "network": {"id": "496d6e84-b52b-4e7b-90e5-e4acac832552", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2046688465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf7c1ba6a6948e0bbd33a5fd441a8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c9385f-b2", "ovs_interfaceid": "93c9385f-b22e-4272-b6d5-5ff92b938bec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 17:35:20 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Converting VIF {"id": "93c9385f-b22e-4272-b6d5-5ff92b938bec", "address": "fa:16:3e:a3:2a:77", "network": {"id": "496d6e84-b52b-4e7b-90e5-e4acac832552", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2046688465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdf7c1ba6a6948e0bbd33a5fd441a8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c9385f-b2", "ovs_interfaceid": "93c9385f-b22e-4272-b6d5-5ff92b938bec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 17:35:20 user nova-compute[73056]: DEBUG nova.network.os_vif_util [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:2a:77,bridge_name='br-int',has_traffic_filtering=True,id=93c9385f-b22e-4272-b6d5-5ff92b938bec,network=Network(496d6e84-b52b-4e7b-90e5-e4acac832552),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93c9385f-b2') {{(pid=73056) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 17:35:20 user nova-compute[73056]: DEBUG os_vif [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:2a:77,bridge_name='br-int',has_traffic_filtering=True,id=93c9385f-b22e-4272-b6d5-5ff92b938bec,network=Network(496d6e84-b52b-4e7b-90e5-e4acac832552),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93c9385f-b2') {{(pid=73056) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 17:35:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:35:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93c9385f-b2, bridge=br-int, if_exists=True) {{(pid=73056) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 17:35:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:35:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:35:20 user nova-compute[73056]: INFO os_vif [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:2a:77,bridge_name='br-int',has_traffic_filtering=True,id=93c9385f-b22e-4272-b6d5-5ff92b938bec,network=Network(496d6e84-b52b-4e7b-90e5-e4acac832552),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93c9385f-b2')
Aug 14 17:35:20 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] calling os-brick to detach iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 17:35:20 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3006e89a0>, {'target_iqns': ['iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gbtuZykx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 17:35:20 user nova-compute[73056]: WARNING os_brick.initiator.connectors.base [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 17:35:20 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 17:35:20 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 17:35:20 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc74525c-7a91-4a64-86d6-7468f0251d91', 0)] {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 17:35:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:35:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 21 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:35:20 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb355d0-54f6-4691-b05a-05f201e50798]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:35:20 user nova-compute[73056]: WARNING os_brick.initiator.connectors.iscsi [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
Aug 14 17:35:20 user nova-compute[73056]: 
Aug 14 17:35:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 17:35:20 user nova-compute[73056]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83519) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 17:35:20 user nova-compute[73056]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b0e6d8-0978-467e-9fa6-34001d15d975]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 17:35:20 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 17:35:20 user nova-compute[73056]:  {{(pid=73056) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 17:35:20 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 17:35:20 user nova-compute[73056]:  {{(pid=73056) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 17:35:20 user nova-compute[73056]: WARNING os_brick.initiator.connectors.iscsi [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 17:35:20 user nova-compute[73056]: 
Aug 14 17:35:20 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff2dcd7f010>, {}) {{(pid=73056) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 17:35:20 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Disconnecting from: [] {{(pid=73056) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 17:35:20 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.base [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.042s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 17:35:20 user nova-compute[73056]: DEBUG os_brick.initiator.connectors.iscsi [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] <== disconnect_volume: return (44ms) None {{(pid=73056) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 17:35:20 user nova-compute[73056]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Disconnected iSCSI Volume {{(pid=73056) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 17:35:20 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Deleting instance files /opt/stack/data/nova/instances/fbffc715-52da-4a96-83a1-f20898a078ae_del
Aug 14 17:35:20 user nova-compute[73056]: INFO nova.virt.libvirt.driver [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Deletion of /opt/stack/data/nova/instances/fbffc715-52da-4a96-83a1-f20898a078ae_del complete
Aug 14 17:35:20 user nova-compute[73056]: INFO nova.compute.manager [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 14 17:35:20 user nova-compute[73056]: DEBUG oslo.service.loopingcall [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73056) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 17:35:20 user nova-compute[73056]: DEBUG nova.compute.manager [-] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Deallocating network for instance {{(pid=73056) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 17:35:20 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] deallocate_for_instance() {{(pid=73056) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 17:35:21 user nova-compute[73056]: DEBUG nova.network.neutron [-] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:35:21 user nova-compute[73056]: DEBUG nova.compute.manager [req-d9c4612b-3d9f-4b23-9d8e-903b739f81be req-f07a3fff-f197-4d72-81a0-e43b39b9276c service nova] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Received event network-vif-deleted-93c9385f-b22e-4272-b6d5-5ff92b938bec {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:35:21 user nova-compute[73056]: INFO nova.compute.manager [req-d9c4612b-3d9f-4b23-9d8e-903b739f81be req-f07a3fff-f197-4d72-81a0-e43b39b9276c service nova] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Neutron deleted interface 93c9385f-b22e-4272-b6d5-5ff92b938bec; detaching it from the instance and deleting it from the info cache
Aug 14 17:35:21 user nova-compute[73056]: DEBUG nova.network.neutron [req-d9c4612b-3d9f-4b23-9d8e-903b739f81be req-f07a3fff-f197-4d72-81a0-e43b39b9276c service nova] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Updating instance_info_cache with network_info: [] {{(pid=73056) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 17:35:21 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Took 0.99 seconds to deallocate network for instance.
Aug 14 17:35:21 user nova-compute[73056]: DEBUG nova.compute.manager [req-d9c4612b-3d9f-4b23-9d8e-903b739f81be req-f07a3fff-f197-4d72-81a0-e43b39b9276c service nova] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Detach interface failed, port_id=93c9385f-b22e-4272-b6d5-5ff92b938bec, reason: Instance fbffc715-52da-4a96-83a1-f20898a078ae could not be found. {{(pid=73056) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 17:35:21 user nova-compute[73056]: WARNING nova.volume.cinder [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Attachment d9a95abc-3d2e-4724-921c-37efc8faf7c5 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = d9a95abc-3d2e-4724-921c-37efc8faf7c5. (HTTP 404) (Request-ID: req-23657e11-d720-48a8-96f6-308d9ff1c43b)
Aug 14 17:35:21 user nova-compute[73056]: INFO nova.compute.manager [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Took 0.05 seconds to detach 1 volumes for instance.
Aug 14 17:35:21 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:35:21 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:35:21 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:35:21 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:35:21 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.104s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:35:22 user nova-compute[73056]: INFO nova.scheduler.client.report [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Deleted allocations for instance fbffc715-52da-4a96-83a1-f20898a078ae
Aug 14 17:35:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-3144fbee-b973-4aae-a869-a1345539dea4 tempest-VolumesSnapshotTestJSON-110053267 tempest-VolumesSnapshotTestJSON-110053267-project-member] Lock "fbffc715-52da-4a96-83a1-f20898a078ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.317s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:35:22 user nova-compute[73056]: DEBUG nova.compute.manager [req-88099496-f389-441b-9308-465a8a732512 req-4a4fea4e-9322-41ec-805f-e6ab5c1c2e05 service nova] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Received event network-vif-plugged-93c9385f-b22e-4272-b6d5-5ff92b938bec {{(pid=73056) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 17:35:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-88099496-f389-441b-9308-465a8a732512 req-4a4fea4e-9322-41ec-805f-e6ab5c1c2e05 service nova] Acquiring lock "fbffc715-52da-4a96-83a1-f20898a078ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:35:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-88099496-f389-441b-9308-465a8a732512 req-4a4fea4e-9322-41ec-805f-e6ab5c1c2e05 service nova] Lock "fbffc715-52da-4a96-83a1-f20898a078ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:35:22 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [req-88099496-f389-441b-9308-465a8a732512 req-4a4fea4e-9322-41ec-805f-e6ab5c1c2e05 service nova] Lock "fbffc715-52da-4a96-83a1-f20898a078ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:35:22 user nova-compute[73056]: DEBUG nova.compute.manager [req-88099496-f389-441b-9308-465a8a732512 req-4a4fea4e-9322-41ec-805f-e6ab5c1c2e05 service nova] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] No waiting events found dispatching network-vif-plugged-93c9385f-b22e-4272-b6d5-5ff92b938bec {{(pid=73056) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 17:35:22 user nova-compute[73056]: WARNING nova.compute.manager [req-88099496-f389-441b-9308-465a8a732512 req-4a4fea4e-9322-41ec-805f-e6ab5c1c2e05 service nova] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Received unexpected event network-vif-plugged-93c9385f-b22e-4272-b6d5-5ff92b938bec for instance with vm_state deleted and task_state None.
Aug 14 17:35:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:35:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:35:35 user nova-compute[73056]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692034520.6039076, fbffc715-52da-4a96-83a1-f20898a078ae => Stopped> {{(pid=73056) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 17:35:35 user nova-compute[73056]: INFO nova.compute.manager [-] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] VM Stopped (Lifecycle Event)
Aug 14 17:35:35 user nova-compute[73056]: DEBUG nova.compute.manager [None req-701c455b-1c73-41dc-9eeb-b5f656b32471 None None] [instance: fbffc715-52da-4a96-83a1-f20898a078ae] Checking state {{(pid=73056) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 17:35:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:35:38 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:35:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:35:42 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:35:42 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 17:35:43 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:35:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:35:48 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:35:48 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 17:35:48 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Rebuilding the list of instances to heal {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 17:35:48 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Didn't find any instances for network info cache update. {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 17:35:48 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:35:50 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:35:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:35:51 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:35:51 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:35:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:35:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:35:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:35:51 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 17:35:51 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:35:51 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:35:51 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=8896MB free_disk=25.161006927490234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 17:35:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:35:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:35:51 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 17:35:51 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 17:35:51 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:35:51 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:35:51 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 17:35:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:35:54 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:35:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:36:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:36:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:36:09 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:36:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:36:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:36:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:36:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:36:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:36:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:36:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:36:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:36:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:36:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:36:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:36:38 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:36:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:36:43 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:36:43 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 17:36:45 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:36:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:36:48 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:36:48 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 17:36:48 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Rebuilding the list of instances to heal {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 17:36:48 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Didn't find any instances for network info cache update. {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 17:36:50 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:36:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:36:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:36:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:36:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:36:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:36:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:36:51 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:36:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:36:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:36:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:36:51 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 17:36:51 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:36:51 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:36:51 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=8896MB free_disk=25.159576416015625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 17:36:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:36:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:36:51 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 17:36:51 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 17:36:51 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:36:51 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:36:51 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 17:36:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.103s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:36:52 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:36:52 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:36:54 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:36:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:36:58 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:37:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:37:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:37:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:37:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:37:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:37:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:37:05 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:37:10 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:37:15 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:37:17 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:37:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:37:20 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:37:25 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:37:30 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:37:35 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:37:40 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:37:40 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:37:44 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:37:44 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73056) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 17:37:45 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:37:47 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:37:50 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:37:50 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Starting heal instance info cache {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 17:37:50 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Rebuilding the list of instances to heal {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 17:37:50 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Didn't find any instances for network info cache update. {{(pid=73056) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 17:37:50 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:37:50 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:37:51 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:37:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:37:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:37:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:37:51 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Auditing locally available compute resources for user (node: user) {{(pid=73056) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 17:37:51 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:37:51 user nova-compute[73056]: WARNING nova.virt.libvirt.driver [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 17:37:51 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Hypervisor/Node resource view: name=user free_ram=9018MB free_disk=25.156726837158203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73056) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 17:37:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 17:37:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 17:37:51 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 17:37:51 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73056) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 17:37:51 user nova-compute[73056]: DEBUG nova.compute.provider_tree [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed in ProviderTree for provider: 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b {{(pid=73056) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 17:37:51 user nova-compute[73056]: DEBUG nova.scheduler.client.report [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Inventory has not changed for provider 2a2ae4c4-4e2e-4af7-a57a-7cae35a0592b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73056) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 17:37:51 user nova-compute[73056]: DEBUG nova.compute.resource_tracker [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Compute_service record updated for user:user {{(pid=73056) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 17:37:51 user nova-compute[73056]: DEBUG oslo_concurrency.lockutils [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.110s {{(pid=73056) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 17:37:52 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:37:53 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:37:53 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:37:53 user nova-compute[73056]: DEBUG nova.compute.manager [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73056) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 17:37:54 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:37:55 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:38:00 user nova-compute[73056]: DEBUG oslo_service.periodic_task [None req-20657c0b-e6ca-47c1-9334-f3c5c33e27e2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73056) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 17:38:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 17:38:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 17:38:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73056) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 17:38:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:38:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73056) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 17:38:00 user nova-compute[73056]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73056) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}